Databricks Simplifies Data Sharing

Databricks is rolling out OpenSharing SecureConnect, a new feature designed to simplify and secure the process of sharing live data across organizations. This addresses a significant hurdle for companies dealing with sensitive or regulated data that resides behind private networks.

Previously, sharing data externally meant providers had to manually configure network access for each recipient, often involving lengthy back-and-forth with IT administrators. This could take weeks for each new connection, creating bottlenecks and forcing compromises on security or data location.

Eliminating Network Headaches

SecureConnect introduces a Databricks-managed proxy for storage access. Data providers configure their storage to allow access from Databricks' network once. From that point, Databricks handles routing storage access for new recipients through this proxy.

This eliminates the need for providers to update firewalls for every new user and simplifies recipient onboarding to near-zero configuration, especially for serverless users.

Enhanced Security and Flexibility

For an added layer of security, providers can optionally leverage Network Connectivity Configuration (NCC) to establish private link connectivity between the Databricks proxy and their storage. Mutual TLS is also supported for enhanced data recipient security.

The system works seamlessly across different cloud regions and providers, supporting both customer-managed storage and Databricks Default Storage.

Getting Started

OpenSharing SecureConnect is currently in Public Preview. Users can enable it via their Databricks workspace settings, with full documentation available in the Open Sharing SecureConnect documentation.