How do I connect to my AKS from Azure databricks Serverless workspace?

Akash S 6 Reputation points
2026-08-10T16:30:29.54+00:00

How do I connect to my AKS from Azure databricks Serverless workspace? My Serverless workspace is private endpoint enabled. Is it possible to connect via NCC? If not, what options we have? Connection should be all private without any public.

Azure Databricks
Azure Databricks

An Apache Spark-based analytics platform optimized for Azure.


2 answers

Sort by: Most helpful
  1. Himaja Y 375 Reputation points Microsoft External Staff Moderator
    2026-08-24T15:50:12.7533333+00:00

    Hi @Akash S ,

    Yes, apart from Azure Standard Load Balancer, there are several Azure-native options available for enabling connectivity between Azure Databricks (DBX) and Azure Kubernetes Service (AKS), depending on your networking and security requirements.

    Some commonly used approaches are:

    • Azure Application Gateway: Recommended when AKS workloads are exposed through HTTP/HTTPS endpoints and require Layer 7 routing, SSL termination, or Web Application Firewall (WAF) capabilities.
    • Azure Private Link / Private Endpoints: Recommended for secure private connectivity between Databricks and AKS services without exposing traffic to the public internet.
    • VNet Peering: Suitable when Databricks and AKS are deployed in different virtual networks and need private network connectivity.
    • Azure API Management (APIM): Useful when AKS services are exposed as APIs and require centralized authentication, authorization, throttling, and governance.
    • NGINX Ingress Controller or Application Gateway Ingress Controller (AGIC): Commonly used within AKS to expose and manage application traffic.

    From a security and architecture perspective, if the requirement is to allow Azure Databricks to communicate privately with services hosted on AKS, the recommended approach is typically:

    Azure Databricks → VNet Peering / Private Link → AKS Internal Service

    This avoids exposing AKS services publicly while providing secure and controlled communication between the platforms.

    To recommend the most appropriate solution, could you please clarify:

    • Is the AKS service exposed internally or externally?
    • Is Azure Databricks deployed with VNet Injection enabled?
    • Are you looking for private connectivity, API access, or load-balanced application access?

    This information will help determine the best architecture for your scenario.

    If this answer helps, please consider clicking Accept Answer so that other community members with similar requirements can benefit from it as well.

    If you have any further questions, please let us know. We will be happy to assist.

    Was this answer helpful?

    0 comments No comments

  2. Jose Benjamin Solis Nolasco 12,116 Reputation points Volunteer Moderator
    2026-08-10T18:19:48.6666667+00:00

    Hello @Akash S , I hope you are doing well,

    Yes, you can keep the connection fully private.

    The Databricks workspace Private Endpoint does not provide outbound connectivity from Serverless compute to AKS. For this scenario, use a Network Connectivity Configuration (NCC) with a private endpoint.

    A typical architecture is:

    Databricks Serverless → NCC → Private Endpoint → Standard Load Balancer → AKS service

    This avoids exposing the AKS application through a public endpoint.

    References:

    Serverless private connectivity – Microsoft Learn

    If my answer helped you, please consider marking it as accepted. This helps others in the community find similar solutions.

    Was this answer helpful?


Your answer

Answers can be marked as 'Accepted' by the question author and 'Recommended' by moderators, which helps users know the answer solved the author's problem.