An Apache Spark-based analytics platform optimized for Azure.
Hi @Akash S ,
Yes, apart from Azure Standard Load Balancer, there are several Azure-native options available for enabling connectivity between Azure Databricks (DBX) and Azure Kubernetes Service (AKS), depending on your networking and security requirements.
Some commonly used approaches are:
- Azure Application Gateway: Recommended when AKS workloads are exposed through HTTP/HTTPS endpoints and require Layer 7 routing, SSL termination, or Web Application Firewall (WAF) capabilities.
- Azure Private Link / Private Endpoints: Recommended for secure private connectivity between Databricks and AKS services without exposing traffic to the public internet.
- VNet Peering: Suitable when Databricks and AKS are deployed in different virtual networks and need private network connectivity.
- Azure API Management (APIM): Useful when AKS services are exposed as APIs and require centralized authentication, authorization, throttling, and governance.
- NGINX Ingress Controller or Application Gateway Ingress Controller (AGIC): Commonly used within AKS to expose and manage application traffic.
From a security and architecture perspective, if the requirement is to allow Azure Databricks to communicate privately with services hosted on AKS, the recommended approach is typically:
Azure Databricks → VNet Peering / Private Link → AKS Internal Service
This avoids exposing AKS services publicly while providing secure and controlled communication between the platforms.
To recommend the most appropriate solution, could you please clarify:
- Is the AKS service exposed internally or externally?
- Is Azure Databricks deployed with VNet Injection enabled?
- Are you looking for private connectivity, API access, or load-balanced application access?
This information will help determine the best architecture for your scenario.
If this answer helps, please consider clicking Accept Answer so that other community members with similar requirements can benefit from it as well.
If you have any further questions, please let us know. We will be happy to assist.