An Apache Spark-based analytics platform optimized for Azure.
Hi @data engineerlin ,
Thank you for sharing the resolution.
Based on the final findings, the issue was not related to the Azure Databricks Access Connector, managed identity permissions, storage RBAC, or the storage account configuration.
Root cause:
The Databricks AccountAdmin CLI profile was configured with the workspace URL instead of the Databricks Account Console URL (https://accounts.azuredatabricks.net).
As a result:
- Account-level Unity Catalog and Metastore API calls were sent to the wrong endpoint.
- The Databricks CLI returned 404 Not Found errors.
- The Catalog section in the Account Console displayed "Not Found".
- Metastore creation and management operations failed even though the Access Connector and storage permissions were configured correctly.
Resolution:
- Updated the AccountAdmin CLI profile to use the Databricks Account Console host (
https://accounts.azuredatabricks.net). - Created a separate CLI profile for the workspace URL.
- Re-authenticated both profiles.
- Verified that account-level commands could successfully list and manage metastores.
- Recreated and assigned a new Unity Catalog metastore to the workspace.
- Recreated the Access Connector and storage credential after the previous configuration had been removed.
- Confirmed the new metastore appeared correctly in both the Account Console and Workspace Catalog UI.
I'm glad to hear the issue has been resolved and Unity Catalog is now functioning as expected. Thanks for sharing the root cause and resolution with the community. Thank you for sharing the resolution.
Based on the final findings, the issue was not related to the Azure Databricks Access Connector, managed identity permissions, storage RBAC, or the storage account configuration.