An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
Hi, @Ganesh Chelluri
Thank you for the detailed explanation. That makes things much clearer.
Based on your explanation, I now understand that the increases in Data Movement, Pipeline Activity, and External Pipeline Activity are expected as a consequence of moving to Private Link and the Managed VNet Integration Runtime.
I have now gathered the monthly cost data around the migration to perform a more thorough comparison. From what I found:
- Data Movement costs approximately doubled.
- Activity Orchestration remained the same
- Pipeline Activity and External Pipeline Activity both increased dramatically, going from almost negligible costs before the migration to around USD 600 each afterward.
Given these results, is there any additional optimization you would recommend to further reduce these costs?
Also, regarding your suggestion to enable TTL on the Managed VNet Integration Runtime, I wasn't able to find that setting in our Synapse workspace. We have the default AutoResolveIntegrationRuntime configured as a Managed VNet Azure Integration Runtime, along with a Self-hosted Integration Runtime, but I don't see any TTL option exposed in the Managed VNet IR configuration. Could you clarify where this setting can be configured in Synapse, or were you referring to Azure Data Factory?
Thank you again for your help.