Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
Azure Data Factory Salesforce Connector and Salesforce Bulk API v2.0 support
Javier Callico
11
Reputation points
As per documentation:
The Salesforce connector is built on top of the Salesforce REST/Bulk API. When copying data from Salesforce, the connector automatically chooses between REST and Bulk APIs based on the data size – when the result set is large, Bulk API is used for better performance; You can explicitly set the API version used to read/write data via apiVersion property in linked service.
What version of the Bulk API is currently supported, v1.0 or v2.0? There are major differences between both versions.
Also, the internal criteria to use REST vs Bulk is not clearly defined: what is the data size limit and/or other criteria that causes the connector to decide? Any way to force the connector to use the Bulk API?
Any information regarding this subject will be greatly appreciated.
Azure Data Factory
-
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(204.8, 44%, 29%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESS%3C/text%3E%3C/svg%3E)
Saurabh Sharma 23,866 Reputation points Microsoft Employee Moderator2021-12-04T13:32:05.227+00:00 Hi @Javier Callico ,
Thanks for using Microsoft Q&A !!
I am checking internally with the products team and get back to you.Thanks
Saurabh -
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(115.19999999999999, 94%, 21%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMP%3C/text%3E%3C/svg%3E)
Muralikrishna Pirla 216 Reputation points2021-12-07T07:15:43.68+00:00 Even I have the same situation with my source, just 4GB of data is taking more than 9 hours to copy from salesforce, is there any way we can set to use the Bulk API 2.0 to improve the performance.
-
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(188.79999999999998, 33%, 28%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EPM%3C/text%3E%3C/svg%3E)
PIERRE MASSE 1 Reputation point2021-12-10T10:31:57.757+00:00 Hi all,
I have the exact same requirement. I am currently using Azure Data Factory as an ETL for a Salesforce data initialization, and our Salesforce tech architect require that all data loading be done through Bulk API V2.0.
The first test I did showed that the latest available version in the Salesforce Linked Service (v52.0) uses the Bulk API V1.0 on Salesforce side.
Could you please keep us posted @Saurabh Sharma ?
Thanks a lot!
Pierre -
Saurabh Sharma 23,866 Reputation points Microsoft Employee Moderator
2021-12-10T20:16:18.347+00:00 @Javier Callico @PIERRE MASSE @muralikrishna-2396
Can you please open a support ticket so that an engineer could help you addressing your issues. In case you have a limitation, please send an email to azcommunity[at]microsoft[dot]com with your subscription id with this Q&A thread link and subject as "Attn: Saurabh' and I will help providing a free support ticket for you.
Thanks
Saurabh -
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(249.60000000000002, 95%, 34%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EGP%3C/text%3E%3C/svg%3E)
Govind Patwa 1 Reputation point2022-02-12T18:59:41.033+00:00 Hi Saurabh, I am also looking for the same solution. Can I too create a support ticket? Or any reference to the document will be helpful
Regards
Govind -
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(281.6, 79%, 37%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EDM%3C/text%3E%3C/svg%3E)
David Mixon 1 Reputation point2022-04-14T20:42:20.557+00:00 Hi Saurabh,
Was an answer ever determined for this question? "What version of the Bulk API is currently supported, v1.0 or v2.0?".
Thanks,
David
-
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(67.2, 99%, 16%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EVR%3C/text%3E%3C/svg%3E)
Venkoba Rao Jujaray 0 Reputation points2024-08-14T15:32:28.97+00:00 I am also expolring the same solution getting the data from salesforce using BULK API and ADF piple lines or Databricks
Regards
Rao
-
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(73.60000000000001, 1%, 17%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EPV%3C/text%3E%3C/svg%3E)
Pitta, Vamshidhar R 0 Reputation points2025-10-03T20:18:41.2133333+00:00 Enable automatic partition detection in the pipeline. This option isn’t available as a checkbox but can be added directly to the JSON configuration file. It helps optimize performance for large data loads.
Sign in to comment
Sign in to answer