Learning Objectives #
In SKYVVA, the bulk-loading option increases the performance of a session where huge volumes of data are involved. During bulk loading, the Integration Service bypasses the database log, which results in performance improvement. Without writing to the database log, however, the target database cannot perform a rollback. While using bulk loading, the need for improved session performance must be weighed against the ability to recover an incomplete session.
Introduction #
The Data Integration Service can use the SKYVVA Bulk API to write data to sObjects. Use the Bulk API to write large amounts of data to Salesforce with a minimal number of API calls. Users can use the Bulk API to write data to Salesforce targets with Salesforce API version 31.0.
With a Bulk API write, each batch of data can contain up to 10,000 records or one million characters of data in CSV format. When the Data Integration Service creates a batch, it adds required characters such as quotation marks around text, to format the data.
Users can configure a Bulk API target session to load batches serially or in parallel. By default, the data load is in parallel mode, but you can override the data load to serial mode. Users can also monitor the progress of batches in the session log.
To configure a session to use the Bulk API for Salesforce targets, select the Use SKYVVA Bulk API session property. When the user selects this property, the Data Integration Service ignores the Max Batch Size session property.
SKYVVA Bulk Interface Processing #
SKYVVA Bulk Interface Processing is an interface uses for running bulk attachments. When the user has much data, using Bulk Interface Processing is necessary (over 5000 records). Before configuring Bulk Interface Processing, the user has to know about the parameters:
BULK Mode: Check this flag if you want to run interface in a bulk mode using Salesforce BULK API.
Bulk Version: We support SFDC pure bulk mode in version 1.0 or 2.0. Then we have our own SKYVVA bulk mode. This uses SKYVVA workflow and mapping and thus is more powerful but slower than the pure bulk API technique from Salesforce. This one is SKYVVA’s own bulk mode.
Bulk Processing Mode: This field indicates the two-mode, which is support with bulk version 1.0. With bulk, version 2.0 only parallel mode is supported. Therefore, the value here depends on the selection of the field bulk version e.g. when we want to use ‘Serial’ then we need to choose ‘Bulk V 1.0’.
How to Use Bulk Processing Mode with Agent? #
Using SKYVVA Bulk version
- Create Integration
- Create Interface
- Click on Interface
- Scroll down to the Bulk Setting section
- Check flag of BULK Mode
- Select SKYVVA Bulk1.0 value from the picklist
- Save
- Scroll down to Source Definition section
- Choose file & Save
- Click on Open Mapping Button
- Select Ext Id
- Save
Go to SKYVVA Agent configure with your Salesforce Org. Which is obvious
- Select Integration Name
- Select SKYVVA Bulk Interface
- Click on Edit Interface
- Select File Folder
- Write File Name
- Click on Test Query
- Save
- Select your Interface SKYVVA Bulk
- Click on the Process button
- Process Completed
- Click ok button
Go back to your Salesforce Org.
- Go to Integration Detail page
- Click on Bulk Control Board
- Drop down and select your Inbound Interface
- Click on the Search button
- Now click on timer logo
- Set Time Interval lets play with 2 min.
- Save
- Click on Action button and start Scheduler
- See message pop up in dialogue box Bulk Schedule Job is running
- See Bulk Data Inbox shows total no. of records
- Bulk Data Monitor shows the no. of records which are 10
- Status Completed