Bulk Processing uses for running attachment as batch too. It has more ability than synchronous, batch and running with huge records at high speed. The Records have more than 5000, so user uses with bulk processing. It can contain many records in an attachment, and the user can set the time interval in bulk processing scheduler of SKYVVA or Agent Scheduler to run anytime that you want. However, there are two options of bulk processing which is including SKYVVA bulk and SFDC bulk. The following section will be explained more detail about these two modes.
SKYVVA Bulk Interface Processing #
SKYVVA Bulk Interface Processing is an interface uses for running bulk attachments. When the user has much data, using Bulk Interface Processing is necessary (over 5000 records). Before configuring Bulk Interface Processing, the user has to know about the parameters:
- BULK Mode: Check this flag if you want to run interface in a bulk mode using Salesforce BULK API.
- Bulk Version: We support SFDC pure bulk mode in version 1.0 or 2.0. Then we have our own SKYVVA bulk mode. This uses SKYVVA workflow and mapping and thus is more powerful but slower than the pure bulk API technique from Salesforce. This one is SKYVVA’s own bulk mode.
- Bulk Processing Mode: This field indicates the two-mode, which is support with bulk version 1.0. With bulk, version 2.0 only parallel mode is supported. Therefore, the value here depends on the selection of the field bulk version e.g. when we want to use ‘Serial’ then we need to choose ‘Bulk V 1.0’. There are two modes which are:
- Parallel: When you select this processing mode, it will run parallel.
- Serial: When you select this mode, it will not run at the same time.
- Bulk Package Size: This parameter determines how many records are split into Bulk data size. If your Message contains 10.000 records and the value for this parameter is 1000 so the user will get 10 bulk data set in Salesforce.
- Bulk Monitor Keep Size: The number of bulk execute logs to be kept.
- Bulk Sch Frequency: This is the schedule time frequency for the bulk scheduler on the interface.
- Bulk Integrate Time Interval (minute): The interval (minutes) used to integrate bulk job scheduler. For example, if its value is 10, then the integrate bulk scheduler will be run every 10 minutes.
Configuring of Bulk Interface Processing #
This section will be explained by the configuring of Bulk Interface Processing. Assuming you are already created Integration and interface. To understand the process, please follow the steps below:
- Enter Interface page detail
- Scroll down the page to the Streaming and Bulk API Configuration section and configure the parameters as:
Check the flag on BULK Mode
Choose the Bulk Version and Bulk Processing Mode
When the user checks this flag, it means you activate the bulk processing and your data will be integrated from Agent.
Monitoring in Bulk Control Board #
As you did integrate, your data you might want to check or monitor if all your data are successfully integrated. To monitor bulk data, please log in to Salesforce and enter Bulk Control Board. If you want to know more and how to use Bulk Control Board, please kindly look for this documentation (How to use Bulk Control Board).
There are three orders to monitor bulk processing:
- New Baskets
- Current Processing Baskets
- Processed Baskets
To monitor in New Baskets #
When data pushed from the client using Bulk API, they will appear in this section. As you can see below, there are 1000 records are integrated from Agent. There are five attachments that you can do manual reprocessing by checkbox and click on “Process Bulk Attachment” or you can set the time and then start the scheduler in Scheduler Tab.
Set the scheduler #
This section will allow you to set the Scheduler and start it.
To monitor in Current Basket Processing #
Bulk Data Processing is using to store data that are processing. These data will remove after it has done to the Bulk Monitor section. Whenever all the attachments that store has faced some problems like crashing you can use the delete button to eliminate them. However, if you want to stop these attachments processing you need to go to Apex job to abort them. Otherwise, the attachment will keep on processing. You can do reprocessing by checkbox and click on the “Re-Initialload” button.
To monitor in Processed Baskets #
At the same time, all the attachments will also move to “Bulk monitor“. In this section, you can monitor the total records of attachments, total batch and batches that had processed. Likewise, you can also know if the attachment is completed, failed or pending.