Thank you for your feedback.
Form temporarily unavailable. Please try again or contact to submit your comments.
  • London
  • Kingston
  • Jakarta
  • Istanbul
  • Helsinki
  • Geneva
  • Store

Import set performance

Import set performance

An algorithm is used to transform import sets from their staging table into their final destination.

Importing data via an import set requires the following two phases.
  1. The data is loaded from a data source into a staging table.
  2. The data is transformed from the staging table into a target table.

The transform algorithm operates in blocks of 100 records at a time. This approach allows the application server to pre-fetch a variety of information relevant to each block of records. This action reduces the number of unique interactions with the database and improves throughput.

Performance is improved for all large transformations are using this algorithm. It also improves transformations with many reference or choice type columns. Transformations that with complex or unkeyed coalesce conditions experience a proportionately smaller benefit from the algorithm.

This site is scheduled for a small content update on Tuesday, December 18th, between the hours of 4:00pm and 8:00pm Pacific Time (Dec 19 00:00 – Dec 19 4:00 UTC). Access to this site may be slightly delayed during that time.