Sorted Merge

Description

The Sorted Merge step merges rows coming from multiple input steps providing these rows are sorted themselves on the given key fields.

Use case: When you use multiple copies of the Sort rows step in parallel (on the local JVM with "Change number of copies to start" or in a clustered environment using Carte) each of the sorted blocks need to be merged together to ensure the proper sort sequence. This can be done by adding the Sorted Merge step afterwards (on the local JVM without multiple copies to start or in the cluster on the master).

Options

Option

Description

Step name

Name of the step; this name has to be unique in a single transformation

Fields table

Specify the field name and sort direction (ascending/descending); click Get Fields to retrieve a list of fields from the input stream(s).

Metadata Injection Support (7.x and later)

All fields of this step support metadata injection. You can use this step with ETL Metadata Injection to pass metadata to your transformation at runtime.