Using Automap Values

Only use one Automap Values per Stage

Automap values is a highly resource intensive operation. To ensure optimum performance, there should be no more than one Automap Values operation in a Stage. If you need to use mulitple Automap Values operations, put them in individual stages.

Reference dataset sizes

Automap Values can use reference dataset sizes of up to 24m rows. If you need to use a larger reference dataset, please contact support@quantemplate.com, so we can arrange scaled-up performance for you.

Automap values is configured in the Map Values operation. To access the Automap workspace, click the Automap button in Map Values.

Automap button in the Map Values operation

Automap settings workspace

Enable Automap

Once configured, Automapping for an operation can be disabled or re-enabled by clicking the toggle. Your settings will be retained.

Automap from

The ‘Automap from’ source column is the same as the manual Map Values source column. To change the source column, change it in the Map Values view.

Automap to

Select the reference dataset and its column of known good values to map to.

Context columns

A similarity match between two values alone may not always be enough to create an accurate mapping. Adding context columns can help: values in context columns in source and reference datasets must match exactly for a mapping to be applied.

Minimum match strength

Define the minimum match strength required for a mapping to be applied. If desired, the match strength can be included as a column in the output data. This can be useful for separately analysing the distribution of the results.

Waypointing

Waypointing learns from previous mappings that have been approved or remapped in the Mapping Report to inform the automapping of similar values.

Configuring Automap

1. Configure a Map Values operation

Add a map values operation, select a source column and if desired configure any manual mappings, the output column, and the handling of unmapped values.

2. Select Automap

Click the Automap button to navigate to the Automap configuration page.

Automap configuration button in Map Values

3. Select the reference dataset and column to map to

4. Add context columns if desired

5. Set a minimum match strength if desired

6. Run the pipeline

Mappings are generated on your full set of data on running the pipeline.

7. Review results

Navigate to the Outputs Summary to access the Automap results in the Mapping Report.

Once Automap is configured, the reference dataset will be shown in the Map Values operation.

Map Values column configured to Automap to US States