Help Centre

Login Contact us

• GETTING STARTED
  • Introducing Quantemplate
  • Product areas
  • Logging in
  • User profile and organisation
• INTEGRATE
  • Introducing integrate
    • About Integrate
    • Example workflow
  • Workspace
    • Overview
    • Stages and operations
    • Run Log
    • Pipeline history
  • Managing pipelines
    • Create and name
    • Organise and duplicate
    • Archive and restore
    • Permissions and sharing
    • Reusing pipelines
  • Inputs and outputs
    • Pipeline inputs
    • Pipeline outputs
    • Exporting outputs
    • Downloading outputs
    • Sharing outputs
  • Join and Union
    • Join stage
    • Union stage
  • Automap Values
    • About Automap Values
    • Using Automap Values
    • Waypointing
    • Mapping Report
  • Validation
    • Validation operation
    • Validation Report
  • Operations
    • Operations index
    • DEFINE TABLE
    • Detect Headers
    • Clip After Column
    • Partition
    • Combine Columns
    • CLEANSE
    • Number Format
    • Remove Rows
    • Fill Down
    • MAP
    • Map Column Headers
    • Map Values
    • ENRICH
    • Append File Name
    • Append if Missing
    • Calculate
    • Extract (Regex)
    • TRANSFORM
    • Aggregate
    • Select Columns (Project)
    • Swing Down
    • DATES
    • Working with dates
    • Date Cleanse
    • Date Output
    • SCRIPTS
    • Offset Column
    • Stack Grids
  • Syntax and functions
    • Functions index
    • General functions
    • Date functions
    • Operators and syntax
  • Updates and legacy
    • Pipeline Processor versions
    • LEGACY DATE OPERATIONS
    • Add Term to Date
    • Date Cleansing
    • Duration
    • Extract Date
    • Year Quarter
• DATA
  • About datasets
  • Managing your datasets
  • Creating, uploading and naming datasets
  • Sharing datasets
  • Dataset Processor versions
• ANALYSE
  • Workspace
    • Overview
    • Frames
    • Pages
    • Undo and history
  • Using reports
    • Create and manage reports
    • Permissions and sharing
    • Using data in reports
    • Download and print
  • Pivot tables
    • About
    • Pivot interface
    • Create a pivot
    • Filtering
    • Number formatting
    • Table formatting
    • Aggregation
    • Totals
  • Equation editor
    • Using the editor
    • Functions in Analyse
    • Pre/post-pivot
  • Graphs
    • About graphs
    • Graph types
  • Text and images
    • Text frames and styling
    • Working with images
• TUTORIALS
  • Integrate
    • Getting started with pipelines
    • Exporting data
    • Calculated Columns
    • Map Column Headers
    • Map Values
    • Regular expressions
    • Union and Join
    • Validation
    • Reusing pipelines
  • Analyse
    • Pivots
    • Filters
    • Graphs
    • Equations
    • Permissions and sharing

Introducing Integrate

Example workflow

Quantemplate Integrate provides a completely flexible toolset to cleanse and harmonise your data.

Most workflows in Quantemplate follow this structure:

1. Create a pipeline

In the Integrate view, create a new pipeline.

2. Upload raw data

In the inputs tab, drag and drop your raw data files.

3. Define the data area

Use Remove rows to identify the data area, then define the column headers via a Detect headersoperation.

4. Add stages and operations

Transformations, Joins and Unions incrementally as required.

5. Run the pipeline to preview the outcome

Running the pipeline makes the results available within the pipeline outputs, but does not export them to your data repo.

6. Review outputs

Review the output data, validation report and mapping reports from the outputs tab, then download directly, or export to your data repo to share or send to Analyse for querying and visualisation.

Tip

Accelerate pipeline run times by disabling stage outputs which are not required for export. See Exporting stage outputs for details.