Help Centre

Login Contact us

• GETTING STARTED
  • Introducing Quantemplate
  • Product areas
  • Logging in
  • User profile and organisation
• INTEGRATE
  • Introducing integrate
    • About Integrate
    • Example workflow
  • Workspace
    • Overview
    • Stages and operations
    • Run Log
    • Pipeline history
  • Managing pipelines
    • Create and name
    • Organise and duplicate
    • Archive and restore
    • Permissions and sharing
    • Reusing pipelines
  • Inputs and outputs
    • Pipeline inputs
    • Pipeline outputs
    • Exporting outputs
    • Downloading outputs
    • Sharing outputs
  • Join and Union
    • Join stage
    • Union stage
  • Automap Values
    • About Automap Values
    • Using Automap Values
    • Waypointing
    • Mapping Report
  • Validation
    • Validation operation
    • Validation Report
  • Operations
    • Operations index
    • DEFINE TABLE
    • Detect Headers
    • Clip After Column
    • Partition
    • Combine Columns
    • CLEANSE
    • Number Format
    • Remove Rows
    • Fill Down
    • MAP
    • Map Column Headers
    • Map Values
    • ENRICH
    • Append File Name
    • Append if Missing
    • Calculate
    • Extract (Regex)
    • TRANSFORM
    • Aggregate
    • Select Columns (Project)
    • Swing Down
    • DATES
    • Working with dates
    • Date Cleanse
    • Date Output
    • SCRIPTS
    • Offset Column
    • Stack Grids
  • Syntax and functions
    • Functions index
    • General functions
    • Date functions
    • Operators and syntax
  • Updates and legacy
    • Pipeline Processor versions
    • LEGACY DATE OPERATIONS
    • Add Term to Date
    • Date Cleansing
    • Duration
    • Extract Date
    • Year Quarter
• DATA
  • About datasets
  • Managing your datasets
  • Creating, uploading and naming datasets
  • Sharing datasets
  • Dataset Processor versions
• ANALYSE
  • Workspace
    • Overview
    • Frames
    • Pages
    • Undo and history
  • Using reports
    • Create and manage reports
    • Permissions and sharing
    • Using data in reports
    • Download and print
  • Pivot tables
    • About
    • Pivot interface
    • Create a pivot
    • Filtering
    • Number formatting
    • Table formatting
    • Aggregation
    • Totals
  • Equation editor
    • Using the editor
    • Functions in Analyse
    • Pre/post-pivot
  • Graphs
    • About graphs
    • Graph types
  • Text and images
    • Text frames and styling
    • Working with images
• TUTORIALS
  • Integrate
    • Getting started with pipelines
    • Exporting data
    • Calculated Columns
    • Map Column Headers
    • Map Values
    • Regular expressions
    • Union and Join
    • Validation
    • Reusing pipelines
  • Analyse
    • Pivots
    • Filters
    • Graphs
    • Equations
    • Permissions and sharing

Updates

Pipeline Processor versions

The Pipeline Processor determines how your data is processed. Updating to a newer version may change your pipeline results. Test how the changes affect your data by creating a duplicate pipeline and updating the version.

Updating the Pipeline Processor version

The latest Pipeline Processor version is applied to newly created pipelines automatically.

For existing pipelines, an icon appears in the top right indicating that a new version is available. Clicking the update button will re-interpret your uploaded data using the new processor version.

Updating may change your uploaded data and affect your pipeline results. Before updating a pipeline, it's recommended to test how the changes will affect your data by creating a duplicate of the pipeline and updating its processor version.

Datasets linked from the Data Repo will not be automatically updated to the new version. To update a dataset, navigate to the dataset and follow the instructions here.

Version 2

November 2019

Version 2 contains updates in three areas:

1. Interpreting data in .xlsx files

The way data in uploaded .xlsx files is handled has been changed so that values generated by formulae are treated in the same way as regular values. The changes are:

1.

  Columns generated by formulae are now interpreted as values rather than as formatted text.

2.

  Dates created by formulae are now interpreted as ISO rather than as formatted text.

3.

  Results of booleans (e.g. IF statements) are now interpreted ‘true’ / ‘false’ rather than ‘1’/’0’.

4.

  Results of formulae with text in quotes now retain the quotes rather than removing them.

Example

	1	2	3	4
Version 1	$10.00	01/10/2019	1	string
Version 2	10	20191001	true	“string”

2. Arithmetic equations treat blank as zero

In Calculate and Validate, arithmetic equations ( + - / * ^ ) and some functions (ABS, ROUND) now interpret blank values as zero. The functions MIN and MAX now ignore non-numeric values.

Previously, if these functions encountered a blank value they would return ‘NaN’ (‘Not a Number’), which could cause problems with downstream processes. Now the functions will always give a valid numeric result when encountering blanks.

Inequalities ( < <= > => ) will still produce a NaN if encountering a blank.

Example

	+	MIN	MIN
Version 1	2 + ‘blank’ = NaN	MIN(‘blank’,1) = NaN	MIN(‘blank’,-1) = NaN
Version 2	2 + ‘blank’ = 2	MIN(‘blank’,1) = 1	MIN(‘blank’,-1) = -1

3. Flexible interpretation of column values

In Calculate and Validate a numeric value can be the result of a text function, and vice-versa.

Previously the whole calculation would be ignored with the result column not being created/updated.

Example

	Age	IF	Concatenate
Version 1	1	IF('Age'="", "", 'Age' + 1) = Column not created	ABS( CONCATENATE("-", "1")) = Column not created
Version 2	1	IF('Age'="", "", 'Age' + 1) = 2	ABS( CONCATENATE("-", "1")) = 1

Version 1

Original Pipeline Processor version.