Managing pipelines
Pipelines repo
Quantemplate's newsfeed-style repos provides a live view of your pipeline activity across your environment. Repos help you monitor pipeline statuses, identify issues early, and keep track of every automated flow of data.
Metadata bar
The metadata bar below the pipeline name displays information about how the pipeline is used, updated and connected. Click on each item to reveal more details.
Last update
See if a pipeline was updated, 'Just now', '1 minute ago' or even '1 year ago'. The clock icon changes tone depending on the recency of the last update, helping spot recent activity at-a-glance.
Connected feeds and datasets
Feeds or datasets which trigger a pipelines run are listed. If a feed is connected to a partner, their logo is shown. Output feeds or datasets are also listed. Click on a feed or dataset to open it in a new tab.
API and robot
If the pipeline has been shared with the API or Robot users, the API or Robot icon is displayed in the metadata bar.
Pipeline information
The repo view also shows:
- Pipeline name.
- Tags applied to a pipeline.
- Last updated date.
- Last updated by.
- Owner.
-
Number of users with access. Click here to see details of users and manage access.
- Items shared with the whole organisation are indicated by the ‘office building’ icon.
-
An information popup showing who created the pipeline and when, alongside the pipeline's unique ID.
Create a pipeline
Create a new pipeline from within the pipeline view
- Click the + button next to the pipeline name. This creates and opens a new pipeline.
- Name your pipeline by clicking on the pipeline name.
Create a new pipeline from within the repo view
- Open the repo and click the green ‘New’ button at top right. This creates and opens a new pipeline.
- Name your pipeline by clicking on the pipeline name.
Duplicating pipelines
Click the three dots at the end of the row and select ‘Duplicate’ from the popup menu. The pipeline is instantly duplicated and the document opened. The suffix ‘– copy’ is added to the duplicate pipeline’s name.
Renaming pipelines
Click the three dots at the end of the row and select ‘Rename’ from the popup menu. Alternatively, edit the pipeline name by opening the document and clicking on the name.
Organise pipelines
Sort and search pipelines
Pipelines are sorted by 'Last update' by default. This updates live, keeping you up to date with the status of your runs, validations and automations.
Pipelines can be sorted by pipeline name, date updated, updated by user, automation status, and last run. Click the arrow button to reverse the sort direction. Your sorting choice will be remembered.
Click in the search field to search pipelines by name.
Filter and drill down
The pipelines repo can be filtered via the side bar.
The pie chart show a summary of the pipeline statuses, giving you oversight of your automations, validations and runs. Click on the pie chart to drill down by a particular status. If you have an export blocked due to a validation issue, it will be highlighted in a separate block next to the pie chart.
For other filtering options, click the filter icon or hit ‘F’ on the the keyboard to filter pipelines by date created, date updated, pipeline name, owner, or updated by user.
Manage documents with tags
Tags can be applied to any document in Quantemplate, to help organise assets.
Tags are created by Org Admins within the repo views for Feeds, Pipelines, Data and Analyse. They can be applied to documents by document owners. Tags are set at an organisation level and are available to all document types.
Within the repo sidebar, users see all the tags for documents they have access to. Clicking on a tag in the sidebar filters the document list by that tag.
Archive and restore
Archiving pipelines
Click the three dots at the end of the row and select ‘Archive’ from the popup menu. Archived pipelines are not deleted, but hidden from the repo.
Archived pipelines display a warning in the top right of the pipeline view.
Note that pipelines in Quantemplate cannot be deleted permanently by users. Contact us if you have a specific deletion requirement.
View and restore archived pipelines
- To show archived pipelines, click the ‘Show/hide archived’ button in the top right of the repo, or hit ‘A’ on the keyboard.
- Click a pipeline to open it.
- To restore a pipeline to the repo, click the three dots at the end of the row and select restore.