Scheduling Pipelines

Scheduling one or more pipelines forms an integral part of any DataOps project.

Why?

In summary, there are several reasons for this. However, the most significant reason is that it saves time by scheduling recurring tasks. For instance, let's assume you have transactional tables that must be updated every 15 minutes to ensure that the linked data products remain up to date.

The way to schedule a pipeline is from within a project by navigating to CI / CD -> Schedules and clicking on New schedule:

You can find detailed instructions for scheduling at Running pipelines - New schedule form

note

For an in-depth explanation of the DataOps pipeline types and structure, see the Pipeline Overview documentation.