Scheduling Pipelines

Scheduling one or more pipelines forms an integral part of any DataOps project.

Why?

In summary, there are several reasons for this. However, the most significant reason is that it saves time by scheduling recurring tasks. For instance, let's assume you have transactional tables that must be updated every 15 minutes to ensure that the linked data products remain up to date.

The way to schedule a pipeline is from within a project by navigating to CI / CD -> Schedules and clicking on New schedule:

Detailed instructions for scheduling can be found in Running pipelines - New schedule form