DataOps Pipelines

DataOps pipelines are an integral part of the DataOps platform. DataOps pipelines provide hourly, daily, or weekly ingestions, data modeling, and data transformation. Acting as data producers, they publish updates to the overarching data product to data catalogs.

In this section, we cover the following topics for you to build, test, and run DataOps pipelines successfully:

• Pipeline overview
• Running data pipelines
• Scheduling pipelines
• Pipeline parameters
• Pipeline job dependencies
• Pipeline graph styling
• Pipeline cache