What to Read Next
For Data Engineers and Developers¶
Before you start developing with DataOps, here's a checklist of the tools and technologies you'll need some familiarity with.
1. Understand DataOps¶
- DataOps Architecture: A high level overview of DataOps architecture.
- DataOps Core Concepts: The hierarchy, structure, and terminology of DataOps.
- Data Product Platform: Learn how to navigate the platform and use it to its full potential.
- Project Structure: Key files and folder strcuture of DataOps projects.
2. Learn how to use DataOps¶
Once you're familiar with the architecture, here are some guides to start using the platform.
- An overview of the out-of-the-box DataOps environments from dev to prod,
- The typical development workflow you should leverage, and
- How the DataOps Reference Project works.
For Administrators¶
If you are an administrator, we suggest that you first find out about DataOps focussing on the background to DataOps and information about the system architecture.
After that, it's a good idea to familiarize yourself with the DataOps core concepts.
When you are ready, you can install a DataOps Runner as detailed in the Admin Guide.
User guides¶
Once you're familiar with the basics of DataOps in the section above, we have the following user guides to cover more of the basic functionality:
- Data pipeline fundamentals - Ground-up walk through how DataOps pipelines work
- SOLE capabilities - CI/CD for Snowflake using the Snowflake Object Lifecycle Engine (SOLE)
- MATE capabilities - data transformation with dbt using the Modelling and Transformation Engine (MATE)
Additional content¶
The following reference materials may also be helpful: