What to Read Next
For Data Engineers and Developers
Before you start developing with DataOps, here's a checklist of the tools and technologies you'll need some familiarity with.
1. Understand DataOps
- DataOps Architecture: A high level overview of DataOps architecture.
- DataOps Core Concepts: The hierarchy, structure, and terminology of DataOps.
- Data Product Platform: Learn how to navigate the platform and use it to its full potential.
- Project Structure: Key files and folder strcuture of DataOps projects.
2. Learn how to use DataOps
Once you're familiar with the architecture, here are some guides to start using the platform.
- An overview of the out-of-the-box DataOps environments from dev to prod,
- The typical development workflow you should leverage, and
- How the DataOps Reference Project works.
For Administrators
If you are an administrator, we suggest that you first find out about DataOps focussing on the background to DataOps and information about the system architecture.
After that, it's a good idea to familiarize yourself with the DataOps core concepts.
When you are ready, you can install a DataOps Runner as detailed in the Admin Guide.
User guides
Once you're familiar with the basics of DataOps in the section above, we have the following user guides to cover more of the basic functionality:
- Data pipeline fundamentals - Ground-up walk through how DataOps pipelines work
- SOLE capabilities - CI/CD for Snowflake using the Snowflake Object Lifecycle Engine (SOLE)
- MATE capabilities - data transformation with dbt using the Modelling and Transformation Engine (MATE)
Additional content
The following reference materials may also be helpful: