DataOps Features in Preview
DataOps.live offers pre-release features and gives them a status with a Preview tag. They are provided for evaluation and testing purposes and are not meant to be used in production under any circumstances.
DataOps.live notifies customers of available previews through different means, including emails, webinars, or newsletters. Preview features are always identified in our documentation and release notes by adding the Preview tags.
Preview types
Preview features can be either private or public and are released on a “Preview” basis with the below tags so customers can get early access and provide feedback:
- Private preview - Describes features still in development and may only be released to a few customers. You must not use such features in DataOps pipelines on your production branches. You can use them for testing in feature branches.
- Public preview - Describes actively developed features that may be released to a few or all customers. These features should not change significantly when fully released, but we do not recommend you use them in main production branches.
Features currently in preview
The following topics list all DataOps.live release features in public and private previews to help you discover our features in development but not yet delivered and generally available.
Features in public preview
| Orchestrators | Description |
|---|---|
| data.world orchestrator | Interacts with the data.world data catalog to publish metadata about the data transformed in a DataOps pipeline. Learn more with examples. |
| Monte Carlo orchestrator | Allows DataOps.live products to leverage the observability tools within the Monte Carlo platform. Learn more with examples. |
| Soda orchestrator | Allows Soda users to execute automated testing as part of a DataOps.live pipeline, supporting operations provided by Soda SQL. Learn more with examples. |
| Stage Ingestion orchestrator | Helps ingest data from Snowflake stages into tables defined in the Snowflake configuration by SOLE (Snowflake Object Lifecycle Engine). Learn more with examples. |
| VaultSpeed orchestrator | Deploys the data vault you have designed in VaultSpeed into a Snowflake database. Learn more with examples. |
Features in private preview
| SOLE | Description |
|---|---|
| SOLE for Data Products | New framework for SOLE (Snowflake Object Lifecycle Engine) to help you easily build an ecosystem of data products and benefit from greater accuracy and accessibility of data. Learn more with examples. |
| SOLE for Data Products migration | Provides information on how to migrate/update your current Snowflake object configuration to match the new structure of SOLE for Data Products. In the new structure, object definitions are split into separate files allowing their organization into type-specific or domain-specific files. Learn more with examples. |
| Orchestrators | Description |
|---|---|
| Snowpark (Python) orchestrator | Provides an intuitive API for querying and processing data in a DataOps.live pipeline. Learn more with examples. |
| Platform | Description |
|---|---|
| DataOps Development Environment | The DataOps Development Environment (DDE) is a ready-to-code environment that gives you a highly optimized Data Development Experience for key DataOps use cases with no or minimal setup. It has three deployment topologies: cloud, local, or remote. Learn more with examples. |
| Data Products | They leverage data as the source and, with the data product platform, you build pipelines to process and transform data into data products that allow consumers to connect, explore, and consume the data. Learn more with examples. |