Feature MATE with dbt version 1.5
By the end of November 2023, the current default dbt 1.0 version will reach its end of life and will no longer receive support. However, you can still opt for dbt 1.0 in your DataOps projects after November, and dbt 1.0 will be installed at runtime, but this will have an impact on performance and support.
Should you encounter any issues in your pipelines related to the dbt version, check dbt migration for detailed guidance to help you resolve any potential issues.
Feature VaultSpeed orchestrator
The VaultSpeed orchestrator is now fully released and accessible to all customers to help you deploy the data vault you have designed in VaultSpeed into a Snowflake database.
For more information, see the VautSpeed Orchestrator documentation.
Feature Auto-generate sources from external tables
Alongside our Auto-Generating Sources from SOLE Ingestion Tables feature, you can now automatically generate dbt sources for MATE from external tables managed in SOLE.
PriPrev Python 3.11 orchestrator
This release introduces a Python 3.11 orchestrator, expanding compatibility for the latest Python version. See the Python Orchestrators documentation for more information.
Improvement Enhancements in SOLE and Orchestrators
DATAOPS_PREFIXvariable in SOLE is now case sensitive.
- Enhancements were made to the logs of the Limiting the roles and users feature in SOLE grant management.
- In the VaultSpeed orchestrator:
- We now only use locked business vault releases.
- We've enhanced the usage of a custom database as your data vault.
- In the Azure Data Factory orchestrator, we added a new
DATAOPS_ADF_SLEEPvariable to control the sleep time between retry attempts. For more information, see the Azure Data Factory Orchestrator documentation.
Bug Fix Bug fixes in SOLE and Orchestrators
Resolved issues in this release include:
- Invalid table name when tags are applied to a table and
DATAOPS_SOLE_PRESERVE_OBJECT_NAMEis set in SOLE.
- Stream recreation in SOLE when
- An error in SOLE occurs during a DESTROY action when a network policy is not unset.
- Invalid parsing error in the Secrets Manager orchestrator.
Snowflake bundle 2023_07
With the release of the Snowflake 2023_07 bundle planned for January 2024, you'll notice security enhancement in the behavior of network policy commands. When you try to delete a network policy assigned to an account, security integration, or a user:
Before the bundle is released
You can delete the network policy without considering whether the network policy is still assigned to an account, security integration, or user.
After the bundle is released
You must detach a network policy from all accounts, security integrations, and users before you can delete it.