Skip to main content

Release Notes June 2024

Orchestrators

The below Orchestrators release notes provide information about new features and updates in the pre-release version 5-latest. These updates are set available as an opportunity to test and validate that things work as expected in your environment before we promote them to the official release 5-stable.

To test orchestrators with 5-latest, simply set DATAOPS_RUNNER_IMAGE_TAG to 5-latest in your project's variables.yml configuration file. See Orchestrators Pre-Release Versions for more information.

Feature release status badge: Feature
Feature
New External Access Integration object in SOLE for data products

SOLE for data products now supports managing External Access Integration objects. See the new External Access Integration documentation for more details.

Additionally, you can now reference External Access Integration objects in the YAML configuration of a Procedure using the external_access_integration parameter. See the Procedure documentation for more details.

Feature release status badge: Feature
Feature
Support default argument values for Procedures in SOLE

You can now define default argument values for Procedures in SOLE. See the updated Procedure arguments documentation for more information.

Feature release status badge: Feature
Feature
New parameters added in the Azure and ADF orchestrators

The Azure and Azure Data Factory orchestrators now support the following new parameters: AZURE_USER, AZURE_PASSWORD, DISABLE_ALLOW_NO_SUBSCRIPTIONS, DATAOPS_AZURE_LOGIN_AS_SERVICE_PRINCIPAL, TENANT_ID, AZURE_APP_ID, AZURE_CLIENT_SECRET, DATAOPS_AZURE_RETRY_ATTEMPTS and DATAOPS_AZURE_RETRY_INTERVAL.

See the Azure orchestrator and Azure Data Factory orchestrator for more information about all of the supported parameters and their usage.

Feature release status badge: Improvement
Improvement
Improvements in SOLE

Feature release status badge: Improvement
Improvement
Improvements in the Snowflake orchestrator and dataops-snowsql

  • Support new DATAOPS_RUN_SQL variable to run SQL scripts in the Snowflake orchestrator without calling the dataops-snowsql command.
  • Mask the output of dataops-snowsql.
  • Enable passing on the output of dataops-snowsql to a file using the > operator.

For more information, see the updated Snowflake orchestrator documentation.

Feature release status badge: Bug Fix
Bug Fix
Bug Fixes in SOLE and Orchestrators

Feature release status badge: EoL
EoL
dbt 1.0 no longer supported in MATE

The dbt 1.0 version is no longer supported in MATE and Develop. The versions that are currently supported are:

  • dbt 1.7
  • dbt 1.5 (default)
  • dbt 1.4

To switch to a specific version or continue using an unsupported one, follow the Switching dbt version documentation.

Operate

Feature release status badge: Feature
Feature
Integrations

We've added the Pipeline status email integration to the list of supported integrations.

See the new Pipeline status email integrations documentation for more information.

We have also enabled integrations at the group level.

Feature release status badge: Bug Fix
Bug Fix
Pipeline Schedules Bug

We have fixed a bug in the create pipeline schedule screen where the pipeline type only showed -ci.yml files that existed on the default branch.

Depending on the branch, the pipeline type now refreshes the available -ci.yml files.

Feature release status badge: Improvement
Improvement
General Improvements

We increased the background process capacity.

Feature release status badge: Feature
Feature
Assist for Merge Requests

Assist for Merge Requests is now enabled by default in the Platform. For more information, see Assist for Merge Requests documentation.

Develop

Feature release status badge: Feature
Feature
Key Pair authentication

We have added the ability to use Key Pair authentication when configuring your workspace connection to Snowflake.

See Giving DevReady access to Snowflake for more information.

Feature release status badge: Bug Fix
Bug Fix
dbt commands Bug

We have fixed a bug where dbt commands were not working in existing open terminals after completing the connection wizard.

Feature release status badge: Feature
Feature
Assist for Develop

Assist is now enabled by default in Develop. For more information on the power of Assist, see the Assist documentation.