Skip to content

June 2024

Orchestrators

Feature New External Access Integration object in SOLE for data products

SOLE for Data Products now supports managing External Access Integration objects. See the new External Access Integration documentation for more details.

Additionally, you can now reference External Access Integration objects in the YAML configuration of a Procedure using the external_access_integration parameter. See the Procedure documentation for more details.

Feature Support default argument values for Procedures in SOLE

You can now define default argument values for Procedures in SOLE. See the updated Procedure arguments documentation for more information.

Feature New parameters added in the Azure and ADF orchestrators

The Azure and Azure Data Factory orchestrators now support the following new parameters: AZURE_USER, AZURE_PASSWORD, DISABLE_ALLOW_NO_SUBSCRIPTIONS, DATAOPS_AZURE_LOGIN_AS_SERVICE_PRINCIPAL, TENANT_ID, AZURE_APP_ID, AZURE_CLIENT_SECRET, DATAOPS_AZURE_RETRY_ATTEMPTS and DATAOPS_AZURE_RETRY_INTERVAL.

See the Azure orchestrator and Azure Data Factory orchestrator for more information about all of the supported parameters and their usage.

Improvement Improvements in SOLE

Improvement Improvements in the Snowflake orchestrator and dataops-snowsql

  • Support new DATAOPS_RUN_SQL variable to run SQL scripts in the Snowflake orchestrator without calling the dataops-snowsql command.
  • Mask the output of dataops-snowsql.
  • Enable passing on the output of dataops-snowsql to a file using the > operator.

For more information, see the updated Snowflake orchestrator documentation.

Bug Fix Bug Fixes in SOLE and Orchestrators

EoL dbt 1.0 no longer supported in MATE

The dbt 1.0 version is no longer supported in MATE and Develop. The versions that are currently supported are:

  • dbt 1.7
  • dbt 1.5 (default)
  • dbt 1.4

To switch to a specific version or continue using an unsupported one, follow the Switching dbt version documentation.

Operate

Feature Integrations

We've added the Pipeline status email integration to the list of supported integrations.

See the new Pipeline status email integrations documentation for more information.

We have also enabled integrations at the group level.

Bug Fix Pipeline Schedules Bug

We have fixed a bug in the create pipeline schedule screen where the pipeline type only showed -ci.yml files that existed on the default branch.

Depending on the branch, the pipeline type now refreshes the available -ci.yml files.

Improvement General Improvements

We increased the background process capacity.

Feature Assist for Merge Requests

Assist for Merge Requests is now enabled by default in the Platform. For more information, see Assist for Merge Requests documentation.

Develop

Feature Key-pair authentication

We have added the ability to use key-pair authentication when configuring your workspace connection to Snowflake.

See Giving DevReady access to Snowflake for more information.

Bug Fix dbt commands Bug

We have fixed a bug where dbt commands were not working in existing open terminals after completing the connection wizard.

Feature Assist for Develop

Assist is now enabled by default in Develop. For more information on the power of Assist, see the Assist documentation.