Release Notes January 2025
Orchestrators
PubPrev Dataiku orchestrator
The Dataiku orchestrator is now available in public preview. You can now integrate and run Dataiku scenarios as part of a DataOps.live pipeline.
Check the Dataiku orchestrator documentation for more information.
Feature Memoizable functions in SOLE
You can now define memoizable functions through SOLE by
setting the is_memoizable
parameter. Adding support for memoizable functions will help improve execution time and
overall system performance.
Check the Function documentation for more information and a usage example.
Bug Fix dataops-snowsql
using incorrect configuration file
The Snowflake orchestrator now supports setting the configuration path using the DATAOPS_SNOWSQL_CONFIG_PATH
variable.
This change ensures that the orchestrator uses the correct configuration file when a higher-precedence configuration is
present.
Check the Snowflake orchestrator documentation for more information.
EoL Deprecated orchestrators
The following orchestrators are now archived and will be completely removed from the DataOps.live platform:
- Data.world orchestrator v1.0 (a new v2.0 is available)
- SnowparkJava orchestrator
Improvement Improvements in SOLE and orchestrators
We improved the speed of reading secrets from the vault.
Bug Fix Bug fixes in SOLE and orchestrators
- Fix default values for Hybrid Tables in SOLE
- Prevent resetting the value of
default_secondary_roles
for Users - Prevent resetting the value of
nullable
for Hybrid Tables - Update External Functions to support VARCHAR as a return type
Operate
Feature Required review and approval of merge requests
Starting with this release, you can turn on mandatory approvals for your merge request approvals. When turned on, a review and approval for merged to protected branches becomes mandatory, strengthening your governance stance.
Spendview
Feature Spendview learns key-pair authentication with Snowflake
Apart from username-password authentication, Spendview now also supports connecting Snowflake accounts with key-pair authentication.