You can manage a DataOps project using an external Git repository like GitHub, Bitbucket, or Azure DevOps for central code management. In this case, you can set up synchronization of the external repository such that all changes (commits, branches, etc.) are constantly pushed to DataOps.
Pipeline run tags (e.g.
[full-ci.yml ci]) can also be used, as the full commit message is part of the
Synchronizing from GitLab
This procedure sets up synchronization from a project in GitLab (either gitlab.com or a self-managed instance) into a project in DataOps.live.
The DataOps project should then be considered read-only from within DataOps - all changes should be made via GitLab.
Create a personal access token in DataOps that has the
write_repositoryscope, under a user account that has the appropriate access level on the project.
Set up a DataOps project:
- If the DataOps project already exists, clone it into GitLab using the personal access token
- If no project currently exists, create an empty project in DataOps, then create a DataOps-structured project in GitLab.
In the GitLab project, navigate to Settings > Repository > Mirroring repositories
Enter the URL to the DataOps project (including the
.gitextension), select the other options as required and save the settings.
Make a test commit to the GitLab project and include a pipeline run tag to test the synchronization.
Pushing to Bitbucket
Create an empty (not even a Readme or .gitignore) repository on Bitbucket.
Create (or use an existing) app password that has full access to your repository.
In DataOps, navigate to the project and open Settings > Repository from the sidebar menu, and expand the Mirroring repositories section.
Enter the URL of the Bitbucket repository in the Git repository URL field, including the username of the user that will authenticate the connection, e.g.
The mirror direction
Pushand authentication method
Passwordare the default and only selections available.
Enter your app password (from above) and select the other options if required.
If successful, the mirrored repository will show in the table below the form. Click the Update now button to start the first push.