Skip to main content

Talend TAC Orchestrator

TypePre-Set
Image$DATAOPS_TAC_RUNNER_IMAGE

The Talend TAC Orchestrator is a pre-set orchestrator that executes existing Talend ETL jobs configured in the Talend Administration Center as part of a DataOps pipeline. This orchestrator allows the two technologies (Talend and DataOps) to co-exist.

note

Before being run as part of a DataOps pipeline, you must register these ETL jobs in Talend's Job Conductor found in your Talend Administration Center instance.

Usage

This YAML script demonstrates how to structure a typical TAC ETL pipeline job run inside a DataOps pipeline.

pipelines/includes/local_includes/tac_jobs/my_tac_job.yml
"My TAC Job":
extends:
- .agent_tag
stage: "My Stage"
image: $DATAOPS_TAC_RUNNER_IMAGE
variables:
TAC_ACTION: START
TAC_URL: XXXX
TAC_USERNAME: XXXX
TAC_PASSWORD: DATAOPS_VAULT(XXX)
TAC_TASK_ID: XXXX
script:
- /dataops
icon: ${TALEND_ICON}

Supported Parameters

ParameterRequired/DefaultDescription
TAC_ACTIONREQUIREDMust be START
TAC_URLREQUIREDThe URL of the TAC instance to use
TAC_USERNAMEREQUIREDThe TAC user with access to start jobs in the Job Conductor
TAC_PASSWORDREQUIREDThe TAC user's password
TAC_TASK_IDREQUIREDThe job ID for the deployed task in the TAC Job Conductor

Example Jobs

This YAML script demonstrates a typical TAC use case; that is, starting an ETL pipeline to ingest data into a Snowflake database:

pipelines/includes/local_includes/tac_jobs/run_tac_job.yml
"Run TAC Job":
extends:
- .agent_tag
stage: "Batch Ingestion"
image: $DATAOPS_TAC_RUNNER_IMAGE
variables:
TAC_ACTION: START
TAC_URL: https://tac1.example.com/org.talend.administration
TAC_USERNAME: DATAOPS_VAULT(TALEND.TAC1.USERNAME)
TAC_PASSWORD: DATAOPS_VAULT(TALEND.TAC1.PASSWORD)
TAC_TASK_ID: 123456
script:
- /dataops
icon: ${TALEND_ICON}

Project Resources

None

Host Dependencies (and Resources)

None