Skip to main content

Informatica Cloud Orchestrator

TypePre-Set
Image$DATAOPS_INFORMATICACLOUD_RUNNER_IMAGE

The Informatica Cloud orchestrator is a pre-set orchestrator that triggers the start of an Informatica cloud taskflow as part of a DataOps pipeline. This functionality allows integrating all existing Informatica cloud taskflows into a DataOps pipeline.

Usage

The Informatica Cloud orchestrator orchestrates Informatica cloud taskflows via Informatica cloud REST API.

The orchestrator's workflow is as follows:

  1. Triggers the specified taskflow using a specified Informatica cloud URL.
  2. Polls the status and fetches progress from the Informatica Cloud for the taskflow.
  3. Propagates the Informatica Cloud taskflow execution status to the DataOps pipeline.
"My Informatica Cloud Job":
extends:
- .agent_tag
stage: "My Stage"
image: $DATAOPS_INFORMATICACLOUD_RUNNER_IMAGE
variables:
INFORMATICA_TASKFLOW_URL: https://id.informaticacloud.com/active-bpel/rt/TaskflowID
INFORMATICA_TASK_TYPE: TASKFLOW
INFORMATICA_USERNAME: XXXX
INFORMATICA_PASSWORD: XXXX
script:
- /dataops
icon: ${INFORMATICA_ICON}

We recommend that you configure the DataOps pipeline to continue running only if the Informatica Cloud job is successful, ensuring that the pipeline run does not transform any out-of-date data.

Supported parameters

ParameterRequired/DefaultDescription
INFORMATICA_USERNAMEREQUIRED but can be pulled from the DataOps VaultUsername to access the Informatica Cloud API
INFORMATICA_PASSWORDREQUIRED but can be pulled from the DataOps VaultPassword to access the Informatica Cloud API
INFORMATICA_TASK_TYPEREQUIREDCurrently only supports TASKFLOW
INFORMATICA_TASKFLOW_URLREQUIREDThe REST API URL for the taskflow
INFORMATICA_TASKFLOW_ARGSOptionalArguments to be passed to Informatica Cloud taskflow
INFORMATICA_TIMEOUTOptional. Defaults to 3600Informatica Cloud taskflow timeout in seconds. If increasing the DataOps job timeout, set this to an equivalent value.

Example jobs

This example demonstrates what a typical pipeline job looks like:

pipelines/includes/local_includes/informatica_jobs/my_informatica_job.yml
"Start Informatica Cloud Job":
extends:
- .agent_tag
stage: Data Ingestion
image: $DATAOPS_INFORMATICACLOUD_RUNNER_IMAGE
variables:
INFORMATICA_TASKFLOW_URL: https://id.informaticacloud.com/active-bpel/rt/TaskflowID
INFORMATICA_TASK_TYPE: TASKFLOW
INFORMATICA_USERNAME: DATAOPS_VAULT(INFORMATICA.USERNAME)
INFORMATICA_PASSWORD: DATAOPS_VAULT(INFORMATICA.PASSWORD)
script:
- /dataops
icon: ${INFORMATICA_ICON}