DataStage to Snowflake

Why Snowflake

Many DataStage jobs already target Snowflake

Remove the middle hop

If DataStage jobs extract from sources and land in Snowflake, the parallel engine is just a pass-through. Move the transformation logic into Snowflake SQL or Snowpark and eliminate the DataStage server entirely.

SQL when SQL is enough, Snowpark when it isn't

Simple Transformer derivations become Snowflake SQL views and procedures. Complex stage-variable logic with conditionals and lookups becomes Snowpark Python DataFrames — same Snowflake compute, full Python expressiveness.

Tasks and Streams replace Director sequences

DataStage Director manages job dependencies and schedules. Snowflake Tasks handle the same DAG orchestration natively — with Streams for change data capture that DataStage would need a separate CDC tool to handle.

Parser output

Transformer derivation to Snowflake SQL

A Transformer stage with derived columns and a Lookup reference link — converted to a Snowflake SQL view with JOIN. When stage-variable logic is too complex for SQL, MigryX outputs Snowpark Python instead.

DataStage Transformer

-- Parallel Job: Enrich_Orders
-- Source: ORDERS_EXTRACT (DB2 connector)
-- Lookup: PRODUCT_REF (reference link)
-- Transformer stage:
--   sv_total = lnk.QTY * lnk.UNIT_PRICE
--   sv_disc  = If lnk.TIER = "GOLD"
--              Then sv_total * 0.15
--              Else 0
--   out.NET  = sv_total - sv_disc
--   out.PRODUCT_NAME = ref.NAME
-- Target: ENRICHED_ORDERS (dataset)

→

MigryX
converts

Snowflake SQL

-- Transformer → Snowflake SQL
CREATE OR REPLACE VIEW enriched_orders AS
SELECT
    o.order_id,
    o.qty,
    o.unit_price,
    o.qty * o.unit_price AS total,
    CASE
        WHEN o.tier = 'GOLD'
        THEN o.qty * o.unit_price * 0.15
        ELSE 0
    END AS discount,
    o.qty * o.unit_price
      - CASE WHEN o.tier = 'GOLD'
             THEN o.qty * o.unit_price * 0.15
             ELSE 0 END AS net,
    p.name AS product_name
FROM orders_extract o
LEFT JOIN product_ref p
    ON o.product_id = p.product_id;

Stage variables become SQL expressions. Lookup reference links become LEFT JOINs. Derivations become computed columns. When logic requires Python, MigryX outputs Snowpark DataFrames instead.

Coverage