Make sure you’ve completed Create a Connection before this step.
Creating a pipeline
- Click Jobs in the sidebar
- Click New Job and give the job a name (e.g.
postgres-to-snowflake-orders) - Select your source connection — Zwiron discovers all available tables and schemas automatically
- Select your destination connection
- Select the tables you want to sync (select individual tables, entire schemas, or search by name) — the destination schema is auto-generated from the source connection name (e.g.
prod_postgres). You can override it in the configure step if needed. - Choose an execution mode — Hosted if both ends are cloud-reachable, or Agent to run inside your network
- Choose a sync mode (see below)
- Optionally configure transforms to filter or reshape data in transit
- Set a schedule for when the job should run
- Click Save & Run to start immediately, or Save to start on the next scheduled run
Sync modes
- Full Refresh
- Incremental
- CDC (Change Data Capture)
Best for: Small tables, lookup tables, or when you always want a clean copy.On every run, Zwiron reads the entire source table and replaces the destination table. This is the simplest mode — no special source configuration required.
- Works with any source
- No cursor or primary key required
- Destination table is truncated and reloaded each run
Transforms
Before saving, you can apply transforms to filter or reshape data in transit:- Drop column — exclude columns from reaching the destination (common for PII)
- Rename column — write a column under a different name at the destination
- Type cast — change the Arrow type of a column (e.g.
int32→utf8) - Hash column — replace values with SHA-256 hashes to pseudonymize PII
- Row filter — only sync rows that match a condition
Scheduling
CDC jobs run continuously — they don’t use a schedule. Once started, they stream changes until you pause or stop the job.
Monitoring your pipeline
Click into the job to see:- Status — Running, Completed, Failed, Cancelled
- Progress — tables synced, rows transferred, bytes moved
- Last run — duration, row count, any errors
- Next run — when the job is scheduled to run again
- Logs — full run-level event log for debugging
What’s next?
CDC deep dive
How Change Data Capture works and how to enable it
Transforms
Filter, rename, and type cast columns
Scheduling
Cron schedules and trigger options
All connectors
See every supported source and destination