Prompt
How do I sync Postgres and MySQL into Snowflake without custom scripts?
Latest observation
If you want Postgres and MySQL replicated into Snowflake without writing/maintaining custom ETL scripts, the usual options are:
1) Use a managed ELT/replication tool
These tools handle initial load + ongoing CDC/incremental sync with minimal code.
Common choices:
- Fivetran
- Airbyte Cloud / Airbyte OSS
- Matillion
- Hevo
- Estuary
- Qlik Replicate
- Striim
Typical setup
- Connect Postgres source
- Connect MySQL source
- Connect Snowflake destination
- Enable CDC (change data capture) or incremental sync
- Map tables / schemas
- Let the connector keep Snowflake updated automatically
Pros
- No custom scripts
- Handles schema drift, retries, checkpoints
- Usually supports near-real-time CDC
- Easier ops than rolling your own pipeline
Cons
- Subscription cost
- Some connectors require specific DB settings and permissions
- CDC setup can be a bit involved on the source side
2) Use native database replication into an intermediate layer, then load to Snowflake
This is more “managed” than custom scripting, but less turnkey than the tools above.
Examples:
- AWS DMS for Postgres/MySQL → S3/Kinesis
- Then Snowpipe or external tables / COPY INTO Snowflake
This avoids custom app code, but you still have some infrastructure/configuration.
Good if
- You’re already on AWS
- You want lower-cost ingestion
- You’re okay managing cloud services
3) Use Snowflake partner connectors / marketplace solutions
Snowflake has a partner ecosystem and some marketplace offerings that can ingest from operational databases directly or via managed connectors.
This is effectively the same category as option 1, but through Snowflake’s ecosystem.
Best practical answer
If your requirement is “no custom scripts” and you want the fastest path, use:
- Fivetran if you want the most polished/low-maintenance option
- Airbyte Cloud if you want more flexibility and often lower cost
- Qlik Replicate / Striim if you need stronger enterprise CDC / low-latency replication
Things to check before choosing
For Postgres/MySQL → Snowflake sync, verify:
- CDC support for your source version
- Whether it needs logical replication (Postgres) or binlog config (MySQL)
- Support for schema changes
- Latency target: minutes vs near-real-time
- Whether you need full table refresh or true incremental sync
- Cost model: per-row, per-connector, per-credit, or per-volume
If you want a recommendation
A simple rule of thumb:
- Small team / want easiest ops: Fivetran
- Need lower cost / flexibility: Airbyte Cloud
- Enterprise / complex CDC / high scale: Qlik Replicate or Striim
If you want, I can give you:
- a side-by-side comparison of the top tools, or
- a step-by-step setup for Postgres + MySQL → Snowflake using one of them.