Airbyte is a data integration platform that syncs data from APIs, databases, and files into warehouses and lakes, available self-hosted or as a managed cloud service.

Fivetran is a commercial, fully managed data movement platform with maintained connectors, automated schema handling, and consumption-based pricing.

Debezium is an open-source CDC platform that streams row-level changes from databases such as PostgreSQL, MySQL, and MongoDB, typically via Kafka Connect.

Snowflake is a commercial cloud data platform offering elastic SQL warehouses, cross-account data sharing, and multi-cloud availability as a fully managed service.

BigQuery is Google Cloud's serverless, fully managed data warehouse with on-demand or capacity-based pricing, streaming ingestion, and built-in ML functions.

ClickHouse is an open-source columnar database designed for low-latency analytical queries over large volumes, available self-hosted or as ClickHouse Cloud.

Apache Iceberg is an open table format bringing ACID transactions, schema evolution, and time travel to data lake tables, with broad engine support.

Delta Lake is an open-source table format providing ACID transactions, schema enforcement, and time travel over Parquet files, closely integrated with Spark and Databricks.

Apache Spark is an open-source distributed compute engine for batch processing, SQL, machine learning, and stream processing across large clusters.

dbt is a transformation framework that compiles modular, version-controlled SQL models and runs them inside the warehouse, with testing, documentation, and lineage built in.

Trino is an open-source distributed SQL engine that queries data where it lives — object storage, lakehouse table formats, and operational databases — through a single interface.

DuckDB is an open-source, in-process OLAP database — an embeddable columnar SQL engine that queries Parquet, CSV, and dataframes with no server to run.

Apache Kafka is an open-source distributed log for high-throughput, durable event streaming, with a large ecosystem including Kafka Connect and Kafka Streams.

Apache Flink is an open-source framework for stateful computation over unbounded and bounded data streams, with event-time processing and exactly-once state consistency.

Redpanda is a Kafka API-compatible streaming platform written in C++, shipped as a single binary without ZooKeeper or a JVM, available self-hosted or as a managed cloud.

Apache Airflow is the widely adopted open-source orchestrator where pipelines are Python-defined DAGs, with a large provider ecosystem and multiple managed offerings.

Dagster is an open-source orchestrator organized around software-defined assets — declaring the tables and models pipelines produce — with strong local development and testing.

Prefect is an open-source orchestration framework where plain Python functions become flows and tasks, aimed at dynamic, failure-tolerant pipelines with minimal boilerplate.

DataHub is an open-source metadata platform providing search, discovery, and end-to-end lineage across warehouses, pipelines, and BI tools via push-based ingestion.

OpenMetadata is an open-source metadata platform combining catalog, lineage, data quality tests, and collaboration on a single schema-first foundation with many connectors.

Great Expectations (GX) is an open-source Python framework for declaring, validating, and documenting data quality expectations inside pipelines.