Apache DataFusion SQL Query Engine
-
Updated
Oct 18, 2026 - Rust
Apache DataFusion SQL Query Engine
Drop-in Apache Spark replacement written in Rust, unifying batch processing, stream processing, and compute-intensive AI workloads.
Create full-fledged APIs for slowly moving datasets without writing a single line of code.
LakeSoul is an end-to-end, realtime cloud-native Lakehouse framework for fast data ingestion, concurrent updates, incremental analytics, multimodal data processing and vector search — powering next-generation BI and AI workloads.
Apache Kafka® compatible broker with S3, PostgreSQL, SQLite, Apache Iceberg and Delta Lake
Apache Auron is an accelerator for big data engines, leveraging native vectorized execution to accelerate query processing.
Object-storage native graph database with branching and typed ontology
High performance Rust stream processing engine seamlessly integrates AI capabilities, providing powerful real-time data processing and intelligent analysis.
Learn vector search with Rust and DataFusion; the C++/BusTub track is deprecated.
DuckDB-powered data lake analytics from Postgres
Analytical database for data-driven Web applications 🪶
Pushdown cache for DataFusion
Next-generation decentralized data lakehouse and a multi-party stream processing network
Unofficial rust implementation of Apache Iceberg with integration for Datafusion
A Rust-native DuckLake engine built on Apache DataFusion
Blazing-Fast Bioinformatic Operations on Python DataFrames
To associate your repository with the datafusion topic, visit your repo's landing page and select "manage topics."