lakehq

sail

Drop-in Apache Spark replacement written in Rust, unifying batch processing, stream processing, and compute-intensive AI workloads.

Rust Apache-2.0 Data / Analytics AI / Machine Learning CONTRIBUTING.md
Stars 3.5k
Forks 246
Open issues 169
Last push

Issues stay on GitHub. Read the thread before starting work.

Topics

arrowbig-datapysparkrustsparksqldatafusionpythonartificial-intelligencedata-engineeringdistributed-computingmachine-learninglakehousedelta-lakeicebergspark-connectspark-sqlapache-icebergapache-sparkparquet