lance-format

lance

Open Lakehouse Format for Multimodal AI. Convert from Parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, and PyTorch with more integrations coming..

Rust Apache-2.0 AI / Machine Learning Data / Analytics CONTRIBUTING.md
Stars 7.4k
Forks 960
Open issues 805
Last push

Issues stay on GitHub. Read the thread before starting work.

Topics

machine-learningcomputer-visiondata-formatdeep-learningpythonapache-arrowduckdbmlopsdata-analysisdata-analyticsdata-sciencedataopsdata-centricembeddingsrustllms