类库 › lance
lance-format

lance-format/lance

Lance是一个为多模态AI设计的开放湖仓格式,支持高性能向量搜索、全文检索和随机访问。它可将Parquet数据快速转换,兼容主流数据处理框架如Pandas、Polars、PyTorch等,适用于构建AI搜索引擎、特征存储和大规模机器学习训练。

6,258 608 6,258 1,086
在 GitHub 上查看
lance-format/lance

技术栈

测试

pytest
查看全部依赖 (102)

依赖

Pandas arrayref 0.3 arrow arrow-arith arrow-array arrow-buffer arrow-cast arrow-data arrow-ipc arrow-ord arrow-row arrow-schema arrow-select async-channel 2.3.1 attrs aws-credential-types bytes chrono com.fasterxml.jackson.core:jackson-databind com.google.guava:guava dashmap 6 datafusion-common datafusion-sql datasets deepsize futures geo-traits geo-types geoarrow-array geoarrow-schema geodatafusion half hex 0.4.3 jieba-rs jsonb lance-arrow lance-arrow-scalar lance-bitpacking lance-core lance-datafusion lance-encoding lance-file lance-geo lance-index lance-io lance-linalg lance-namespace lance-table lancedb libc 0.2 lindera lindera-tantivy matplotlib ml_dtypes num-traits num_cpus 1.0 object_store object_store_opendal opendal org.apache.arrow:arrow-c-data org.apache.arrow:arrow-dataset org.apache.arrow:arrow-memory-netty org.apache.arrow:arrow-vector org.apache.commons:commons-lang3 org.junit.jupiter:junit-jupiter org.lance:lance-namespace-apache-client org.lance:lance-namespace-core org.questdb:jar-jni paste 1 proc-macro2 1.0.67 pyarrow pylance quote 1.0.33 rand rand_distr rand_xoshiro ray ruff seaborn seq-macro 0.3 smallvec 1.15 software.amazon.awssdk:auth software.amazon.awssdk:s3 tdqm torch tqdm twox-hash 2.0 yt-dlp

开发依赖

approx arrow-ord arrow-select criterion env_logger 0.11.6 lance-datagen lance-test-macros lance-testing libc pretty_assertions proptest rand_xoshiro rstest tracing-mock

截图

avg_latency.png
avg_latency.png
https://user-images.githubusercontent.com/917119/199353423-d3e202f7-0269-411d-8ff2-e747e419e492.png

评论

首页 - Wiki
Copyright © 2011-2026 iteam. Current version is 2.155.1. UTC+08:00, 2026-04-03 19:13
浙ICP备14020137号-1 $访客地图$