The API used to read files has evolved over time, from simple full table reads to batch reads and eventually to iterative record batch readers. Lance takes this a step further to return a stream of read tasks.
Explore columnar file readers in depth: column shredding with practical insights and expert guidance from the LanceDB team.
Explore lance v2: a new columnar container format with practical insights and expert guidance from the LanceDB team.
Explore a practical guide to fine-tuning embedding models with practical insights and expert guidance from the LanceDB team.
Streaming data applications can be tricky. When you can read data faster than you can process the data then bad things tend to happen. The various solutions to this problem are largely classified as backpressure.
Explore GraphRAG: hierarchical approach to retrieval-augmented-generation with practical insights and expert guidance from the LanceDB team.
LanceDB is the first open-source AI-Native Multimodal Lakehouse.
