From lancedb.com
An attempt to build cursor's @codebase feature - RAG on codebases - part 1/2
0 0
💡This is a community post by Sankalp Shubham The project will look something like this: Introduction If you have used the Cursor code editor's @codebase feature, you're probably familiar with how helpful it can be for understanding codebases. Whether you need to find relevant files, trace...
on Dec 4
From lancedb.com
Columnar File Readers in Depth: Backpressure
0 0
Streaming data applications can be tricky. When you can read data faster than you can process the data then bad things tend to happen. The most common scenario is you run out of memory and your process crashes. When the process doesn't crash, it often breaks performance (e.g. swapping
on Oct 28
From lancedb.com
Columnar File Readers in Depth: Scheduling vs Decoding
0 0
We've been working on readers / writers for our recently announced Lance v2 file format and are posting in-depth articles about writing a high performance file reader. In the first article I talked about how we obtain parallelism without row groups. Today, I want to explain how, and why, we separate
on Jun 25
From lancedb.com
Practical introduction to Adaptive-RAG
0 0
Traditional LLMs provide answers based on a fixed knowledge database on which they are trained. This limits their ability to respond with current or specific information. While methods like Retrieval-Augmented Generation (RAG) try to solve this by combining LLMs with external data retrieval,...
on May 6
From lancedb.com
Lance v2: A columnar container format for modern data
0 0
Why a new format? Lance was invented because readers and writers for existing column formats did not handle AI/ML workloads efficiently. Lance v1 solved some of these problems but still struggles in a number of cases. At the same time, others (btrblocks, procella, vortex) have found similar issues with
on Apr 23
From lancedb.com
LanceDB - developer friendly, serverless vector database
0 0
Developer-friendly, serverless vector database for AI applications
on Mar 30