smallrag

Small implementation of an RAG (retrieval-augmented generation) with bun, hono, sqlite-vec, and langchain (ollama)

Installing

Make sure you have ollama with embeddinggemma & gemma3 model, and bun installed on your machine.

Install dependencies:

bun install

Running the app

Run:

bun run dev

open http://localhost:3000

Ingesting documents:
POST /ingest with this body:

{
  "documents": "some documents"
}

Querying:
POST /query with this body:

{
  "query": "some query"
}