Running RAG & Semantic Search… Locally!
One of the challenges I’ve faced with vector databases like Chroma DB is how heavy they can get even with a handful of small PDFs. I have seen them consume 180+ MB once vectorized. Great for experimentation, but not exactly lightweight or (work) laptop‑friendly. Those who have been following me, know that I am a…