RAG concierge
- Problem
- Customer operations was the bottleneck. Every incoming question required manual search across scattered docs, past tickets, and dashboards. Latency was high, throughput was flat, and hiring would not have fixed it.
- Build
- RAG concierge end-to-end: document ingestion pipeline, vector retrieval over internal KB, retrieval-grounded LLM responses with inline citations, cost and safety guardrails, and an eval harness tracking answer faithfulness, citation coverage, and drift as content changed.
- Outcome
- 2x operational throughput without headcount. Query latency dropped from minutes of manual search to sub-second retrieval. Still running in production, on budget and within SLO.
