Warrant
Question answering over NIST SP 800-53, where every claim names the control that warrants it
Compliance answers are only useful if you can check them. Warrant embeds the full NIST SP 800-53 catalog — 1,014 controls from the OSCAL source — into Postgres with pgvector, retrieves the controls that bear on a question, and tags every sentence of the answer to the control ID that supports it, with the clause itself one click away. I chose the embedding model by measurement rather than habit: four candidates run on CPU against a 42-question golden set, with recall@5 and latency recorded for each. Recorded answer fixtures mean the whole pipeline replays deterministically, so the tests never need an API key.
- Role
- Solo — corpus to console
- Period
- Aug 2026
- Scale
- 1,014 controls · 42-question golden set
- Measure
- recall@5 0.679 · retrieval under 80 ms
- Python
- FastAPI
- PostgreSQL
- pgvector
- bge-base-en-v1.5
- OSCAL
- React
- TypeScript
- Vite
- Docker Compose
- CatalogOSCAL · 1,014 controls
- Embedbge-base · 768-d
- StorePostgres + pgvector
- Retrievetop-k · under 80 ms
- AnswerLLM, live or replay
- Citeclaim → control ID
Recorded answer fixtures let the whole pipeline replay deterministically with no API key. The embedding model was chosen by measurement — four candidates on CPU against a 42-question golden set — not by default.







