Home / Notes

Notes

Written from systems I run in production, with the failures included. If something here reads like a warning, it is because I walked into it first.

9 Aug 2026
RAG

An assistant over your company documents

Anyone can build the demo in an afternoon. What decides whether the project ships is permissions, knowing which version of each document is current, and citing the source every time. What stretches these projects is almost never the AI.

9 Aug 2026
Evaluation

Your AI's 92% confidence probably measures nothing

For months my clinical platform displayed a confidence score that did not come from the model we thought it did. Why it happens so often, how to check yours in an afternoon, and what to show instead.