Where randomness meets reason
Tag
12 posts
How LLM evaluation benchmarks actually work, what they measure, what they miss, and how to build evaluation that matters for your specific application.
Taxonomy of prompt injection attacks and the layered defenses — input validation, output filtering, guardrails — that actually work at scale.
What happens between your API call and a streamed token — routing, batching, KV cache, quantization, and speculative decoding explained.