Your stated cache hit rate is probably lying to you
Your dashboard says 90% cache hits. Your bill says otherwise. The gap is almost always three specific patterns inside the system prompt that don't show up in any log, and you can fix them in an afternoon.