Shipping the demo
A prototype that worked on ten examples goes live without an evaluation set, and quality is judged by whoever complains first.
What it costs
Silent errors in customer-facing answers, a rollback after the first incident, and a team that no longer trusts automation.
How we decide
No agent goes to production without a test set from real cases and a quality threshold agreed with the business owner.
