Expedia's AI chief Xavi Amatriain explains why AI evals are replacing traditional specs for agent governance, using toll gates calibrated to risk.

How we build and release AI systems: turn intent into measurable artifacts, align the whole team on one shared truth, and keep quality honest from prototype to production.

YouTube video by Sasha Rush 🤗

Evaluation metrics, how to build eval datasets, eval methodology, and a review of several benchmarks.

You can't check every output by hand, and a machine can't check it for you until you write down what "good" means. Beeline turns one sentence into a feature, the evals that judge it, and the proof it ...