SyntaxPilot
Courses/Generative AI Engineering/Lesson 58
Video coming soonThis lesson’s video is being made

Start with the notes below; the video appears here as soon as it is on YouTube.

Generative AI Engineering · Lesson 58 of 90

Evals 4: agents, benchmarks and online tests

trajectory evaluationtask success ratetool-call accuracypublic benchmarks (MMLU, GPQA, HumanEval, SWE-bench)benchmark contaminationleaderboardsonline evaluationA/B testingstatistical significance basics

Detailed notes for this lesson are being written. They appear here together with the video.