SyntaxPilot
Courses/Generative AI Engineering/Lesson 57
Video coming soonThis lesson’s video is being made

Start with the notes below; the video appears here as soon as it is on YouTube.

Generative AI Engineering · Lesson 57 of 90

Evals 3: LLM-as-judge done right

grading rubricpointwise vs pairwise judgingreference-based vs reference-free judgingjudge biases (position, verbosity, self-preference)chain-of-thought judgingcalibrating judges with human labelsinter-annotator agreementCohen's kappa

Detailed notes for this lesson are being written. They appear here together with the video.