Coders In Hoods

Courses
Answers
Setup
Bookmarks

Coders In Hoods Academy

Every course is free. Sign in to start, and your progress, quiz scores and bookmarks follow you.

Academy

Courses
Paths
Exercise answers
Setup guides
Bookmarks

Coders In Hoods

The agency
Coaching for teams

Social

LinkedIn
X (Twitter)

Contact

codersinhoods@gmail.com

© Coders In Hoods · since 2019

Free · no card

Coders In Hoods Academy

Sign in to start learning

Free, no card. We use your account to save progress, quiz scores, bookmarks and occasionally send updates from our team.

Course overview

Human Feedback at Scale

Free · sign in to start and track progress

1 · Human judgement at scale

1Designing human evaluations
2Agreement and disagreement among many raters
3Pairwise preferences and rankings

2 · Signals from real use

4Feedback from users
5Understanding usage at scale, privately

3 · Closing the loop with few labels

6Estimating quality from few labels
7Review queues and the dataset loop
Exercise answers
- Answer: Build a review queue and promote what it finds
- Answer: Measure what pre-labels do to your own labels

CapstoneBuild a feedback system for a support assistant Reference implementation

Answers Lesson 7: Review queues and the dataset loop

Step-by-step answer

Stretch 60–75 min7 steps

Measure what pre-labels do to your own labels

Back to the exercise

Previous answerBuild a review queue and promote what it finds Next answer Capstone: Build a feedback system for a support assistant

Free · sign in to start

Sign in to read the answer.

Free, no card. We use your account to save progress, quiz scores, bookmarks and occasionally send updates from our team.

7 more sections
Progress, quiz scores and bookmarks