Coders In Hoods

Courses
Answers
Setup
Bookmarks

Coders In Hoods Academy

Every course is free. Sign in to start, and your progress, quiz scores and bookmarks follow you.

Academy

Courses
Paths
Exercise answers
Setup guides
Bookmarks

Coders In Hoods

The agency
Coaching for teams

Social

LinkedIn
X (Twitter)

Contact

codersinhoods@gmail.com

© Coders In Hoods · since 2019

Free · no card

Coders In Hoods Academy

Sign in to start learning

Free, no card. We use your account to save progress, quiz scores, bookmarks and occasionally send updates from our team.

Course overview

LLMs for Engineers

Free · sign in to start and track progress

1 · Inside the transformer

1Tokens and embeddings
2Attention, step by step
3The transformer block

2 · How models are trained

4Pretraining and scaling laws
Exercise answers
- Answer: Fit your own scaling law on a laptop
- Answer: Base model versus assistant on conveyancing prompts
5Post-training an assistant

3 · Running models in production

6Sampling and hallucination
7Context windows, KV cache and caching
8Reasoning models and extended thinking
9Choosing and comparing models

CapstoneChoose a model for document extraction Reference implementation

Answers Lesson 4: Pretraining and scaling laws

Step-by-step answer

Core 60–90 min7 steps

Fit your own scaling law on a laptop

Back to the exercise

Previous answerProve RoPE is relative, numerically Next answer Base model versus assistant on conveyancing prompts

Free · sign in to start

Sign in to read the answer.

Free, no card. We use your account to save progress, quiz scores, bookmarks and occasionally send updates from our team.

7 more sections
Progress, quiz scores and bookmarks