ML / LLM notes for learning, building, and interview preparation.

When I started preparing for industry roles, my materials were scattered across lectures, papers, documentation, and bookmarks. Finding a good explanation took time. Working out what to read next took more. These notes grew out of trying to bring that material together.

Here you'll find ML and LLM notes in English and Chinese, with examples, diagrams, code, and project walkthroughs. They're free to read and will stay that way. You can start with the basics, review for an interview, or explore a field outside your own. The aim is to make useful material easier to find and follow, even if you're new to it.

English or 中文: use the switch at the top of any note. It opens the same article in the other language; Chinese notes keep familiar English technical terms. The site starts in English and remembers your choice in this browser. A direct link to a language opens that version.

Start here

What brings you here? A place to start
I'm new to ML Starting out — work through a prediction, a loss, and a parameter update. Python pointers are included.
I want a learning plan Study at your pace — choose a route and fit reading and practice around your week.
I have an interview soon Quick review — focus on topics relevant to the role and the time you have.
I want to check what I know Coding checks · Role-based preparation — try first, then revisit what was difficult.
I'm here out of curiosity Choose a topic · Tech history — explore a question or follow how a field developed.

Choose for the topic, not your job title. You might know systems well and still want an introduction to RL.

How to use the notes

  1. Pick something you want to understand. Use a route above, or the topic guide. You don't need to read the site in order.
  2. Follow the example, then try it. Work through a calculation or run the code. Continue to the derivation and tradeoffs when you want more detail. We're still improving this progression in some chapters.
  3. Keep your place. Choose “Save this page” under a note's title, and find it later under “My reading” at the top right; a note reopens where you stopped. No account or fork is needed. Records stay in this browser; export a JSON backup to keep a copy or move devices.

Time estimates mean focused learning time, not a daily target. Split a session if you need to; there is no streak to maintain.

What's in each section

  • Foundations — How models work, learn, and are evaluated. The study guide is a starting point for language models.
  • Interview prep — ML / LLM review, ML coding, Python, and reusable algorithm patterns.
  • Engineering practice — Recommendation, RAG, and post-training systems: how data, training, serving, and evaluation fit together.
  • Tech history — Developments in power, chips, networks, software, and AI, with links to original sources.
  • Career notes — What I tried during internship and new-grad searches, and what I'd do differently.

Diagrams show the main idea without requiring interaction. The controls are there when you want to change an input or compare outcomes.

Practice with your AI agent (interview coach skill)

Install the notes into an agent that reads skills, such as Claude Code or Codex, and it becomes an interviewer: one question at a time, graded against the notes, with follow-up questions, and a record of what you got wrong so the next session starts there. The notes and questions come from the site's read-only data API and update with the site; your answers and scores stay on your machine.

npx skills add https://github.com/tianyi-zhang-02/cooking-agi --skill cooking-agi-interview

Then ask, for example, "Mock interview for an LLM inference engineer role, 5 questions" or "What am I weak at? Quiz me on that". See skills/README.md for details. The skill was contributed by @Juggernaut0825.

What's inside

A few articles to start reading now:

For practice, head to ML coding, Python, algorithm patterns, or system design.

Still being worked on: some explanations and source comparisons need more review. The coverage and backlog separates material that exists from material that has been checked. Small tested examples are not claims of full-model training or benchmark reproduction.

Roadmap

Now

Better notes, not more of them. Every note has been re-read once in both languages, and in October the facts were checked again against primary sources: errors fixed, stale numbers updated, repeated explanations folded into one place. The newest series (AI infrastructure, perception and driving, three frontier series, scaling, diffusion LMs and quantization) are drafts until the site owner has read them. If something reads awkwardly, is hard to follow, or seems wrong, please tell us; every article also ends with a feedback button.

Next: a faster way to the answer: better search and quicker pages, then an MCP server, so Claude, ChatGPT and Cursor can search the notes and quiz you from the same data as the interview coach skill. For Jetson, physical simulation, and reviewing the vision, driving and robotics drafts, we'd like people who have worked in those areas to join us. See the roadmap for the full plan; the scope of the upcoming v1.0 interview-prep release is in release scope.

Topic coverage

How many notes each topic has, and how far this review pass has got. The numbers update on every site deploy.

206 of 264 notes reviewed

Foundations

  • Foundations18 / 18
  • Architectures & model families23 / 23
  • Multimodal learning11 / 11
  • Pretraining & training mechanics12 / 16
  • Deep RL18 / 21
  • Post-training25 / 25
  • Evaluation12 / 13
  • Generation, context & inference9 / 9
  • Data, memory & retrieval9 / 9
  • Agents7 / 8
  • AI systems & experience2 / 3
  • AI infrastructure (draft)0 / 14
  • Perception, robots & driving (draft)0 / 10
  • Frontier0 / 24

Interview prep

  • Start here8 / 8
  • ML / LLM fundamentals4 / 4
  • ML coding6 / 6
  • Algorithm patterns15 / 15

Engineering practice

  • An ML system end to end2 / 2
  • Build something small4 / 4
  • System design4 / 4
  • Inside recommender systems9 / 9
  • A RAG knowledge assistant2 / 2
  • Post-training experiments6 / 6

Open to contributors

  • Jetson & edge deploymentHelp wanted
  • Physical simulationHelp wanted
Item by item: coverage and gaps

How we got here

By date: August 2026 to now
When What happened
Early August 2026 Started: Chinese notes and a systems study map; the first site and the Transformer foundations
Late August A post-training series from PPO to what came after; interview fundamentals and a whiteboard checklist
Late September Site redesign around career routes and knowledge blocks; interactive figures for RLHF, MoE, looped Transformers and Agents
End of September to early October The whole site in two languages; learning paths and self-checks, CLIP and multimodal, LLM-as-a-Judge, Deep RL labs
October 9–11 Bilingual routes organized into a system, examples checked one by one; training, inference and ML systems guides
October 13 The chronicle world tree (143 sourced milestones), reading history, page feedback and security hardening
October 14 Step-by-step animations in the LeetCode notes; saved notes and reading history folded into “My reading”; step-by-step figures in four chapters; first full read-through of every note in both languages
October 15–16 Frontier watch, AI infrastructure and embodied AI (with the papers' own figures and 26 step-by-step figures); every note audited for errors, stale facts and repetition; drafts on scaling, diffusion LMs and quantization

Details of every merge are in the changelog at the bottom of this page.

Contributors and reviewers

Everyone with a commit or co-author credit, the reviewers who approve changes in each area, and where readers went next if they chose to share it. The card is rebuilt from git history, GitHub and site/collaboration.toml on every deploy and every hour. Commit counts are not a ranking: questions, reviews and corrections count too. To be credited for a review or correction, or to share your next stop (only what you choose to show), open an issue: credit me · share my next stop.

Join us!

If a passage is confusing, something has changed, or a topic is missing, we'd like to hear about it. You don't need to have the answer before asking a question.

  • Give feedback: open an issue and link the part you're referring to. You can flag a correction, outdated information, an unclear explanation, a missing topic, or a site problem.
  • Make a change: small fixes can go straight into a PR. For a new article or navigation change, start with a content proposal so we can coordinate.
  • Pass it on: if the notes helped you learn or prepare, share the link with a friend or classmate. Sharing an employer or job-search outcome is never required. The people behind the notes are listed under Contributors and reviewers.

These are our working notes, not an official curriculum. Our experience is mainly in ML / LLM and MLE / research preparation, and it shapes what we cover. Some material will be incomplete or out of date. We share public knowledge and preparation methods, not company-specific interview information or question banks. We can't predict questions or promise an offer.

Contributing, review, and privacy

See the contributing guide, editorial guide, and area reviewers. Community PRs need a relevant non-author CODEOWNER review and passing checks. Use public sources and your own explanations. Disclose and check AI-assisted work; an AI review is not formal approval or factual verification.

Issues are public. Don't attach private progress backups, company material, or unredacted logs. A public source or software version is helpful when reporting a change, but not required to ask for a clearer explanation.

Free to read, open to reuse. There are no paid chapters or premium preparation routes. Original code uses MIT; original notes use CC BY 4.0. Keep attribution, source links, and the relevant notices, and mark your changes. Third-party materials retain their own terms. We don't endorse others' edited or redistributed versions; warranty and liability terms are in the licenses.

Run locally

This repository contains the notes, examples, and static-site source. No database is needed. From the repository root, with Python 3.12 recommended:

python3 -m pip install markdown pygments numpy
python3 site/build.py --serve

Open http://localhost:8000. To build without starting a server, run python3 site/build.py; output goes to _site/.

Checks before submitting
python3 site/collaboration.py
python3 -m unittest discover -s site/tests
python3 site/leakcheck.py
python3 site/paritycheck.py --strict
python3 site/build.py

Some experiments also need PyTorch, as documented in their chapters; corresponding tests explicitly skip when it is unavailable. Your bookmark list, recently opened notes, and reading positions stay in this browser. Public counting is off by default; opting in sends only subsequent reads and manual save actions, not past records or backups.

Why this exists

Moving from academic research toward industry, I often found that something I recognized in a paper was much harder to explain or implement myself. Writing it down helped me notice those gaps. Sharing the notes gives other people a chance to point them out too.

I hope this makes it easier to get started without already having a background in the field or someone to hand you a reading list. It won't replace study and practice. Where others explain something better, we'll link to them; where we lack experience, we'd like to learn from people who have it. Comparing notes across fields may reveal connections we wouldn't find on our own.

If it saves you some searching and leaves a little more time for the rest of your life, that's a good reason to keep working on it.

Changelog

Every change merged into the main branch, by date, split into major and minor updates. Links go to the pull requests.

Date Major Minor
2026-10-17 Interview coach skill: mock interviews in Claude Code or Codex graded against the notes, which now come from a read-only data API on the site (#103, contributed by @Juggernaut0825) · New README: animated preview, and topic, roadmap and contributor cards that update with the site (#104 #105) Contributor pages move from the site to the GitHub page (#104) · Card icons and folded sections (#106)
2026-10-16 Every note audited: errors fixed, interview pages kept free of company hiring processes (#99), facts updated to October 2026 (#100), repeated explanations folded together and links to the new areas (#101) · Draft series on scaling laws, diffusion LMs and quantization (#102) The unpublished quant notes removed (#98)
2026-10-15 Frontier watch, AI infrastructure and embodied AI, with the papers' own figures and 26 step-by-step figures (#97) —
2026-10-14 Step-by-step animations in the LeetCode notes (#78) · Step-by-step figures and the papers' own figures in four chapters (#83) · Every note read through once in both languages, checking facts, worked examples and wording (#84 #85 #87 #88 #89 #90) · Step-by-step figures in 16 training and systems notes (#94) Saved notes, reading history and backups fold into “My reading”; the study dashboard goes and its exercises move to the study plan (#81) · New README promo (#79) · README roadmap, topic coverage and changelog (#82) · Line breaks inside Chinese paragraphs no longer render as spaces (#86) · Review list and changelog (#91) · The interview-prep home becomes a plain directory (#93) · With the private repo archived, the leak check is the only gate (#92) · The gated-attention example uses gates that do not sum to 1 (#95)
2026-10-13 Chronicle: a technology world tree with 143 sourced milestones, later a vertical timeline (#65 #71) · Study dashboard and reading history (#64 #67) Reading panel: today, this week, all time (#66 #70) · One-click page feedback (#72) · Security hardening (#73) · Study buddy (#74) · Anonymous counts (#75 #76) · vLLM / SGLang comparison (#68) · README animation (#69)
2026-10-11 Bilingual entry, README and learning routes; engineering labs and more worked examples (#61 #62) Training, inference, SigLIP and ML systems guides (#63)
2026-10-09 Bilingual learning routes reorganized, examples checked one by one (#60) —
2026-10-05 Bilingual Deep RL lessons with interactive labs (#58) More natural career notes (#59)
2026-10-03 Math and quant review with proofs and worked examples (#56, later removed) Discussions retired to refocus on the notes (#57)
2026-10-02 Bilingual LLM-as-a-Judge lessons with interactive evaluation labs (#55) —
2026-10-01 Navigation, reading tools and community pages (#45) Discussions launched and laid out (#53 #54)
2026-09-30 Bilingual learning paths and chapter self-checks (#42) CLIP / VLM notes and bilingual READMEs (#44) · The Python you use in coding problems (#40)
2026-09-25 — AI Infra section removed; skipped notes polished, a co-reviewer added (#37 #38)
2026-09-24 Quant zone: a probability series (#36, later removed) —
2026-09-23 Close readings, agents, model choice, career and AI infra (#33 #34) Contributors page and credits (#30 #31 #32) · ML Systems reading list (#35)
2026-09-22 A nine-note RLHF series; MoE, looped Transformers and Agents with seven live figures (#24 #25) One language per page (#18) · Night-sky design and home page (#19 #20 #21 #22) · Long evaluation notes split (#23) · Career notes (#26 #27 #28 #29)
2026-09-21 Site redesign around career routes, knowledge blocks and quick review (#17) —
2026-08-27 — Interview fundamentals, a whiteboard checklist and reference implementations (#15 #16)
2026-08-26 Post-training series in four steps, from PPO to what came after (#11 #13 #14) A Chinese reading guide (#10)
2026-08-24 — Decoding and the RLHF pipeline restored (#8)
2026-08-14 — Multi-head attention, normalization and residual connections (#7)
2026-08-12 Foundations chapter, reading order and the first site (#3) Smoother Chinese, grouped sidebar (#4) · Architecture diagrams and intro / advanced layers (#6)
2026-08-10 First AI infrastructure study guide (#1) Redrawn diagrams (#2)