ML Knowledge Base

39 reference documents · converted from Markdown

Master References3

Cross-cutting merges compiled from the whole knowledge base

A — Decision Trees (Master Merge) A single merged reference consolidating the "decision tree / which-method" guide from every cheat sheet in this knowledge base that has one (26 of 36 files). Each source's tree is preserved verbatim under it… A-Decision_Trees.md A — Things to Memorize (Master Merge) A single merged study sheet consolidating the "things to memorize" appendix from every cheat sheet in this knowledge base (36 files). Each source's list is preserved under its topic; paper links are kept int… A-Things_to_Memorize.md A — Year-by-Year Milestones (Master Merge) A single merged chronology consolidating the "year-by-year milestones" timeline from every cheat sheet in this knowledge base that has one (27 of 36 files). Each source's timeline is preserved verbatim under… A-Year_by_Year_Milestones.md

Transformers & LLM Architecture6

Attention, tokenization, MoE, KV cache

Attention — All Variants & Tricks Updated July 2026 with 2025–2026 SOTA additions — new entries marked ★. T-Attention_SOTA_Updated.md KV Cache — Technologies & Tricks Updated July 2026 with 2025–2026 SOTA additions — new entries marked ★. T-KV_Cache_SOTA_Updated.md Mixture of Experts — Technologies & Tricks Updated July 2026 with 2025–2026 SOTA additions — new entries marked ★. T-MoE_SOTA_Updated.md Tokenization & Context Treatment — Technologies & Tricks Updated July 2026 with 2025–2026 SOTA additions — new entries marked ★. T-Tokenization_Context_SOTA_Updated.md Tokenization & Context Treatment — Technologies & Tricks Updated July 2026 with 2025–2026 SOTA additions — new entries marked ★. T-Tokenization_Context_SOTA_Updated_v2.md The X-Former Catalogue — Every Notable Transformer Variant Updated July 2026 with 2025–2026 SOTA additions — new entries marked ★. T-XFormer_Catalogue_SOTA_Updated.md

Reasoning, RL & Agents7

Policy optimization, rewards, agentic systems, test-time compute

Agentic Intelligence — Technologies & Tricks Updated July 2026 with 2025–2026 SOTA additions — new entries marked ★. R-Agentic_Intelligence_SOTA_Updated.md Policy Optimization — All Variants & Tricks in RL Updated July 2026 with 2025–2026 SOTA additions — new entries marked ★. R-Policy_Optimization_SOTA_Updated.md Prompt · Context · Harness · Graph Engineering — and Self-Improving AI The engineering stack around a frozen model: how you prompt it, what context you feed it, the harness you wrap it in, the graphs you impose on it — and how systems improve themselves. R-Prompt_Context_Harness_Graph_Engineering_SOTA_Updated.md RL Training Strategies & Practical Recipes — Every recipe and engineering trick that turns a policy-optimization paper into a model that actually trains 22 sections · classical RL through 2026 RLHF R-RL_Training_Strategies_Recipes_CheatSheet_with_Links.md Reasoning Technologies — in Modern AI Updated July 2026 with 2025–2026 SOTA additions — new entries marked ★. R-Reasoning_Technologies_SOTA_Updated.md Reward Functions — All Variants & Design Patterns Updated July 2026 with 2025–2026 SOTA additions — new entries marked ★. R-Reward_Functions_SOTA_Updated.md Training-Free & Test-Time Optimization / Training — SOTA Cheat Sheet Methods that improve a frozen (or barely-touched) model at inference — no training run required. Decoding, activation steering, weight merging, speculative decoding, guidance; test-time compute & search; tes… R-Test_Time_and_Training_Free_Optimization_SOTA_Updated.md

Efficiency, Data & Evaluation6

Quantization, pruning, distillation, PEFT, data, metrics

Data Collection & Curation — All Variants & Tricks Updated July 2026 with 2025–2026 SOTA additions — new entries marked ★. M-Data_Collection_Curation_SOTA_Updated.md Distillation — Technologies & Tricks Updated July 2026 with 2025–2026 SOTA additions — new entries marked ★. M-Distillation_SOTA_Updated.md Metrics & Evaluations — All Variants & Tricks Updated July 2026 with 2025–2026 SOTA additions — new entries marked ★. M-Metrics_Evaluations_SOTA_Updated.md Parameter-Efficient Fine-Tuning (PEFT) — All Variants & Tricks Updated July 2026 with 2025–2026 SOTA additions — new entries marked ★. M-PEFT_SOTA_Updated.md Pruning — Parameters, Gaussians, Tokens Updated July 2026 with 2025–2026 SOTA additions — new entries marked ★. M-Pruning_SOTA_Updated.md Quantization — Technologies & Tricks Updated July 2026 with 2025–2026 SOTA additions — new entries marked ★. M-Quantization_SOTA_Updated.md

Diffusion Models2

Formulations, derivations and samplers

Diffusion Models — Step-by-Step Derivations — SDEs, ODEs & More Updated July 2026 with 2025–2026 SOTA additions — new entries marked ★. D-Diffusion_Derivations_SOTA_Updated.md Diffusion Models — All Variants & Tricks Updated July 2026 with 2025–2026 SOTA additions — new entries marked ★. D-Diffusion_Models_SOTA_Updated.md

Foundation & Generative Models5

Scaling laws, video, world models, VLA

Foundation Models — Vision, Graphics, Multimodality Updated July 2026 with 2025–2026 SOTA additions — new entries marked ★. F-Foundation_Models_SOTA_Updated.md Scaling Laws — Technologies & Tricks Updated July 2026 with 2025–2026 SOTA additions — new entries marked ★. F-Scaling_Laws_SOTA_Updated.md VLA Models — Vision-Language-Action Updated July 2026 with 2025–2026 SOTA additions — new entries marked ★. F-VLA_Models_SOTA_Updated.md Video Generation — Models, Technologies & Tricks Updated July 2026 with 2025–2026 SOTA additions — new entries marked ★. F-Video_Generation_SOTA_Updated.md World Models — Technologies & Tricks Updated July 2026 with 2025–2026 SOTA additions — new entries marked ★. F-World_Models_SOTA_Updated.md

3D Vision & Neural Rendering8

NeRF, Gaussian splatting, SfM, avatars, driving

**1\. Foundations: The AV Stack** 3D-Autonomous_Driving_All_Variants_with_Links.md Delighting & Relighting — All Variants & Tricks Updated July 2026 with 2025–2026 SOTA additions — new entries marked ★. 3D-Delighting_Relighting_SOTA_Updated.md Gaussian Splatting — All Variants Cheat Sheet Updated July 2026 with 2025–2026 SOTA additions — new entries marked ★. 3D-Gaussian_Splatting_SOTA_Updated.md 3D / Multi-View Generation Models — All Variants & Tricks Updated July 2026 with 2025–2026 SOTA additions — new entries marked ★. 3D-MultiView_Generation_SOTA_Updated.md NeRF — All Variants Cheat Sheet Updated July 2026 with 2025–2026 SOTA additions — new entries marked ★. 3D-NeRF_SOTA_Updated.md Neural Rendering — Technologies & Tricks Updated July 2026 with 2025–2026 SOTA additions — new entries marked ★. 3D-Neural_Rendering_SOTA_Updated.md Photo-realistic Avatars — All Variants & Tricks Updated July 2026 with 2025–2026 SOTA additions — new entries marked ★. 3D-Photorealistic_Avatars_SOTA_Updated.md Structure from Motion — Technologies & Tricks Updated July 2026 with 2025–2026 SOTA additions — new entries marked ★. 3D-Structure_from_Motion_SOTA_Updated.md

Computer Vision Deep Dives2

Principal-level breadth and mathematics

Computer Vision — Principal Deep Dive — Senior-Principal Interview Prep Updated July 2026 with 2025–2026 SOTA additions — new entries marked ★. CV-Principal_DeepDive_SOTA_Updated.md Computer Vision — Principal Math — Interview Cheat Sheets Updated July 2026 with 2025–2026 SOTA additions — new entries marked ★. CV-Principal_Math_SOTA_Updated.md