LightMySky

Machine Learning

34 topics open, in the order they build on each other.

  1. Joint, Marginal and Conditional Probabilityages 18 to 19 · 18 questions
  2. Data as a Matrix: Rows, Features and the Targetages 18 to 20 · 15 questions
  3. Likelihood and the Maximum Likelihood Estimateages 18 to 20 · 8 questions
  4. Linear Regression by Least Squaresages 19 to 20 · 12 questions
  5. Bayes' Rule and Updating a Beliefages 18 to 19 · 14 questions
  6. Training Across Many Devices: Data, Model and Pipeline Parallelismages 23 to 24 · 8 questions
  7. Serving a Model: Batching, the Key-Value Cache and Quantisationages 23 to 24 · 8 questions
  8. Gradient Descent: Following the Slope Downhillages 19 to 20 · 8 questions
  9. Logistic Regression and the Decision Boundaryages 19 to 21 · 16 questions
  10. Overfitting and the Bias-Variance Trade-offages 19 to 21 · 11 questions
  11. Regularisation: Charging for Complexityages 20 to 21 · 8 questions
  12. Cross-Validation and Honest Model Selectionages 20 to 21 · 16 questions
  13. Beyond Accuracy: Precision, Recall and the Cost of an Errorages 20 to 22 · 8 questions
  14. Decision Trees and Ensemblesages 20 to 22 · 8 questions
  15. Clustering: Structure Without Labelsages 20 to 22 · 8 questions
  16. Principal Components and Dimensionality Reductionages 20 to 22 · 15 questions
  17. From Perceptron to Multilayer Networkages 21 to 22 · 8 questions
  18. Backpropagation: Assigning Blame for an Errorages 21 to 22 · 17 questions
  19. Deep Learning: Convolution, Sequence and Scaleages 21 to 22 · 8 questions
  20. Attention as a Learned Lookupages 22 to 23 · 8 questions
  21. The Transformer Block: Heads, Residuals and Normalisationages 22 to 23 · 8 questions
  22. Tokenisation and What a Model Actually Readsages 22 to 23 · 8 questions
  23. Pretraining by Predicting the Next Tokenages 22 to 23 · 8 questions
  24. Scaling Laws and the Compute Budgetages 22 to 23 · 8 questions
  25. Adapting a Pretrained Model: Fine-Tuning and Low-Rank Updatesages 22 to 24 · 12 questions
  26. Generative Models: Learning a Distribution You Can Sampleages 22 to 24 · 8 questions
  27. Diffusion Models: Learning to Undo Noiseages 22 to 24 · 8 questions
  28. Benchmarks and the Traps in Themages 22 to 24 · 8 questions
  29. Markov Decision Processes: States, Actions and Returnages 22 to 24 · 11 questions
  30. Temporal-Difference Learning and Q-Learningages 23 to 24 · 8 questions
  31. Policy Gradients and the Actor-Critic Splitages 23 to 24 · 8 questions
  32. Learning from Human Preferences: Reward Models and Policy Optimisationages 23 to 24 · 8 questions
  33. Fairness, Accountability and the Limits of a Modelages 21 to 22 · 8 questions
  34. Interpretability: Probes, Features and Circuitsages 23 to 24 · 8 questions
Machine Learning · Computing · LightMySky