Module 4 — Knowledge Checks (5)

Module 4 — Knowledge Checks (5)#

Answer in plain English. If you can explain these without equations, you understand the foundations.

  1. Weights

  • What are weights, and why do we say “nothing is learned except the weights”?

  1. Loss

  • What is loss, and why can’t learning happen without it?

  1. Gradient vs Learning Rate

  • What does the gradient tell you?

  • What does the learning rate control?

  • What happens if the learning rate is too large or too small?

  1. Training vs Inference

  • What is the difference, and why do real-world failures often show up in inference?

  1. Overfitting & Validation

  • What is overfitting?

  • How does a validation set help detect it?

  • In the hiker story, what does “the scout” do?