Reference ยท STOR 323
The math symbols the slides use, explained with real-world examples and pictures instead of code. Read once, come back whenever a formula looks like noise.
Imagine you're guessing a stranger's weight just by looking at them. There's their actual weight (a real number, but you don't get to see it). And there's your guess, based on what you observed. The hat symbol is math's way of writing "my guess," so it never gets confused with "the real thing."
Same trick everywhere: ฮฒ (the true, unknowable number) vs. ฮฒฬ (our estimate of it).
Picture two different weather forecasters. One trained their forecasting method on ten years of local rainfall data. The other used a different city's data. They'll come up with different guesses โ different fฬ's. The little D underneath just labels which batch of data produced this particular guess, the same way you'd label two jars of homemade jam with the date they were made.
Different data in, different guess out. The subscript just keeps track of which data made which guess.
Think of baking a cake:
The arrow just means "goes through." D is your raw data (ingredients). A is the fixed process that never changes (the recipe steps โ mix, pour, bake at 350ยฐ). What comes out โ fฬ_D โ depends entirely on what ingredients you put in. Same recipe, different ingredients, different cake.
This is the one that trips people up, so let's build it by hand instead of just reading it.
Real-world setup: you're pricing houses. You believe bigger houses cost more, and you believe the relationship is a straight line โ some starting price, plus a bit more for every extra square foot. You don't know the exact numbers yet. So before looking at any data, you've already made a decision: "I will only ever consider straight-line pricing rules." That decision โ "only straight lines allowed" โ is the model family. It's the shape of every rule you're willing to consider, before you've picked the specific one.
Below, you are the machine. Drag the two sliders to move the red line until it passes as close as possible through all five real house sales (the dots). Watch the error number drop as you get closer.
What you just did by hand is exactly what a training algorithm does automatically, just faster and more precisely. Now here's what the notation is really saying:
fฬ_D.
So the "useful information" packed into the notation is: (1) what shape every candidate is allowed to have (a straight line, not a curve), (2) exactly which knobs are adjustable (here, just two: starting price and rate-of-increase), and (3) that "training" literally means searching those knobs for the setting with the least error โ which is the game you just played.
Think of a grocery receipt โ you add up every item to get the total. That's all ฮฃ means: "add these all up."
ฮฃi=1n x_i just means "add up xโ through xโ" โ walk down the receipt and total it.
Imagine a talent show where the audience claps for each contestant, and a meter measures how loud the applause is. Argmax doesn't tell you how loud the loudest clap was โ it tells you who got it.
argmax of these four scores is Contestant C โ the name/label of the winner, not the 0.72.
Read the bar | as the word "given." "What's the chance of snow, given it's below freezing?" You're not asking about all days ever โ you've already narrowed the world down to freezing days first, then asking about snow within just that narrower group.
โ(Y = 1 | x) = "the chance the label is 1, given that we've already observed input x" โ same funnel, just with x as the narrowing condition instead of "below freezing."
Story first, from the hospital screening slide. One hospital uses one screening rule โ refer for follow-up if the test score is โฅ 0.30 โ on everyone. It applies that exact same rule to two neighborhoods, Group A and Group B. Here's what actually happened to the people who were not sick:
Same test, same threshold, same rule for everybody. And yet: a healthy person in Group A is twice as likely to get a false alarm (40% vs. 20%) as a healthy person in Group B. Nobody changed the rule between groups โ the disparity was hiding inside a single "false positive rate" number until you split it by group. That's the concrete thing. Now the label for it:
That four-stage funnel, read right to left in the formula, is exactly FPR_g(t) = โ(ฮด_t(S) = 1 | Y = 0, G = g):
ฮด_t(S) = 1 โ "the rule flagged this person" (the thing we're asking the chance of)| Y = 0, G = g โ "given" two conditions stacked together: this person is actually healthy, and they're in group g. Commas inside the conditioning bar just mean "and."g on FPR_g is the same labeling trick as fฬ_D earlier โ it just says which group this particular rate was computed for.
FNR_g(t) is the mirror image โ same funnel, but starting from "given: actually sick (Y=1)" and asking the chance the rule missed them (ฮด_t(S) = 0). That's the "missed" bar in the charts above.