Reference ยท STOR 323

Notation decoder

The math symbols the slides use, explained with real-world examples and pictures instead of code. Read once, come back whenever a formula looks like noise.

The hat: ห†

Imagine you're guessing a stranger's weight just by looking at them. There's their actual weight (a real number, but you don't get to see it). And there's your guess, based on what you observed. The hat symbol is math's way of writing "my guess," so it never gets confused with "the real thing."

๐ŸŽฉ
fฬ‚ โ€” our guess
What you built by looking at examples. It's an estimate, and the hat is math's way of saying "estimate, not the real thing" out loud.

Same trick everywhere: ฮฒ (the true, unknowable number) vs. ฮฒฬ‚ (our estimate of it).

Subscripts: fฬ‚D

Picture two different weather forecasters. One trained their forecasting method on ten years of local rainfall data. The other used a different city's data. They'll come up with different guesses โ€” different fฬ‚'s. The little D underneath just labels which batch of data produced this particular guess, the same way you'd label two jars of homemade jam with the date they were made.

Dataset Dโ‚
โ†’
Guess fฬ‚Dโ‚
Dataset Dโ‚‚
โ†’
Guess fฬ‚Dโ‚‚

Different data in, different guess out. The subscript just keeps track of which data made which guess.

Arrow notation: D --A--> fฬ‚D

Think of baking a cake:

๐Ÿฅš Ingredients (D) --baking process (A)--> ๐Ÿฐ The cake (fฬ‚_D)

The arrow just means "goes through." D is your raw data (ingredients). A is the fixed process that never changes (the recipe steps โ€” mix, pour, bake at 350ยฐ). What comes out โ€” fฬ‚_D โ€” depends entirely on what ingredients you put in. Same recipe, different ingredients, different cake.

Set-builder notation & "model family" โ€” the big one

This is the one that trips people up, so let's build it by hand instead of just reading it.

Real-world setup: you're pricing houses. You believe bigger houses cost more, and you believe the relationship is a straight line โ€” some starting price, plus a bit more for every extra square foot. You don't know the exact numbers yet. So before looking at any data, you've already made a decision: "I will only ever consider straight-line pricing rules." That decision โ€” "only straight lines allowed" โ€” is the model family. It's the shape of every rule you're willing to consider, before you've picked the specific one.

Below, you are the machine. Drag the two sliders to move the red line until it passes as close as possible through all five real house sales (the dots). Watch the error number drop as you get closer.

What you just did by hand is exactly what a training algorithm does automatically, just faster and more precisely. Now here's what the notation is really saying:

{ every possible line : starting price and rate-of-increase can be anything }
That whole set of infinitely many possible lines โ€” every position those two sliders could ever be in โ€” is the model family. Training doesn't invent a new kind of rule; it just searches through that family (slides the two sliders) until it finds the one line with the smallest error. That one winning line is your fฬ‚_D.

So the "useful information" packed into the notation is: (1) what shape every candidate is allowed to have (a straight line, not a curve), (2) exactly which knobs are adjustable (here, just two: starting price and rate-of-increase), and (3) that "training" literally means searching those knobs for the setting with the least error โ€” which is the game you just played.

Sum notation: ฮฃ

Think of a grocery receipt โ€” you add up every item to get the total. That's all ฮฃ means: "add these all up."

Item 1$4
Item 2$7
Item 3$2
Total (ฮฃ)$13

ฮฃi=1n x_i just means "add up xโ‚ through xโ‚™" โ€” walk down the receipt and total it.

Argmax

Imagine a talent show where the audience claps for each contestant, and a meter measures how loud the applause is. Argmax doesn't tell you how loud the loudest clap was โ€” it tells you who got it.

0.10
0.05
0.72
0.13
Contestant AContestant BContestant CContestant D

argmax of these four scores is Contestant C โ€” the name/label of the winner, not the 0.72.

Probability notation: โ„™(Y = 1 | x)

Read the bar | as the word "given." "What's the chance of snow, given it's below freezing?" You're not asking about all days ever โ€” you've already narrowed the world down to freezing days first, then asking about snow within just that narrower group.

All days
โ†’
Given: below freezing
โ†’
Chance of snow

โ„™(Y = 1 | x) = "the chance the label is 1, given that we've already observed input x" โ€” same funnel, just with x as the narrowing condition instead of "below freezing."

Stacked conditions: FPRg(t) = โ„™(ฮดt(S) = 1 | Y = 0, G = g)

Story first, from the hospital screening slide. One hospital uses one screening rule โ€” refer for follow-up if the test score is โ‰ฅ 0.30 โ€” on everyone. It applies that exact same rule to two neighborhoods, Group A and Group B. Here's what actually happened to the people who were not sick:

Group A
10%
40%
missed (FNR)false alarm (FPR)
Group B
10%
20%
missed (FNR)false alarm (FPR)

Same test, same threshold, same rule for everybody. And yet: a healthy person in Group A is twice as likely to get a false alarm (40% vs. 20%) as a healthy person in Group B. Nobody changed the rule between groups โ€” the disparity was hiding inside a single "false positive rate" number until you split it by group. That's the concrete thing. Now the label for it:

Everyone
โ†’
Given: actually healthy (Y=0)
โ†’
Given: in Group g
โ†’
Chance flagged anyway

That four-stage funnel, read right to left in the formula, is exactly FPR_g(t) = โ„™(ฮด_t(S) = 1 | Y = 0, G = g):

FNR_g(t) is the mirror image โ€” same funnel, but starting from "given: actually sick (Y=1)" and asking the chance the rule missed them (ฮด_t(S) = 0). That's the "missed" bar in the charts above.

Equal rule โ‰  equal burden. The formula's whole point is that you can't tell whether a rule is fair by looking at one overall number โ€” you have to compute it separately within each group, which is exactly why the group shows up as a condition inside the โ„™(...), not as an afterthought.
Any of this still fuzzy, or want a different real-world example? Just ask โ€” that's what your teaching agent is for.