Probability DistributionsTopic #16 of 33

Standard Normal and Z-Scores

Standardization: converting to z-scores, using z-tables, and finding probabilities.

Overview

Z-scores standardize values from any normal distribution to the standard normal distribution, enabling probability calculations using a single reference table.

Z-Score Formula

Z=XμσZ = \frac{X - \mu}{\sigma}

Where:

  • XX = raw score
  • μ\mu = population mean
  • σ\sigma = population standard deviation

Interpretation

Z-ScoreMeaning
Z=0Z = 0At the mean
Z=1Z = 1One SD above mean
Z=1Z = -1One SD below mean
Z=2Z = 2Two SD above mean

The z-score tells you how many standard deviations a value is from the mean.

Standard Normal Distribution

ZN(0,1)Z \sim N(0, 1)

Properties:

  • Mean = 0
  • Standard deviation = 1
  • Total area = 1
  • Symmetric about 0

Using Z-Tables

Z-tables give P(Z<z)P(Z < z), the area to the left of zz.

Common Z-Values and Probabilities

ZZP(Z<z)P(Z < z)P(Z>z)P(Z > z)
-2.580.00490.9951
-1.960.02500.9750
-1.6450.05000.9500
00.50000.5000
1.6450.95000.0500
1.960.97500.0250
2.580.99510.0049

Key Percentiles

PercentileZ-Score
1st-2.326
5th-1.645
10th-1.282
25th-0.674
50th0
75th0.674
90th1.282
95th1.645
99th2.326

Probability Calculations

Left Tail: P(Z<z)P(Z < z)

Read directly from z-table

Right Tail: P(Z>z)P(Z > z)

P(Z>z)=1P(Z<z)P(Z > z) = 1 - P(Z < z)

Between Two Values: P(z1<Z<z2)P(z_1 < Z < z_2)

P(z1<Z<z2)=P(Z<z2)P(Z<z1)P(z_1 < Z < z_2) = P(Z < z_2) - P(Z < z_1)

Two-Tailed: P(Z>z)P(\lvert Z \rvert > z)

P(Z>z)=2×P(Z>z)P(\lvert Z \rvert > z) = 2 \times P(Z > z)

Examples

Example 1: Finding Z-Score

IQ scores: μ=100\mu = 100, σ=15\sigma = 15. Convert IQ of 130 to z-score.

Z=13010015=2.0Z = \frac{130 - 100}{15} = 2.0

Interpretation: An IQ of 130 is 2 standard deviations above the mean.

Example 2: Finding Probability

SAT scores: μ=500\mu = 500, σ=100\sigma = 100. Find P(X<620)P(X < 620).

Z=620500100=1.2Z = \frac{620 - 500}{100} = 1.2 P(Z<1.2)=0.8849P(Z < 1.2) = 0.8849

Approximately 88.5% score below 620.

Example 3: Finding a Value from Z

Given P(X<k)=0.90P(X < k) = 0.90, find kk.

From table: Z=1.282\text{From table: } Z = 1.282 k=μ+Z×σ=500+1.282×100=628.2k = \mu + Z \times \sigma = 500 + 1.282 \times 100 = 628.2

Example 4: Comparing Values from Different Distributions

Test A: Score 85, μ=75\mu = 75, σ=5\sigma = 5Z=2.0Z = 2.0

Test B: Score 90, μ=80\mu = 80, σ=10\sigma = 10Z=1.0Z = 1.0

The score of 85 on Test A is relatively better (higher z-score).

Example 5: Probability Between Values

Heights: μ=170\mu = 170 cm, σ=10\sigma = 10 cm. Find P(160<X<180)P(160 < X < 180).

Z1=16017010=1.0Z_1 = \frac{160 - 170}{10} = -1.0 Z2=18017010=1.0Z_2 = \frac{180 - 170}{10} = 1.0 P(1<Z<1)=P(Z<1)P(Z<1)=0.84130.1587=0.6826P(-1 < Z < 1) = P(Z < 1) - P(Z < -1) = 0.8413 - 0.1587 = 0.6826

Applications

ApplicationWhat Z-Scores Tell You
Class gradesPosition relative to class
Quality controlHow unusual a measurement is
ResearchIdentifying outliers (Z>3\lvert Z \rvert > 3)
Standardized testsComparison across different forms

Converting Back

From z-score to raw score:

X=μ+Z×σX = \mu + Z \times \sigma