Bayes' theorem P ( B ∣ A ) = P ( A ∣ B ) P ( B ) P ( A ) P(B\mid A)=\dfrac{P(A\mid B)\,P(B)}{P(A)} P ( B ∣ A ) = P ( A ) P ( A ∣ B ) P ( B ) — reverses a conditional probability to update a cause given evidence.Sample space The set S S S (or Ω \Omega Ω ) of all possible outcomes of a random experiment. An event is any subset of S S S . Event Any subset of the sample space. Its probability is a number in [ 0 , 1 ] [0,1] [ 0 , 1 ] . Axioms of probability P ( A ) ≥ 0 P(A)\ge 0 P ( A ) ≥ 0 ; P ( S ) = 1 P(S)=1 P ( S ) = 1 ; for disjoint events P ( ⋃ A i ) = ∑ P ( A i ) P\!\left(\bigcup A_i\right)=\sum P(A_i) P ( ⋃ A i ) = ∑ P ( A i ) .Complement rule P ( A c ) = 1 − P ( A ) P(A^{c})=1-P(A) P ( A c ) = 1 − P ( A ) .Addition rule P ( A ∪ B ) = P ( A ) + P ( B ) − P ( A ∩ B ) P(A\cup B)=P(A)+P(B)-P(A\cap B) P ( A ∪ B ) = P ( A ) + P ( B ) − P ( A ∩ B ) .Mutually exclusive events Events that cannot both occur: P ( A ∩ B ) = 0 P(A\cap B)=0 P ( A ∩ B ) = 0 , so P ( A ∪ B ) = P ( A ) + P ( B ) P(A\cup B)=P(A)+P(B) P ( A ∪ B ) = P ( A ) + P ( B ) . Independent events P ( A ∩ B ) = P ( A ) P ( B ) P(A\cap B)=P(A)\,P(B) P ( A ∩ B ) = P ( A ) P ( B ) , equivalently P ( A ∣ B ) = P ( A ) P(A\mid B)=P(A) P ( A ∣ B ) = P ( A ) . Independence is about influence, not overlap.Conditional probability P ( A ∣ B ) = P ( A ∩ B ) P ( B ) P(A\mid B)=\dfrac{P(A\cap B)}{P(B)} P ( A ∣ B ) = P ( B ) P ( A ∩ B ) for P ( B ) > 0 P(B)>0 P ( B ) > 0 .Multiplication rule P ( A ∩ B ) = P ( A ∣ B ) P ( B ) = P ( B ∣ A ) P ( A ) P(A\cap B)=P(A\mid B)\,P(B)=P(B\mid A)\,P(A) P ( A ∩ B ) = P ( A ∣ B ) P ( B ) = P ( B ∣ A ) P ( A ) .Law of total probability For a partition B 1 , … , B n B_1,\dots,B_n B 1 , … , B n : P ( A ) = ∑ i P ( A ∣ B i ) P ( B i ) P(A)=\sum_i P(A\mid B_i)\,P(B_i) P ( A ) = ∑ i P ( A ∣ B i ) P ( B i ) . Permutation Arrangements where order matters: n P r = n ! ( n − r ) ! \,_nP_r=\dfrac{n!}{(n-r)!} n P r = ( n − r )! n ! . Combination Selections where order does not matter: ( n r ) = n ! r ! ( n − r ) ! \binom{n}{r}=\dfrac{n!}{r!\,(n-r)!} ( r n ) = r ! ( n − r )! n ! . Fundamental counting principle If stage 1 has n 1 n_1 n 1 outcomes and stage 2 has n 2 n_2 n 2 , the process has n 1 × n 2 n_1\times n_2 n 1 × n 2 outcomes. De Morgan's laws ( A ∪ B ) c = A c ∩ B c (A\cup B)^c=A^c\cap B^c ( A ∪ B ) c = A c ∩ B c and ( A ∩ B ) c = A c ∪ B c (A\cap B)^c=A^c\cup B^c ( A ∩ B ) c = A c ∪ B c .Inclusion-exclusion (3 events) P ( A ∪ B ∪ C ) = ∑ P ( ⋅ ) − ∑ P ( ⋅ ∩ ⋅ ) + P ( A ∩ B ∩ C ) P(A\cup B\cup C)=\sum P(\cdot)-\sum P(\cdot\cap\cdot)+P(A\cap B\cap C) P ( A ∪ B ∪ C ) = ∑ P ( ⋅ ) − ∑ P ( ⋅ ∩ ⋅ ) + P ( A ∩ B ∩ C ) .Odds against an event If P ( A ) = p P(A)=p P ( A ) = p , the odds against are ( 1 − p ) : p (1-p):p ( 1 − p ) : p . Equally likely outcomes When N N N outcomes are equally likely, P ( A ) = # outcomes in A N P(A)=\dfrac{\#\,\text{outcomes in }A}{N} P ( A ) = N # outcomes in A . Partition of a sample space A collection of mutually exclusive, exhaustive events whose union is S S S . Conditional independence A A A and B B B are independent given C C C if P ( A ∩ B ∣ C ) = P ( A ∣ C ) P ( B ∣ C ) P(A\cap B\mid C)=P(A\mid C)\,P(B\mid C) P ( A ∩ B ∣ C ) = P ( A ∣ C ) P ( B ∣ C ) .
Pairwise vs mutual independence Pairwise independence (every pair independent) does not imply mutual independence of all events together. P(A or B) for disjoint events P ( A ∪ B ) = P ( A ) + P ( B ) P(A\cup B)=P(A)+P(B) P ( A ∪ B ) = P ( A ) + P ( B ) when A A A and B B B are mutually exclusive.Union bound P ( ⋃ A i ) ≤ ∑ P ( A i ) P\!\left(\bigcup A_i\right)\le \sum P(A_i) P ( ⋃ A i ) ≤ ∑ P ( A i ) .
Sampling without replacement Successive draws are dependent; counts follow the hypergeometric distribution.
Sampling with replacement Successive draws are independent and identically distributed; counts follow the binomial distribution.
Tree diagram A diagram of sequential events whose branch probabilities multiply along a path. Total probability as a weighted average P ( A ) = ∑ i P ( A ∣ B i ) P ( B i ) P(A)=\sum_i P(A\mid B_i)P(B_i) P ( A ) = ∑ i P ( A ∣ B i ) P ( B i ) weights each conditional by how likely its cause is.Prior vs posterior probability In Bayes, P ( B ) P(B) P ( B ) is the prior and P ( B ∣ A ) P(B\mid A) P ( B ∣ A ) — updated by evidence A A A — is the posterior. Probability of the impossible event P ( ∅ ) = 0 P(\varnothing)=0 P ( ∅ ) = 0 .Probability bounds For any event A A A , 0 ≤ P ( A ) ≤ 1 0\le P(A)\le 1 0 ≤ P ( A ) ≤ 1 .
Disjoint vs independent For events of positive probability, mutually exclusive implies dependent (not independent). Conditional probability of the complement P ( A c ∣ B ) = 1 − P ( A ∣ B ) P(A^c\mid B)=1-P(A\mid B) P ( A c ∣ B ) = 1 − P ( A ∣ B ) .Symmetric difference A △ B = ( A ∖ B ) ∪ ( B ∖ A ) A\,\triangle\,B=(A\setminus B)\cup(B\setminus A) A △ B = ( A ∖ B ) ∪ ( B ∖ A ) — outcomes in exactly one of A , B A,B A , B .Bayes with two hypotheses P ( B ∣ A ) = P ( A ∣ B ) P ( B ) P ( A ∣ B ) P ( B ) + P ( A ∣ B c ) P ( B c ) P(B\mid A)=\dfrac{P(A\mid B)P(B)}{P(A\mid B)P(B)+P(A\mid B^c)P(B^c)} P ( B ∣ A ) = P ( A ∣ B ) P ( B ) + P ( A ∣ B c ) P ( B c ) P ( A ∣ B ) P ( B ) .Subset rule (monotonicity) If A ⊆ B A\subseteq B A ⊆ B then P ( A ) ≤ P ( B ) P(A)\le P(B) P ( A ) ≤ P ( B ) . Factorial n ! = n ( n − 1 ) ⋯ 2 ⋅ 1 n!=n(n-1)\cdots 2\cdot 1 n ! = n ( n − 1 ) ⋯ 2 ⋅ 1 , with 0 ! = 1 0!=1 0 ! = 1 by convention.Combinations sum to 2 n 2^n 2 n ∑ r = 0 n ( n r ) = 2 n \sum_{r=0}^{n}\binom{n}{r}=2^n ∑ r = 0 n ( r n ) = 2 n — the number of subsets of an n n n -element set.Symmetry of combinations ( n r ) = ( n n − r ) \binom{n}{r}=\binom{n}{n-r} ( r n ) = ( n − r n ) .At-least-one probability P ( at least one ) = 1 − P ( none ) P(\text{at least one})=1-P(\text{none}) P ( at least one ) = 1 − P ( none ) — use the complement.Conditional probability chain rule P ( A ∩ B ∩ C ) = P ( A ) P ( B ∣ A ) P ( C ∣ A ∩ B ) P(A\cap B\cap C)=P(A)\,P(B\mid A)\,P(C\mid A\cap B) P ( A ∩ B ∩ C ) = P ( A ) P ( B ∣ A ) P ( C ∣ A ∩ B ) .
Mutually exclusive AND exhaustive Disjoint events whose union is the whole sample space; their probabilities sum to 1. Independence and complements If A , B A,B A , B are independent, so are A , B c A,B^c A , B c and A c , B c A^c,B^c A c , B c .
Sample point A single outcome (element) of the sample space. Counting with repetition Choosing r r r from n n n with order and repetition allowed gives n r n^r n r outcomes. Probability as relative frequency Over many trials, P ( A ) P(A) P ( A ) is approximated by the fraction of trials in which A A A occurs. Bayes denominator The P ( A ) P(A) P ( A ) in Bayes' theorem is computed by the law of total probability. Poisson distribution Counts rare events at rate λ \lambda λ : P ( X = k ) = e − λ λ k k ! P(X=k)=\dfrac{e^{-\lambda}\lambda^k}{k!} P ( X = k ) = k ! e − λ λ k ; mean and variance both λ \lambda λ .
Random variable A function assigning a number to each outcome. Discrete (countable values) or continuous (interval of values). Probability mass function (pmf) For a discrete variable, p ( x ) = P ( X = x ) p(x)=P(X=x) p ( x ) = P ( X = x ) ; values are ≥ 0 \ge 0 ≥ 0 and ∑ x p ( x ) = 1 \sum_x p(x)=1 ∑ x p ( x ) = 1 . Probability density function (pdf) For a continuous variable, f ( x ) ≥ 0 f(x)\ge 0 f ( x ) ≥ 0 with ∫ − ∞ ∞ f ( x ) d x = 1 \int_{-\infty}^{\infty} f(x)\,dx=1 ∫ − ∞ ∞ f ( x ) d x = 1 ; probability is area under f f f . Cumulative distribution function (CDF) F ( x ) = P ( X ≤ x ) F(x)=P(X\le x) F ( x ) = P ( X ≤ x ) ; nondecreasing from 0 to 1, and f ( x ) = F ′ ( x ) f(x)=F'(x) f ( x ) = F ′ ( x ) for continuous X X X .Probability from a pdf P ( a ≤ X ≤ b ) = ∫ a b f ( x ) d x P(a\le X\le b)=\int_a^b f(x)\,dx P ( a ≤ X ≤ b ) = ∫ a b f ( x ) d x .Expected value (discrete) E [ X ] = ∑ x x p ( x ) E[X]=\sum_x x\,p(x) E [ X ] = ∑ x x p ( x ) .Expected value (continuous) E [ X ] = ∫ − ∞ ∞ x f ( x ) d x E[X]=\int_{-\infty}^{\infty} x\,f(x)\,dx E [ X ] = ∫ − ∞ ∞ x f ( x ) d x .Law of the unconscious statistician E [ g ( X ) ] = ∑ x g ( x ) p ( x ) E[g(X)]=\sum_x g(x)p(x) E [ g ( X )] = ∑ x g ( x ) p ( x ) or ∫ g ( x ) f ( x ) d x \int g(x)f(x)\,dx ∫ g ( x ) f ( x ) d x — no need to find the distribution of g ( X ) g(X) g ( X ) .Variance Var ( X ) = E [ ( X − μ ) 2 ] = E [ X 2 ] − ( E [ X ] ) 2 \text{Var}(X)=E[(X-\mu)^2]=E[X^2]-(E[X])^2 Var ( X ) = E [( X − μ ) 2 ] = E [ X 2 ] − ( E [ X ] ) 2 .Standard deviation σ = Var ( X ) \sigma=\sqrt{\text{Var}(X)} σ = Var ( X ) — the spread in the units of X X X .Coefficient of variation C V = σ μ CV=\dfrac{\sigma}{\mu} C V = μ σ — a relative (unitless) measure of spread.Linear transformation: mean For Y = a X + b Y=aX+b Y = a X + b , E [ Y ] = a E [ X ] + b E[Y]=aE[X]+b E [ Y ] = a E [ X ] + b . Linear transformation: variance For Y = a X + b Y=aX+b Y = a X + b , Var ( Y ) = a 2 Var ( X ) \text{Var}(Y)=a^2\,\text{Var}(X) Var ( Y ) = a 2 Var ( X ) ; the shift b b b does not affect spread. Median The value m m m with F ( m ) = 0.5 F(m)=0.5 F ( m ) = 0.5 ; resists outliers more than the mean. Mode The value of x x x where the pmf/pdf is largest. Percentile The p p p th percentile is the value x x x with F ( x ) = p F(x)=p F ( x ) = p (e.g. 90th percentile: F ( x ) = 0.90 F(x)=0.90 F ( x ) = 0.90 ). Moment generating function (MGF) M ( t ) = E [ e t X ] M(t)=E[e^{tX}] M ( t ) = E [ e tX ] ; M ′ ( 0 ) = E [ X ] M'(0)=E[X] M ′ ( 0 ) = E [ X ] , M ′ ′ ( 0 ) = E [ X 2 ] M''(0)=E[X^2] M ′′ ( 0 ) = E [ X 2 ] ; it uniquely identifies a distribution.kth moment E [ X k ] E[X^k] E [ X k ] — the k k k th raw moment; M ( k ) ( 0 ) = E [ X k ] M^{(k)}(0)=E[X^k] M ( k ) ( 0 ) = E [ X k ] .
Skewness Based on the third central moment: positive = long right tail (mode < median < mean).
Kurtosis Based on the fourth central moment: measures tail heaviness and peakedness. Bernoulli distribution One trial: X = 1 X=1 X = 1 with prob p p p . Mean p p p , variance p ( 1 − p ) p(1-p) p ( 1 − p ) . Binomial distribution Successes in n n n trials: P ( X = k ) = ( n k ) p k ( 1 − p ) n − k P(X=k)=\binom{n}{k}p^k(1-p)^{n-k} P ( X = k ) = ( k n ) p k ( 1 − p ) n − k ; mean n p np n p , variance n p ( 1 − p ) np(1-p) n p ( 1 − p ) . Binomial mean and variance E [ X ] = n p E[X]=np E [ X ] = n p , Var ( X ) = n p ( 1 − p ) \text{Var}(X)=np(1-p) Var ( X ) = n p ( 1 − p ) .Geometric distribution Trials until the first success; mean 1 / p 1/p 1/ p , and it is memoryless. Negative binomial distribution Trials needed to reach r r r successes — a generalization of the geometric distribution. Hypergeometric distribution Successes when drawing n n n items without replacement from a finite two-type population. Discrete uniform distribution Values 1 , … , n 1,\dots,n 1 , … , n equally likely; mean n + 1 2 \dfrac{n+1}{2} 2 n + 1 . Poisson pmf P ( X = k ) = e − λ λ k k ! P(X=k)=\dfrac{e^{-\lambda}\lambda^k}{k!} P ( X = k ) = k ! e − λ λ k for k = 0 , 1 , 2 , … k=0,1,2,\dots k = 0 , 1 , 2 , … Poisson mean and variance Both equal the rate parameter λ \lambda λ . Sum of independent Poissons Poisson with rate equal to the sum of the rates: λ 1 + λ 2 \lambda_1+\lambda_2 λ 1 + λ 2 . Poisson approximation to binomial For large n n n , small p p p , binomial( n , p ) ≈ (n,p)\approx ( n , p ) ≈ Poisson( λ = n p ) (\lambda=np) ( λ = n p ) . Continuous uniform distribution On [ a , b ] [a,b] [ a , b ] : density 1 b − a \dfrac{1}{b-a} b − a 1 , mean a + b 2 \dfrac{a+b}{2} 2 a + b , variance ( b − a ) 2 12 \dfrac{(b-a)^2}{12} 12 ( b − a ) 2 . Uniform mean and variance E [ X ] = a + b 2 E[X]=\dfrac{a+b}{2} E [ X ] = 2 a + b , Var ( X ) = ( b − a ) 2 12 \text{Var}(X)=\dfrac{(b-a)^2}{12} Var ( X ) = 12 ( b − a ) 2 .Exponential distribution Waiting time at rate λ \lambda λ : f ( x ) = λ e − λ x f(x)=\lambda e^{-\lambda x} f ( x ) = λ e − λ x ; mean and sd 1 / λ 1/\lambda 1/ λ , variance 1 / λ 2 1/\lambda^2 1/ λ 2 . Exponential mean and variance E [ X ] = 1 / λ E[X]=1/\lambda E [ X ] = 1/ λ , Var ( X ) = 1 / λ 2 \text{Var}(X)=1/\lambda^2 Var ( X ) = 1/ λ 2 .Memoryless property P ( X > s + t ∣ X > s ) = P ( X > t ) P(X>s+t\mid X>s)=P(X>t) P ( X > s + t ∣ X > s ) = P ( X > t ) ; held by the exponential and geometric distributions.Hazard (force of failure) rate h ( x ) = f ( x ) 1 − F ( x ) h(x)=\dfrac{f(x)}{1-F(x)} h ( x ) = 1 − F ( x ) f ( x ) ; constant λ \lambda λ for the exponential.Gamma distribution A sum of α \alpha α independent exponential waits; generalizes the exponential. Beta distribution A continuous distribution on [ 0 , 1 ] [0,1] [ 0 , 1 ] used to model proportions and probabilities. Normal distribution Symmetric bell curve N ( μ , σ 2 ) N(\mu,\sigma^2) N ( μ , σ 2 ) ; standardize with z = x − μ σ z=\dfrac{x-\mu}{\sigma} z = σ x − μ . Standard normal distribution Z ∼ N ( 0 , 1 ) Z\sim N(0,1) Z ∼ N ( 0 , 1 ) : mean 0, standard deviation 1.Standardizing a normal z = x − μ σ z=\dfrac{x-\mu}{\sigma} z = σ x − μ converts X X X to the standard normal for table lookup.Empirical rule For a normal: ≈ 68 % \approx 68\% ≈ 68% within 1 σ 1\sigma 1 σ , 95 % 95\% 95% within 2 σ 2\sigma 2 σ , 99.7 % 99.7\% 99.7% within 3 σ 3\sigma 3 σ . Standard normal symmetry P ( Z ≤ − z ) = 1 − P ( Z ≤ z ) P(Z\le -z)=1-P(Z\le z) P ( Z ≤ − z ) = 1 − P ( Z ≤ z ) , and P ( Z > 0 ) = 0.5 P(Z>0)=0.5 P ( Z > 0 ) = 0.5 .Lognormal distribution X X X is lognormal if ln X \ln X ln X is normal — used for positive, right-skewed losses.Survival function S ( x ) = P ( X > x ) = 1 − F ( x ) S(x)=P(X>x)=1-F(x) S ( x ) = P ( X > x ) = 1 − F ( x ) .Deductible (ordinary) With deductible d d d , payment per loss is max ( X − d , 0 ) \max(X-d,\,0) max ( X − d , 0 ) . Coinsurance The insurer pays a fraction α \alpha α of the covered loss above the deductible. Policy limit Caps the payment at a maximum u u u ; the insurer never pays more.
Order of policy provisions Apply deductible first, then coinsurance, then the policy limit.
Loss vs payment random variable The loss is the full damage; the payment is what the insurer pays after deductible, coinsurance, and limits. Expected payment with a deductible E [ max ( X − d , 0 ) ] < E [ X ] E[\max(X-d,0)]<E[X] E [ max ( X − d , 0 )] < E [ X ] — small losses are zeroed out.Inflation on losses Multiplying every loss by 1 + r 1+r 1 + r scales the mean by 1 + r 1+r 1 + r and the standard deviation by 1 + r 1+r 1 + r . Variance shortcut formula Var ( X ) = E [ X 2 ] − ( E [ X ] ) 2 \text{Var}(X)=E[X^2]-(E[X])^2 Var ( X ) = E [ X 2 ] − ( E [ X ] ) 2 .Expected value of a constant E [ c ] = c E[c]=c E [ c ] = c and Var ( c ) = 0 \text{Var}(c)=0 Var ( c ) = 0 .Probability for a continuous point P ( X = x ) = 0 P(X=x)=0 P ( X = x ) = 0 for any single value of a continuous variable.
Right-skewed distribution Mode < median < mean; the long tail points right (positive skew).
Left-skewed distribution Mean < median < mode; the long tail points left (negative skew). Bernoulli variance Var ( X ) = p ( 1 − p ) \text{Var}(X)=p(1-p) Var ( X ) = p ( 1 − p ) , maximized at p = 0.5 p=0.5 p = 0.5 .Geometric memorylessness P ( X > m + n ∣ X > m ) = P ( X > n ) P(X>m+n\mid X>m)=P(X>n) P ( X > m + n ∣ X > m ) = P ( X > n ) for the (discrete) geometric distribution.Percent of normal area beyond 2 sd By the empirical rule, ≈ 2.5 % \approx 2.5\% ≈ 2.5% lies above μ + 2 σ \mu+2\sigma μ + 2 σ . Indicator random variable I A = 1 I_A=1 I A = 1 if A A A occurs, else 0; E [ I A ] = P ( A ) E[I_A]=P(A) E [ I A ] = P ( A ) .Mode of a continuous distribution The x x x maximizing the density f ( x ) f(x) f ( x ) . Negative binomial as r successes Counts failures (or trials) before the r r r th success; reduces to geometric when r = 1 r=1 r = 1 . Continuous CDF and pdf relationship F ( x ) = ∫ − ∞ x f ( t ) d t F(x)=\int_{-\infty}^x f(t)\,dt F ( x ) = ∫ − ∞ x f ( t ) d t and f ( x ) = d d x F ( x ) f(x)=\dfrac{d}{dx}F(x) f ( x ) = d x d F ( x ) .
Support of a distribution The set of values where the pmf/pdf is positive.
Symmetric distribution mean and median For a symmetric distribution, the mean equals the median. Probability over the whole support ∑ x p ( x ) = 1 \sum_x p(x)=1 ∑ x p ( x ) = 1 (discrete) or ∫ f ( x ) d x = 1 \int f(x)\,dx=1 ∫ f ( x ) d x = 1 (continuous).Normal mean and variance N ( μ , σ 2 ) N(\mu,\sigma^2) N ( μ , σ 2 ) has mean μ \mu μ and variance σ 2 \sigma^2 σ 2 .Limited expected value E [ min ( X , u ) ] E[\min(X,u)] E [ min ( X , u )] — the expected loss capped at a policy limit u u u .Coinsurance + deductible payment Payment = α ( X − d ) =\alpha\,(X-d) = α ( X − d ) for X > d X>d X > d , then capped at the policy limit. E [ X 2 ] E[X^2] E [ X 2 ] from varianceE [ X 2 ] = Var ( X ) + ( E [ X ] ) 2 E[X^2]=\text{Var}(X)+(E[X])^2 E [ X 2 ] = Var ( X ) + ( E [ X ] ) 2 .Geometric mean For trials-until-first-success, E [ X ] = 1 / p E[X]=1/p E [ X ] = 1/ p . Probability a Poisson count is zero P ( X = 0 ) = e − λ P(X=0)=e^{-\lambda} P ( X = 0 ) = e − λ .Exponential CDF F ( x ) = 1 − e − λ x F(x)=1-e^{-\lambda x} F ( x ) = 1 − e − λ x for x ≥ 0 x\ge 0 x ≥ 0 .Exponential survival function P ( X > x ) = e − λ x P(X>x)=e^{-\lambda x} P ( X > x ) = e − λ x .Standard normal P(Z>0) P ( Z > 0 ) = 0.5 P(Z>0)=0.5 P ( Z > 0 ) = 0.5 by symmetry about 0.Discrete uniform variance For values 1 , … , n 1,\dots,n 1 , … , n : Var ( X ) = n 2 − 1 12 \text{Var}(X)=\dfrac{n^2-1}{12} Var ( X ) = 12 n 2 − 1 . Mean of a transformed loss For Y = a X + b Y=aX+b Y = a X + b , E [ Y ] = a E [ X ] + b E[Y]=aE[X]+b E [ Y ] = a E [ X ] + b — apply inflation a a a and a flat add b b b . Probability density nonnegativity A valid pdf satisfies f ( x ) ≥ 0 f(x)\ge 0 f ( x ) ≥ 0 everywhere and integrates to 1.
Discrete vs continuous probability Discrete: sum a pmf; continuous: integrate a pdf. Both total to 1. Expected value linearity (one variable) E [ a X + b ] = a E [ X ] + b E[aX+b]=aE[X]+b E [ a X + b ] = a E [ X ] + b .
Z-score interpretation A z-score is the number of standard deviations a value is from the mean. Constant hazard implies exponential A constant force of failure λ \lambda λ uniquely characterizes the exponential distribution. Probability between two z-values P ( z 1 < Z < z 2 ) = Φ ( z 2 ) − Φ ( z 1 ) P(z_1<Z<z_2)=\Phi(z_2)-\Phi(z_1) P ( z 1 < Z < z 2 ) = Φ ( z 2 ) − Φ ( z 1 ) from the standard-normal table.Mean of a binomial as np With n = 10 n=10 n = 10 , p = 0.3 p=0.3 p = 0.3 , E [ X ] = n p = 3 E[X]=np=3 E [ X ] = n p = 3 . Variance scales by a squared Var ( a X ) = a 2 Var ( X ) \text{Var}(aX)=a^2\,\text{Var}(X) Var ( a X ) = a 2 Var ( X ) ; standard deviation scales by ∣ a ∣ |a| ∣ a ∣ .Right-tail probability symmetry For the standard normal, P ( Z > z ) = 1 − Φ ( z ) = Φ ( − z ) P(Z>z)=1-\Phi(z)=\Phi(-z) P ( Z > z ) = 1 − Φ ( z ) = Φ ( − z ) . Bernoulli as binomial special case A Bernoulli( p ) (p) ( p ) is a binomial( 1 , p ) (1,p) ( 1 , p ) . Probability mass nonnegativity A valid pmf satisfies p ( x ) ≥ 0 p(x)\ge 0 p ( x ) ≥ 0 and ∑ x p ( x ) = 1 \sum_x p(x)=1 ∑ x p ( x ) = 1 . Median of a symmetric normal For N ( μ , σ 2 ) N(\mu,\sigma^2) N ( μ , σ 2 ) the median equals the mean μ \mu μ . Sum of squares for variance Var ( X ) = E [ X 2 ] − μ 2 \text{Var}(X)=E[X^2]-\mu^2 Var ( X ) = E [ X 2 ] − μ 2 , the second moment minus the squared mean.Central Limit Theorem The standardized sum of many i.i.d. variables S n − n μ σ n → N ( 0 , 1 ) \dfrac{S_n-n\mu}{\sigma\sqrt{n}}\to N(0,1) σ n S n − n μ → N ( 0 , 1 ) , regardless of shape. Covariance Cov ( X , Y ) = E [ X Y ] − E [ X ] E [ Y ] \text{Cov}(X,Y)=E[XY]-E[X]\,E[Y] Cov ( X , Y ) = E [ X Y ] − E [ X ] E [ Y ] ; 0 for independent variables.Joint pmf p ( x , y ) = P ( X = x , Y = y ) p(x,y)=P(X=x,\,Y=y) p ( x , y ) = P ( X = x , Y = y ) for discrete variables; sums to 1 over all pairs.Joint pdf f ( x , y ) ≥ 0 f(x,y)\ge 0 f ( x , y ) ≥ 0 with ∬ f ( x , y ) d x d y = 1 \iint f(x,y)\,dx\,dy=1 ∬ f ( x , y ) d x d y = 1 for continuous variables.Joint CDF F ( x , y ) = P ( X ≤ x , Y ≤ y ) F(x,y)=P(X\le x,\,Y\le y) F ( x , y ) = P ( X ≤ x , Y ≤ y ) .Marginal distribution f X ( x ) = ∫ f ( x , y ) d y f_X(x)=\int f(x,y)\,dy f X ( x ) = ∫ f ( x , y ) d y — integrate (or sum) out the other variable.Conditional density f Y ∣ X ( y ∣ x ) = f ( x , y ) f X ( x ) f_{Y\mid X}(y\mid x)=\dfrac{f(x,y)}{f_X(x)} f Y ∣ X ( y ∣ x ) = f X ( x ) f ( x , y ) .Independence of two variables X , Y X,Y X , Y independent ⟺ f ( x , y ) = f X ( x ) f Y ( y ) \iff f(x,y)=f_X(x)\,f_Y(y) ⟺ f ( x , y ) = f X ( x ) f Y ( y ) for all x , y x,y x , y .Joint CDF at infinity lim x , y → ∞ F ( x , y ) = 1 \displaystyle\lim_{x,y\to\infty}F(x,y)=1 x , y → ∞ lim F ( x , y ) = 1 .Independent joint CDF For independent X , Y X,Y X , Y : F ( x , y ) = F X ( x ) F Y ( y ) F(x,y)=F_X(x)\,F_Y(y) F ( x , y ) = F X ( x ) F Y ( y ) . Conditional expectation E [ X ∣ Y = y ] = ∑ x x p X ∣ Y ( x ∣ y ) E[X\mid Y=y]=\sum_x x\,p_{X\mid Y}(x\mid y) E [ X ∣ Y = y ] = ∑ x x p X ∣ Y ( x ∣ y ) — the mean of the conditional distribution.Double expectation (tower rule) E [ X ] = E [ E [ X ∣ Y ] ] E[X]=E\!\left[\,E[X\mid Y]\,\right] E [ X ] = E [ E [ X ∣ Y ] ] .Covariance shortcut Cov ( X , Y ) = E [ X Y ] − E [ X ] E [ Y ] \text{Cov}(X,Y)=E[XY]-E[X]E[Y] Cov ( X , Y ) = E [ X Y ] − E [ X ] E [ Y ] ; if independent, E [ X Y ] = E [ X ] E [ Y ] E[XY]=E[X]E[Y] E [ X Y ] = E [ X ] E [ Y ] so covariance is 0.Covariance with itself Cov ( X , X ) = Var ( X ) \text{Cov}(X,X)=\text{Var}(X) Cov ( X , X ) = Var ( X ) .Covariance bilinearity Cov ( a X , b Y ) = a b Cov ( X , Y ) \text{Cov}(aX,bY)=ab\,\text{Cov}(X,Y) Cov ( a X , bY ) = ab Cov ( X , Y ) .Correlation coefficient ρ = Cov ( X , Y ) σ X σ Y \rho=\dfrac{\text{Cov}(X,Y)}{\sigma_X\,\sigma_Y} ρ = σ X σ Y Cov ( X , Y ) , always in [ − 1 , 1 ] [-1,1] [ − 1 , 1 ] .
Zero covariance vs independence Independence implies zero covariance, but zero covariance does NOT imply independence. Variance of a sum Var ( X + Y ) = Var ( X ) + Var ( Y ) + 2 Cov ( X , Y ) \text{Var}(X+Y)=\text{Var}(X)+\text{Var}(Y)+2\,\text{Cov}(X,Y) Var ( X + Y ) = Var ( X ) + Var ( Y ) + 2 Cov ( X , Y ) .Variance of a sum (independent) Var ( X + Y ) = Var ( X ) + Var ( Y ) \text{Var}(X+Y)=\text{Var}(X)+\text{Var}(Y) Var ( X + Y ) = Var ( X ) + Var ( Y ) when X , Y X,Y X , Y are independent.Variance of a difference Var ( X − Y ) = Var ( X ) + Var ( Y ) − 2 Cov ( X , Y ) \text{Var}(X-Y)=\text{Var}(X)+\text{Var}(Y)-2\,\text{Cov}(X,Y) Var ( X − Y ) = Var ( X ) + Var ( Y ) − 2 Cov ( X , Y ) .Variance of a linear combination Var ( a X + b Y ) = a 2 Var ( X ) + b 2 Var ( Y ) + 2 a b Cov ( X , Y ) \text{Var}(aX+bY)=a^2\text{Var}(X)+b^2\text{Var}(Y)+2ab\,\text{Cov}(X,Y) Var ( a X + bY ) = a 2 Var ( X ) + b 2 Var ( Y ) + 2 ab Cov ( X , Y ) .Mean of a linear combination E [ a X + b Y ] = a E [ X ] + b E [ Y ] E[aX+bY]=aE[X]+bE[Y] E [ a X + bY ] = a E [ X ] + b E [ Y ] — holds whether or not X , Y X,Y X , Y are independent.Expected value of a product E [ X Y ] = E [ X ] E [ Y ] E[XY]=E[X]E[Y] E [ X Y ] = E [ X ] E [ Y ] only when X X X and Y Y Y are independent (or uncorrelated).CLT mean and variance of the sum For S n = ∑ X i S_n=\sum X_i S n = ∑ X i i.i.d.: E [ S n ] = n μ E[S_n]=n\mu E [ S n ] = n μ , Var ( S n ) = n σ 2 \text{Var}(S_n)=n\sigma^2 Var ( S n ) = n σ 2 . CLT for the sample mean E [ X ˉ ] = μ E[\bar X]=\mu E [ X ˉ ] = μ , Var ( X ˉ ) = σ 2 / n \text{Var}(\bar X)=\sigma^2/n Var ( X ˉ ) = σ 2 / n , and X ˉ \bar X X ˉ is approximately normal for large n n n .
Sum of independent normals A linear combination of independent normals is normal, with means and variances adding. Order statistics A sample sorted smallest to largest: X ( 1 ) ≤ ⋯ ≤ X ( n ) X_{(1)}\le\dots\le X_{(n)} X ( 1 ) ≤ ⋯ ≤ X ( n ) . Maximum order statistic CDF For n n n i.i.d. with CDF F F F : P ( X ( n ) ≤ t ) = [ F ( t ) ] n P(X_{(n)}\le t)=[F(t)]^n P ( X ( n ) ≤ t ) = [ F ( t ) ] n . Minimum order statistic CDF For n n n i.i.d. with CDF F F F : P ( X ( 1 ) ≤ t ) = 1 − [ 1 − F ( t ) ] n P(X_{(1)}\le t)=1-[1-F(t)]^n P ( X ( 1 ) ≤ t ) = 1 − [ 1 − F ( t ) ] n . Sample range R = X ( n ) − X ( 1 ) R=X_{(n)}-X_{(1)} R = X ( n ) − X ( 1 ) — the largest minus the smallest order statistic.Convolution (sum of variables) The pmf/pdf of X + Y X+Y X + Y for independent variables is the convolution of the two distributions. Joint moments E [ X Y ] = ∑ x ∑ y x y p ( x , y ) E[XY]=\sum_x\sum_y x\,y\,p(x,y) E [ X Y ] = ∑ x ∑ y x y p ( x , y ) (discrete) — sum over all pairs.
Marginal from a joint table Row totals give the marginal of one variable; column totals give the marginal of the other.
Conditional probability from a table A cell divided by its row (or column) total gives a conditional probability. Conditional variance Var ( X ∣ Y = y ) \text{Var}(X\mid Y=y) Var ( X ∣ Y = y ) is the variance of the conditional distribution of X X X given Y = y Y=y Y = y .Covariance of independent variables Cov ( X , Y ) = 0 \text{Cov}(X,Y)=0 Cov ( X , Y ) = 0 when X X X and Y Y Y are independent.Correlation of independent variables ρ = 0 \rho=0 ρ = 0 for independent variables (but ρ = 0 \rho=0 ρ = 0 alone does not prove independence).Sum of independent Poissons (multivariate) X + Y ∼ Poisson ( λ 1 + λ 2 ) X+Y\sim\text{Poisson}(\lambda_1+\lambda_2) X + Y ∼ Poisson ( λ 1 + λ 2 ) for independent Poissons.Standardizing a sum for the CLT Z = S n − n μ σ n Z=\dfrac{S_n-n\mu}{\sigma\sqrt{n}} Z = σ n S n − n μ is approximately N ( 0 , 1 ) N(0,1) N ( 0 , 1 ) .
Why the normal is everywhere The CLT makes sums and averages (e.g. aggregate claims) approximately normal even from skewed components. Joint density factoring test If f ( x , y ) f(x,y) f ( x , y ) factors into a function of x x x times a function of y y y over a rectangle, X X X and Y Y Y are independent. Linearity of expectation E [ ∑ a i X i ] = ∑ a i E [ X i ] E\!\left[\sum a_i X_i\right]=\sum a_i E[X_i] E [ ∑ a i X i ] = ∑ a i E [ X i ] — always, regardless of dependence.Sum of n i.i.d. variances Var ( ∑ i = 1 n X i ) = n σ 2 \text{Var}\!\left(\sum_{i=1}^n X_i\right)=n\sigma^2 Var ( ∑ i = 1 n X i ) = n σ 2 when the X i X_i X i are independent and identically distributed.Min of independent exponentials The minimum of independent exponentials with rates λ i \lambda_i λ i is exponential with rate ∑ λ i \sum\lambda_i ∑ λ i .
Joint vs marginal independence Variables can be dependent through a joint distribution even with simple-looking marginals — check the joint. Conditional mean depends on x If the conditional distribution of Y Y Y given X X X changes with X X X , then X X X and Y Y Y are dependent. Median of order statistics (odd n) For odd n n n , the sample median is the middle order statistic X ( ( n + 1 ) / 2 ) X_{((n+1)/2)} X (( n + 1 ) /2 ) .
Covariance sign interpretation Positive: variables move together; negative: one rises as the other falls; zero: no linear relationship. Correlation bounds − 1 ≤ ρ ≤ 1 -1\le\rho\le 1 − 1 ≤ ρ ≤ 1 ; ∣ ρ ∣ = 1 |\rho|=1 ∣ ρ ∣ = 1 means a perfect linear relationship.Aggregate claims model Total claims S = ∑ X i S=\sum X_i S = ∑ X i ; by the CLT S S S is approximately normal for large claim counts. Marginal mean from joint E [ X ] E[X] E [ X ] uses the marginal of X X X , obtained by summing/integrating out Y Y Y .Standard deviation of a sum (independent) σ X + Y = σ X 2 + σ Y 2 \sigma_{X+Y}=\sqrt{\sigma_X^2+\sigma_Y^2} σ X + Y = σ X 2 + σ Y 2 when independent.Sum of i.i.d. mean E ( ∑ i = 1 n X i ) = n μ E\!\left(\sum_{i=1}^n X_i\right)=n\mu E ( ∑ i = 1 n X i ) = n μ .Joint probability totals to one ∑ x ∑ y p ( x , y ) = 1 \sum_x\sum_y p(x,y)=1 ∑ x ∑ y p ( x , y ) = 1 or ∬ f ( x , y ) d x d y = 1 \iint f(x,y)\,dx\,dy=1 ∬ f ( x , y ) d x d y = 1 .Linear combination of normals stays normal a X + b Y aX+bY a X + bY is normal when X , Y X,Y X , Y are independent normals.Uncorrelated does not mean independent Cov = 0 \text{Cov}=0 Cov = 0 is necessary but not sufficient for independence.Multinomial coefficient n ! n 1 ! n 2 ! ⋯ n k ! \dfrac{n!}{n_1!\,n_2!\cdots n_k!} n 1 ! n 2 ! ⋯ n k ! n ! counts arrangements of n n n items in k k k groups.Probability of a run of successes For independent trials, P ( k successes in a row ) = p k P(k\text{ successes in a row})=p^k P ( k successes in a row ) = p k . Standard normal CDF notation Φ ( z ) = P ( Z ≤ z ) \Phi(z)=P(Z\le z) Φ ( z ) = P ( Z ≤ z ) for the standard normal.Covariance of a variable and a constant Cov ( X , c ) = 0 \text{Cov}(X,c)=0 Cov ( X , c ) = 0 for any constant c c c .CLT requires finite variance The classic CLT needs i.i.d. variables with finite mean μ \mu μ and variance σ 2 \sigma^2 σ 2 .