Statistical Inference
Statistical Inference
Actuarial Science
Lectures 1 and 2
Dr. Md Mushfiqur Rahman
East West University
Lecture Goals
Key Definitions
Sample
cd
ef gh i jk l m n
o p q rs t u v w
x y
gi
o
n
r
y
Values computed from
sample data are called
statistics
Examples of Populations
Random Sampling
Simple random sampling is a procedure in which
Descriptive statistics
Inferential statistics
Descriptive Statistics
Collect data
Present data
e.g., Survey
Summarize data
Inferential Statistics
Estimation
Hypothesis testing
Knowledge
Experience, Theory,
Literature, Inferential
Statistics
Information
Descriptive Statistics,
Use of Computers
Begin Here:
Identify the
Problem
Data
Types of Data
Data
Categorical
Numerical
Examples:
Marital Status
Are you registered to
vote?
Eye Color
(Defined categories or
groups)
Discrete
Examples:
Number of Children
Defects per hour
(Counted items)
Continuous
Examples:
Weight
Voltage
(Measured characteristics)
Measurement Levels
Differences between
measurements, true
zero exists
Ratio Data
Quantitative Data
Differences between
measurements but no
true zero
Interval Data
Ordered Categories
(rankings, order, or
scaling)
Ordinal Data
Qualitative Data
Categories (no
ordering or direction)
Nominal Data
Graphical
Presentation of Data
Graphical
Presentation of Data
(continued)
Categorical
Variables
Frequency distribution
Bar chart
Pie chart
Pareto diagram
Numerical
Variables
Line chart
Frequency distribution
Histogram and ogive
Stem-and-leaf display
Scatter plot
Introduction to
Probability Distributions
Random Variable
Represents a possible numerical value from
a random experiment
Random
Variables
Discrete
Random Variable
Continuous
Random Variable
Let X = # heads.
T
T
H
T
H
T
Probability Distribution
x Value
Probability
1/4 = .25
2/4 = .50
1/4 = .25
Probability
4 possible outcomes
.50
.25
Probability Distribution
Required Properties
P(x) 1
x
F(x 0 ) P(X x 0 )
In other words,
F(x 0 )
P(x)
x x0
Expected Value
Expected Value (or mean) of a discrete
distribution (Weighted Average)
E(x) xP(x)
x
P(x)
0
.25
.50
.25
E(X ) (x ) P(x)
2
2
(x
)
P(x)
2
(x
)
P(x)
E[g(X)] g(x)P(x)
x
E(a) a
and
Var(a) 0
b)
E(bX) bX
and
Var(bX) b
2
X
Y E(a bX)
Var(a bX)
Y E(a bX) a bX
Var(a bX) b
2
Y b X
Probability Distributions
Some Probability
Distributions
Discrete
Probability
Distributions
Continuous
Probability
Distributions
Binomial
Uniform
Geometric
Normal
Poisson
Exponential
Bernoulli Distribution
Consider only two outcomes: success or failure
Let P denote the probability of success
Let 1 P be the probability of failure
Define random variable X:
x = 1 if success, x = 0 if failure
Ex: Was the newborn child a girl?
Then the Bernoulli probability function is
Bernoulli Distribution
The mean is = P
2 E[(X )2 ] (x )2 P(x)
X
(0 P) (1 P) (1 P) P P(1 P)
2
n!
x ! (n x )!
P (1- P)
nX
P = 0.5
1 - P = (1 - 0.5) = 0.5
x = 0, 1, 2, 3, 4
Example:
Calculating a Binomial Probability
Ex: What is the probability of one success in five
observations if the probability of success is 0.1?
x = 1, n = 5, and P = 0.1
n!
P X (1 P)n X
x! (n x)!
5!
(0.1)1(1 0.1)5 1
1!(5 1)!
P(x 1)
(5)(0.1)(0.9)4
.32805
Binomial Distribution
Mean and Variance
Mean
E(x) nP
nP(1- P)
2
nP(1- P)
Where n = sample size
P = probability of success
(1 P) = probability of failure
Binomial Characteristics
Examples
nP (5)(0.1) 0.5
Mean
nP(1- P) (5)(0.1)(1 0.1)
0.6708
P(x)
.6
.4
.2
0
nP (5)(0.5) 2.5
nP(1- P) (5)(0.5)(1 0.5)
1.118
n = 5 P = 0.1
P(x)
.6
.4
.2
0
n = 5 P = 0.5
x
e
P(x)
x!
where:
x = number of successes per unit
= expected number of successes per unit
e = base of the natural logarithm system (2.71828...)
Poisson Distribution
Characteristics
Mean
E(x)
E[( X ) ]
2
where = expected number of successes per unit
e X e 0.50 (0.50)2
P( X 2)
.0758
X!
2!
P(x, y) P(X x Y y)
The marginal probabilities are
P(x) P(x, y)
y
P(y) P(x, y)
x
P(x, y)
P(y | x)
P(x)
Similarly, the conditional probability function of X, given
Y = y is:
P(x, y)
P(x | y)
P(y)
Independence
The jointly distributed random variables X and Y are
said to be independent if and only if their joint probability
function is the product of their marginal probability
functions:
P(x, y) P(x)P(y)
for all possible pairs of values x and y
Covariance
Let X and Y be discrete random variables with means
X and Y
An equivalent expression is
Correlation
The correlation between X and Y is:
Cov(X, Y)
Corr(X, Y)
X Y
= 0 no linear relationship between X and Y
> 0 positive linear relationship between X and Y
when X is high (low) then Y is likely to be high (low)
= +1 perfect positive linear dependency
Portfolio Analysis
Let random variable X be the price for stock A
Let random variable Y be the price for stock B
The market value, W, for the portfolio is given by the
linear function
W aX bY
(a is the number of shares of stock A,
b is the number of shares of stock B)
Portfolio Analysis
(continued)
2W a2 2X b2 2Y 2abCov(X, Y)
or using the correlation formula
2W a2 2X b2 2Y 2abCorr(X,Y) X Y
P(xiyi)
Economic condition
Investment
Passive Fund X Aggressive Fund Y
.2
Recession
- $ 25
- $200
.5
Stable Economy
+ 50
+ 60
.3
Expanding Economy
+ 100
+ 350
Economic condition
Investment
Passive Fund X Aggressive Fund Y
0.2
Recession
- $ 25
- $200
0.5
Stable Economy
+ 50
+ 60
0.3
Expanding Economy
+ 100
+ 350
Economic condition
Investment
Passive Fund X Aggressive Fund Y
.2
Recession
- $ 25
- $200
.5
Stable Economy
+ 50
+ 60
.3
Expanding Economy
+ 100
+ 350
Portfolio Example
Investment X:
Investment Y:
x = 50
x = 43.30
y = 95
y = 193.21
xy = 8250
y = 95 > x = 50
but
y = 193.21 > x = 43.30
The Covariance of 8250 indicates that the two
investments are positively related and will vary
in the same direction
F(x) P(X x)
Let a and b be two possible values of X, with
a < b. The probability that X lies between a
and b is
F(x 0 )
x0
f(x)dx
xm
Probability as an Area
Shaded area under the curve is the
probability that X is between a and b
f(x)
P (a x b )
= P (a < x < b )
(Note that the
probability of any
individual value is zero)
X E(X)
2X E[(X X )2 ]
f(x)
Total area under the
uniform probability
density function is 1.0
xmin
xmax x
f(x) =
1
if a x b
ba
0
otherwise
where
f(x) = value of the density function at any x value
a = minimum value of x
b = maximum value of x
ab
2
The variance is
2
(b
a)
2
12
.25
(b - a)2 (6 - 2)2
1.333
12
12
2
ab 26
4
2
2
W E(a bX) a bX
the variance is
Var(a bX) b
2
W
W b X
2
X
X X
Z
X
which has a mean 0 and variance 1
Bell Shaped
Symmetrical
f(x)
Mean, Median and Mode
are Equal
Location is determined by the
mean,
Mean
= Median
= Mode
Changing increases
or decreases the
spread.
X ~ N(, 2 )
1
(x )2 /2 2
f(x)
e
2
Where
F(x 0 ) P(X x 0 )
f(x)
P(X x 0 )
x0
F(b) P(X b)
a
F(a) P(X a)
Z ~ N(0,1)
1
0
X
Z
Example
X 200 100
Z
2.0
50
100
0
200
2.0
X
Z
( = 100, = 50)
( = 0, = 1)
b a
F
F
f(x)
a
a
Probability as
Area Under the Curve
The total area under the curve is 1.0, and the curve is
symmetric, so half is above the mean, half is below
f(X) P( X ) 0.5
0.5
P( X ) 0.5
0.5
P( X ) 1.0
.9772
Example:
P(Z < 2.00) = .9772
0
2.00
Example:
P(Z < -2.00) = 1 0.9772
= 0.0228
2.00
.9772
.0228
-2.00
X
8.0
8.6
0.12
5.0
=8
= 10
8 8.6
=0
=1
0 0.12
F(z)
.10
.5398
.11
.5438
.12
.5478
.13
.5517
0.00
0.12
X
8.0
8.6
0.5478
1.000
1.0 - 0.5478
= 0.4522
Z
0
0.12
Z
0
0.12
X Z
(continued)
Example:
Suppose X is normal with mean 8.0 and
standard deviation 5.0.
Now find the X value so that only 20% of all
values are below this X
.2000
?
?
8.0
0
X
Z
F(z)
.82
.7939
.83
.7967
.84
.7995
.85
.8023
?
8.0
-0.84 0
X
Z
X Z
8.0 ( 0.84)5.0
3.80
So 20% of the values from a distribution
with mean 8.0 and standard deviation
5.0 are less than 3.80
Assessing Normality
Not all continuous random variables are
normally distributed
0
Data
Left-Skewed
Right-Skewed
100
Percent
Percent
100
Data
0
Data
Uniform
Nonlinear plots
indicate a deviation
from normality
Percent
100
0
Data
Random variable X:
Xi =1 if the ith trial is success
Xi =0 if the ith trial is failure
E(X) nP
Var(X) nP(1- P)
2
X E(X)
X np
Z
Var(X)
nP(1 P)
If nP(1 - P) > 9,
a nP
nP
P(a X b) P
Z
nP(1
P)
nP(1
P)
76 80
80 80
P(76 X 80) P
Z
200(0.4)(1 0.4)
200(0.4)(1 0.4)
P( 0.58 Z 0)
F(0) F( 0.58)
0.5000 0.2810 0.2190
f(t) e
for t 0
Where
is the mean number of occurrences per unit time
t is the number of time units until the next occurrence
e = 2.71828
F(t) 1 e
where
Exponential Distribution
Example
Example: Customers arrive at the service counter at
the rate of 15 per hour. What is the probability that the
arrival time between consecutive customers is less
than three minutes?
Covariance
Let X and Y be continuous random variables, with
means x and y
The expected value of (X - x)(Y - y) is called the
covariance between X and Y
Cov(X, Y) E(XY) xy
If the random variables X and Y are independent, then the
covariance between them is 0.
Correlation
Let X and Y be jointly distributed random variables.
The correlation between X and Y is
Cov(X, Y)
Corr(X, Y)
X Y
E(X1 X2 Xk ) 1 2 k
Var(X1 X2 Xk ) 12 22 k2
Var(X 1 X2 Xk ) 12 22 k2 2 Cov(X i , X j )
i1 ji1
E(X Y) X Y
Var(X Y) 2X 2Y
Var(X Y) 2X 2Y 2Cov(X, Y)
Linear Combinations of
Random Variables
A linear combination of two random variables, X and Y,
(where a and b are constants) is
W aX bY
The mean of W is
Linear Combinations of
Random Variables
(continued)
The variance of W is
2W a2 2X b2 2Y 2abCov(X, Y)
Or using the correlation,
2W a2 2X b2 2Y 2abCorr(X,Y) X Y
If both X and Y are joint normally distributed random
variables then the linear combination, W, is also
normally distributed
Example
X = minutes to complete task 1; x = 20, x = 5
Y = minutes to complete task 2; y = 30, y = 8
What are the mean and standard deviation for the time to complete
both tasks?
W X Y
W X Y 20 30 50
Since X and Y are independent, Cov(X,Y) = 0, so
W 89 9.434