Probability & Stats Course Guide
Probability & Stats Course Guide
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Text book and Reference Books
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Course Objectives
No Course objectives
CO1 Study of descriptive statistics.
CO2 Study of the fundamentals of probability and probability
distributions.
CO3 Applications of statistics. Sampling theory and statistical
inference. Correlation and Regression analysis.
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Evaluation Scheme:
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
GOAL
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Input:
1. Collection of data
2. Processing of data
3. Analysis of data
4. Interpretation of the data
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Further Study leads to
Decision support system
Set Theory Operations Research
Permutations and Combinations
Basic Statistics
Statistical Inferences -
Hypothesis. Testing
Decision Support
Correlation and Regression
Systems
BITS Pilani, Pilani Campus
Chapters 1 and 2
• Introduction
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
CH1.2 = Need for statistics and its Applications
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
FOR MAKING DECISIONS
OR
CHOOSING ACTIONS
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Modern Statistics ( Games of Chance)
1. Descriptive Statistics
2. Statistical inference
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Statistics and Engineering
IMPACT OF STATISTICS CHANGES THE GLOBAL DYNAMICS
IN MANY FIELDS.
INDUSTIRAL MANAGEMENT
PRODUCTION MANAGEMENT
MAN POWER
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Problem: 1.5 ( page 10, ch.1)
Example : For hard drives to operate properly, the distance
between read/write head and the disk must remain
between tight limits. From each hours production 40 drives
are selected and the distance is measured.
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Sources of data :
1. Conducting surveys.
2. Conducting Experiments.
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Compact way of representation of collected data: (Overview)
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
CH1.4 = Frequency distribution of grouped data
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Frequency Distribution: It is a table that divides a set of data
into suitable number of classes (categories) showing also
the number of items belongs to each class.
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Cumulative distribution : sum of the Less than or equal to a
particular class.
29 44 12 53 21 34 39 25 48 23 Class frequency: Number
of observations in each
17 24 27 32 34 15 42 21 28 37
class.
Class Interval Frequency CF
. 10-19 3 3
Class mark : Mid point of
20-29 8 11 the class interval
30-39 5 16
40-49 3 19 Class interval : Successive
50-59 1 20 class marks
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
CH1.5= Central tendency and Dispersion
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Descriptive Measures
Numerical measure of collected data sets : Observation of
data variation
x1 x2 ...... xn
Mean = x
n
Median :
Order n data points in ascending order
n 1
n is odd : median = 2 position in the data
n n 2
and
n is even : average of two observations 2 2
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Deviations from the mean : xi x
Sample variance : s
2
i n
x x
i
2
i 1 n 1
Standard deviation :
s
x x
i
2
Same unit as the
n 1
observation
( s, S2 are absolute variation)
s
Coefficient of Variation (relative variation): * 100%
x
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Quartiles :
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Descriptive Measures
i k
xii n x f i i
x ,x i 1
i 1 n n
2 2
i n
i k
i n
xi i k
f i xi
i 1 f i x 2 i i 1
x 2
i
n
n
s 2 i 1 , S2 i 1
n 1 n 1
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
PROBLEM 2.39-2.40 Page : 37
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Solution
i n
xi
1. Mean = x 8
i 1 n
2. Median : Arrange the data in ascending order take the middle term
value which is ‘9’.
(1 2 2 3 5 6 8 9 9 10 10 10 13 15 17)
2
i n
xi
i n
s2
x x
i
2
(10 8) 2
(1 8) 2
... (15 8) 2
328
i n
x 2 i i 1
n
n 1 14 14 s 2 i 1 4.84
i 1 n 1
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
ANY DOUBTS
PROBABILITY
THANK YOU
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Course Number: AAOC ZC111 Course
Title : Probability and Statistics
Instructor: Dr. K VENKATA RATNAM
BITS-PILANI HYDERABAD CAMPUS
BITS Pilani
Hyderabad Campus
BITS Pilani
Hyderabad Campus
Probability
Counting
Probability
Axioms of Probability
Theorems of Probability
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
RL1.1.1= Sample spaces and events
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Definitions
Experiment : A simple process – output oriented.
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
RL1.1.2 = Counting and probability
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Definitions
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Definitions
Probability measure uses counting principles.
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Definitions
2. P(S)=1
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
RL 1.2.2= Theorems on Probability
1. Prove that probability of impossible event is 0.
Proof :
Let S be the sample space and 𝜙 be any impossible event, these are
mutually exclusive , then
SU 𝜙=S, P(SU 𝜙)=P(S) implies P(𝜙)=0 by axiom 3.
Let S be the sample space and A be any event, then A and A’ are are
mutually exclusive.
AU A’=S, P(AU A’)=P(S) implies P(A’)=P(S)-P(A)=1-(A) by axiom 3.
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Theorem: If 𝐴1 , 𝐴2 , … , 𝐴𝑛 are mutually exclusive
events in a sample space S, then
P A1 A2 ... An
P A1 P A2 ... P ( An )
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Theorem: If A is an event in the finite sample space S,
then P(A) equals the sum of the probabilities of the
individual outcomes comprising A.
Proof: Suppose 𝐸1 , 𝐸2 , … , 𝐸𝑛 be the n outcomes
comprising event A. Now, we have
𝐴 = 𝐸1 ∪ 𝐸2 ∪ ⋯ ∪ 𝐸𝑛
As, E’s are individual outcomes and mutually
exclusive, therefore
𝑃(𝐴) = 𝑃(𝐸1 ) ∪ 𝑃(𝐸2 ) ∪ ⋯ ∪ 𝑃(𝐸𝑛 ) = 𝑃(𝐸1 ) + 𝑃(𝐸2 ) + ⋯ + 𝑃(𝐸𝑛 )
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
General addition rule for probability
A B
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Proof:
P( A B) P( A B) P( A B) P( A B)
[ P( A B) P( A B)] [ P( A B) P( A B)] P( A B)
P( A) P( B) P( A B)
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Problems
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Problem 3.17: Counting
principle
Solution : 6X4X3
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Problems : 3.20, 3.24
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Combinations : Problem 3.25
A carton of 12 rechargeable batteries contains one that is
defective. In how many ways can an inspector choose 3 of the
batteries and
a) Get the one that is defective
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Probability Problems : 3.39
Page : 65
1. Prove that 𝑃 𝐴 ∩ 𝐵 ≤ 𝑃 𝐴 𝑎𝑛𝑑 𝑃(𝐴𝑈𝐵) ≥ 𝑃(𝐴).
A B
A𝐵ത AB ҧ
𝐴B
Solution :
ത
𝑃 𝐴 = 𝑃(𝐴 ∩ 𝐵)+𝑃 ത
𝐴 ∩ 𝐵 implies 𝑃 𝐴 ∩ 𝐵 = 𝑃 𝐴 − 𝑃(𝐴 ∩ 𝐵)
𝑃 𝐴∩𝐵 ≤𝑃 𝐴
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Solution
𝑃 𝐴∪𝐵 =𝑃 𝐴 +𝑃 𝐵 −𝑃 𝐴∩𝐵
𝑃 𝐵 = 𝑃 𝐴ҧ ∩ 𝐵 + 𝑃 𝐴 ∩ 𝐵
𝑃 𝐴 ∪ 𝐵 = 𝑃 𝐴 + 𝑃 𝐴ҧ ∩ 𝐵 which implies
𝑃(𝐴𝑈𝐵) ≥ 𝑃(𝐴).
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Problem 3.47
The probability that a new airport will get an award for its
design is 0.16, the probability that it will get an award for
the efficient use of materials is 0.24 and the probability
that it will get both awards is 0.11.
b) What is the probability that it will get only one of the two
awards
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Solution: Let A be the event that it will get an award for its
design, 𝑃 𝐴 = 0.16.
Let B be the event that it will get award for efficient use of
material, 𝑃 𝐵 = 0.24.
Now, 𝑃 𝐴 ∩ 𝐵 = 0.11
(a) 𝑃 𝐴 ∪ 𝐵 = 𝑃 𝐴 + 𝑃 𝐵 − 𝑃 𝐴 ∩ 𝐵 = 0.29
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Solution
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Any questions…….
Thank you
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Course Number: PERL ZC113
Course Title : Probability and Statistics
Instructor: Dr. K VENKATA RATNAM
BITS-PILANI HYDERABAD CAMPUS
BITS Pilani
Hyderabad Campus
BITS Pilani
Hyderabad Campus
Contact Hour(CH):3
Problems
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Problem 3.17: Counting
principle
In an optics kit there are 6 concave lenses, 4 convex lenses and 3
prisms. In how many ways can one choose one of the concave
lenses, one of the convex lenses and one of the prisms.
Solution : 6X4X3
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Problems : 3.20
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Problem : 3.24
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Combinations : Problem 3.25
A carton of 12 rechargeable batteries contains one that is
defective. In how many ways can an inspector choose 3 of the
batteries and
a) Get the one that is defective
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Probability Problems : 3.39
Page : 65
1. Prove that 𝑃 𝐴 ∩ 𝐵 ≤ 𝑃 𝐴 𝑎𝑛𝑑 𝑃(𝐴𝑈𝐵) ≥ 𝑃(𝐴).
A B
A𝐵ത AB ҧ
𝐴B
Solution :
ത
𝑃 𝐴 = 𝑃(𝐴 ∩ 𝐵)+𝑃 ത
𝐴 ∩ 𝐵 implies 𝑃 𝐴 ∩ 𝐵 = 𝑃 𝐴 − 𝑃(𝐴 ∩ 𝐵)
𝑃 𝐴∩𝐵 ≤𝑃 𝐴
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Solution
𝑃 𝐴∪𝐵 =𝑃 𝐴 +𝑃 𝐵 −𝑃 𝐴∩𝐵
𝑃 𝐵 = 𝑃 𝐴ҧ ∩ 𝐵 + 𝑃 𝐴 ∩ 𝐵
𝑃 𝐴 ∪ 𝐵 = 𝑃 𝐴 + 𝑃 𝐴ҧ ∩ 𝐵 which implies
𝑃(𝐴𝑈𝐵) ≥ 𝑃(𝐴).
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Problem 3.47
The probability that a new airport will get an award for its
design is 0.16, the probability that it will get an award for
the efficient use of materials is 0.24 and the probability
that it will get both awards is 0.11.
b) What is the probability that it will get only one of the two
awards
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Solution: Let A be the event that it will get an award for its
design, 𝑃 𝐴 = 0.16.
Let B be the event that it will get award for efficient use of
material, 𝑃 𝐵 = 0.24.
Now, 𝑃 𝐴 ∩ 𝐵 = 0.11
(a) 𝑃 𝐴 ∪ 𝐵 = 𝑃 𝐴 + 𝑃 𝐵 − 𝑃 𝐴 ∩ 𝐵 = 0.29
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Solution
P(AUB)= 0.06+0.03-0.02=0.07
P((AUB)’ )=1-P(AUB)=1-.07
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Problems 3.16 Page : 55 : Tree
diagram ( Home work)
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Solution
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
RL1.3.1 = Conditional Probability
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Conditional Probability
Probability of an event A given that the event B has happened,
we are talking of the probability in relation to the “reduced
sample space”.
If A, B are two events associated with a random experiment,
then we define the conditional probability of the event A given
that B has happened as
P B A
P A B if P B 0
P B
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
General Multiplication Rule for Probability
P A B P A . P B | A ; P ( A) 0
P A B P B . P A | B ; P( B) 0
Two events are called independent if
P A B P A .P B
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Problem:3.62
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Solution
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Problem:3.70
(Challenging problem)
In a certain city during the month of May, the probability that a
rainy day will be followed by another rainy day is 0.80 and the
probability that a sunny day will be followed by rainy day is
0.60.
Find the probability that in the given city a rainy day in May is
followed by two more rainy days, then a sunny day, and finally
another rainy day.
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Solution
P(R1 R2 R3 S R4 / R1 )=
P(𝑹𝟏 ∩ 𝑹𝟐 ∩ 𝑹𝟑 ∩ 𝑺 ∩ 𝑹𝟒 / 𝑹𝟏 )=
P(𝑹𝟏 ∩𝑹𝟐 ∩𝑹𝟑 ∩𝑺∩𝑹𝟒 ∩𝑹𝟏 ) P(𝑹𝟏 ∩𝑹𝟐 ∩𝑹𝟑 ∩𝑺∩𝑹𝟒 )
=
𝑷(𝑹𝟏 ) 𝑷(𝑹𝟏 )
P(𝑹𝟏 )∩𝑷(𝑹𝟐 )∩𝑷(𝑹𝟑 )∩𝑷(𝑺)∩𝑷(𝑹𝟒 )
= 𝑷(𝑹𝟏 )
=0.8 * 0.8*(1-0.8)*0.6
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Independent events 3.68
P((M∩N)’)=4/5 P((M∩N)=1-4/5=1/5
𝑃 𝐴 = 𝑃 𝐵𝑖 . 𝑃(𝐴/𝐵𝑖 )
𝑖=1
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Proof
𝑆 = =𝑖𝑛ڂ1 𝐵𝑖
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Bayes' Rule
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Proof: P( A Br )
P( Br | A)
P( A)
Now, by the theorem on total probability,
P A P B1 P A B1 P B2 P A B2 ...
P Bn P A Bn
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Total theorem : 3.71
If 80% of all new workers attend the training program, what is the
probability that a new worker will meet the production
quota.
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Solution
Let M = event that work meets production quota.
P(M) = P(M | T) P(T) + P(M | T’) P(T’) = 0.86 × 0.8 + 0.35 × 0.2 = .758
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Problem:3.73
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Bayes rule 3.79 (Home work)
Engineers in charge of maintaining our nuclear fleet must continually
check for corrosion inside the pipes that are part of the cooling
systems. The inside condition of the pipes cannot be observed
directly but a nondestructive test can give an indication of possible
corrosion. This test is not infallible.
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Solution
P(D | C) P(C)
P(C | D) = by Bayes′s Rule
P(D | C′) P(C′) +P(D | C) P(C)
= (0.7) (0.1) / (0.2) (0.9)+ (0.7) (0.1) = 0.28
𝑃(𝐷′ | 𝐶) 𝑃(𝐶)
P(C | D’) =
P(D′ | C′) P(C′) +P(D′ | C) P(C)
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Bayes rule: 3.99 (Home Work)
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Solution
Let C be the event that amy comes home no later than 6 p.m.
( she arrives on or before 6 pm)
Given that p(A) =.4, P(B)1-0.4=0.6 P(C | A)= 0.8, P(C | B)=0.7
Amy arrives after 6 pm from route B is
P(B/C’)= P(C | B)*P(B) / P(C’)
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Course Number: PERL ZC113
Course Title : Probability and Statistics
Instructor: Dr. K VENKATA RATNAM
BITS-PILANI HYDERABAD CAMPUS
BITS Pilani
Hyderabad Campus
BITS Pilani
Hyderabad Campus
Contact Hour(CH): 4
Problem:3.62
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Solution
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Total probability rule
𝑃 𝐴 = 𝑃 𝐵𝑖 . 𝑃(𝐴/𝐵𝑖 )
𝑖=1
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Proof
𝑆 = =𝑖𝑛ڂ1 𝐵𝑖
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Bayes' Rule
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Proof: P( A Br )
P( Br | A)
P( A)
Now, by the theorem on total probability,
P A P B1 P A B1 P B2 P A B2 ...
P Bn P A Bn
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Total theorem : 3.71
If 80% of all new workers attend the training program, what is the
probability that a new worker will meet the production
quota.
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Solution
Let M = event that work meets production quota.
Probability of New worker will meet the production quota= P(M) ( we use the law of total probability)
P(M) = P(M | T) P(T) + P(M | T’) P(T’) = 0.86 × 0.8 + 0.35 × 0.2 = .758
We need to find P(T | M) = probability that the worker has attended training program
given he/she met quota. (Bayes theorem )
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Bayes rule: 3.99 (Home Work)
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Solution
Let C be the event that amy comes home no later than 6 p.m.
( she arrives on or before 6 pm)
Given that p(A) =.4, P(B)1-0.4=0.6 P(C | A)= 0.8, P(C | B)=0.7
Amy arrives after 6 pm from route B is
P(B/C’)= P(C | B)*P(B) / P(C’)
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Problem:3.73(Home work)
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Bayes rule 3.79 (Home work)
Engineers in charge of maintaining our nuclear fleet must continually
check for corrosion inside the pipes that are part of the cooling
systems. The inside condition of the pipes cannot be observed
directly but a nondestructive test can give an indication of possible
corrosion. This test is not infallible.
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Solution
P(D | C) P(C)
P(C | D) = by Bayes′s Rule
P(D | C′) P(C′) +P(D | C) P(C)
= (0.7) (0.1) / (0.2) (0.9)+ (0.7) (0.1) = 0.28
𝑃(𝐷′ | 𝐶) 𝑃(𝐶)
P(C | D’) =
P(D′ | C′) P(C′) +P(D′ | C) P(C)
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Chapter-4
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Definitions
Classification :
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Definitions
f(x)= P[X=x]
𝑓 𝑥 ≥ 0, 𝑎𝑛𝑑 𝑓 𝑥 = 1
∀𝑥
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Definitions
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Problems: 4.5
𝑘
Given that 𝑓 𝑥 = is a probability distribution for a random
2𝑥
variable that can take on the values x=0,1,2,3 and 4, find k,
also find an expression for the distribution function F(x) of the
random variable.
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Solution
Step1 :
Probability Distribution : (x, P(x))
Step 2: Use discrete density property to find k: σ∀𝑥 𝑓 𝑥 = 1
Step 3: Find the CDF of the given pdf.
𝑘 𝑘 𝑘 𝑘 31𝑘
𝑘 + + + + = 1implies = 1 implies k=16/31
2 4 8 16 16
1
𝑥+1 −1
𝑘 16 (2)
CDF:𝐹 𝑥 = 𝑃 𝑋 ≤ 𝑥 =σ𝑥𝑖=0 𝑃 𝑥 = 𝑥
= σ𝑖=0 𝑥 =
2 31 1 −1
2
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
RL 2.2.1 :Bernoulli Trials
– Success or failure
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
RL 2.2.2 :Binomial Distribution
(sampling with replacement)
X is a random variable that equals the number of success in n
trails.
𝑏 𝑥; 𝑛, 𝑝 = 1 − 𝐵(𝑛 − 𝑥 − 1; 𝑛, 1 − 𝑝)
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Problem :4.19
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Solution
a) x=18, P(x=18)= 18
18 𝐶(0.9)18 (0.1)0 = (0.9)18
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
RL 2.2.3 = Hypergeometric
Properties
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Hypergeometric distribution
(Sampling without replacement)
A random variable X has a hypergeometric distribution with
parameters N, n and a if its density is given by
𝑎𝐶 𝑋 𝑁−𝑎
𝑥 𝑛−𝑥𝐶
ℎ 𝑥; 𝑛, 𝑎, 𝑁 = 𝑁𝐶 ,
𝑛
𝑓𝑜𝑟 𝑥 = 0,1,2, … , 𝑛.
Four emergency radios are available for rescue workers but one
does not work properly. Two randomly selected radios are
taken on a rescue mission. Lex X be the number that work
properly between the two.
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Solution:
𝑎𝐶 𝑋 𝑁−𝑎
𝑥 𝑛−𝑥𝐶
Formula : ℎ 𝑥; 𝑛, 𝑎, 𝑁 = 𝑁𝐶 , 𝑓𝑜𝑟 𝑥 = 0,1,2, … , 𝑛.
𝑛
3 4−3𝐶
𝑥𝐶 𝑋 2−𝑥
P((X=x)=ℎ 𝑥; 2,3,4 = 4𝐶 ,
2
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Probability distribution : Density function P(x)
X=x X=1 X=2
P(x) 0.5 0.5
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Problem: 4.26
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Solution:
𝑎𝐶 𝑋 𝑁−𝑎
𝑥 𝑛−𝑥𝐶
Formula : ℎ 𝑥; 𝑛, 𝑎, 𝑁 = 𝑁𝐶 ,
𝑛
𝑓𝑜𝑟 𝑥 = 0,1,2, … , 𝑛.
6
𝑥𝐶 𝑋 18−6
3−𝑥𝐶
P((X=x)=ℎ 𝑥; 3,6,18 = 18𝐶 , Max[0, 3−(18−6)]≤ x ≤
3
min(3,6)]=x=0,1,2,3.
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Solution
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Problem
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Solution
5 115
Binomial distribution : Given data : n=3, p= , q= ,, x=1,
120 120
use the formula :
𝑛𝑐 𝑝 𝑥 (1 − 𝑝)𝑛−𝑥
𝑥
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Course Number: PERL ZC113
Course Title : Probability and Statistics
Instructor: Dr. K VENKATA RATNAM
BITS-PILANI HYDERABAD CAMPUS
BITS Pilani
Hyderabad Campus
BITS Pilani
Hyderabad Campus
𝑏 𝑥; 𝑛, 𝑝 = 1 − 𝐵(𝑛 − 𝑥 − 1; 𝑛, 1 − 𝑝)
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
RL 2.2.3 = Hypergeometric
Properties
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Hypergeometric distribution
(Sampling without replacement)
A random variable X has a hypergeometric distribution with
parameters N, n and a if its density is given by
𝑎𝐶 𝑋 𝑁−𝑎
𝑥 𝑛−𝑥𝐶
ℎ 𝑥; 𝑛, 𝑎, 𝑁 = 𝑁𝐶 ,
𝑛
𝑓𝑜𝑟 𝑥 = 0,1,2, … , 𝑛.
Four emergency radios are available for rescue workers but one
does not work properly. Two randomly selected radios are
taken on a rescue mission. Lex X be the number that work
properly between the two.
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Solution:
𝑎𝐶 𝑋 𝑁−𝑎
𝑥 𝑛−𝑥𝐶
Formula : ℎ 𝑥; 𝑛, 𝑎, 𝑁 = 𝑁𝐶 , 𝑓𝑜𝑟 𝑥 = 0,1,2, … , 𝑛.
𝑛
3 4−3𝐶
𝑥𝐶 𝑋 2−𝑥
P((X=x)=ℎ 𝑥; 2,3,4 = 4𝐶 ,
2
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Probability distribution : Density function P(x)
X=x X=1 X=2
P(x) 0.5 0.5
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Problem: 4.26
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Solution:
𝑎𝐶 𝑋 𝑁−𝑎
𝑥 𝑛−𝑥𝐶
Formula : ℎ 𝑥; 𝑛, 𝑎, 𝑁 = 𝑁𝐶 ,
𝑛
𝑓𝑜𝑟 𝑥 = 0,1,2, … , 𝑛.
6
𝑥𝐶 𝑋 18−6
3−𝑥𝐶
P((X=x)=ℎ 𝑥; 3,6,18 = 18𝐶 , Max[0, 3−(18−6)]≤ x ≤
3
min(3,6)]=x=0,1,2,3.
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Solution
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Problem
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Solution
5 115
Binomial distribution : Given data : n=3, p= , q= ,, x=1,
120 120
use the formula :
𝑛𝑐 𝑝 𝑥 (1 − 𝑝)𝑛−𝑥
𝑥
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Chapter- 4
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Definitions
Symmetry: Symmetry is an attribute used to describe the shape of a data distribution.
When it is graphed, a symmetric distribution can be divided at the center so that
each half is a mirror image of the other. A non-symmetric distribution cannot.
Skewness: When they are displayed graphically, some distributions of data have
many more observations on one side of the graph than the other. Distributions with
fewer observations on the right (toward higher values) are said to be skewed
right; and distributions with fewer observations on the left (toward lower values)
are said to be skewed left.
Variation: The variance is a numerical value used to indicate how widely individuals in
a group vary. If individual observations vary greatly from the group mean, the
variance is big; and vice versa.
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Mean and Variance
∀𝑥
Standard Deviation : σ = σ∀𝑥 𝑥 − 𝜇 2 𝑓 𝑥
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Example of mean and
Variance
Binomial distribution Mean : 𝜇 =n.p
𝑎
Hypergeometric Mean :𝜇 = n.
𝑁
𝑎 𝑎 𝑁−𝑛
Hypergeometric distribution variance : 𝑛 (1 − )( )
𝑁 𝑁 𝑁−1
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Problems
1
Solution : Mean = E(X)= 𝜇 = σ∀𝑥 𝑥 𝑓(𝑥)= σ𝑛𝑥=1 𝑥
𝑛
1 1 1 1 1 𝑛(𝑛+1)
=1 ∗ + 2 ∗ + ⋯ + 𝑛 ∗ = 1 + 2 + 3 + ⋯+ 𝑛 = ∗
𝑛 𝑛 𝑛 𝑛 𝑛 2
𝑛+1
=
2
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Solution:
=𝐸 𝑋 2 − 𝐸(𝑋) 2
2 1 2 1 2 1 𝑛+1 2
=1 ∗ + 2 ∗ + ⋯ + 𝑛 ∗ −
𝑛 𝑛 𝑛 2
1 𝑛+1 2 1 𝑛(𝑛+1)(2𝑛+1) 𝑛+1 2
= (12 +22 +…𝑛2 ) − = ∗ −
𝑛 2 𝑛 6 2
𝑛2 −1
=
12
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Mean of Hypergeometric
distribution
𝑛 𝑛 𝑎 𝑁−𝑎
𝑥 𝑛−𝑥
𝑀𝑒𝑎𝑛 = 𝐸 𝑥 = 𝑥 𝑓 𝑥 = 𝑥 𝑁
𝑥=0 𝑥=0 𝑛
𝑥𝑎! 𝑁−𝑎 !
𝑛 𝑎 𝑁−𝑎 𝑛 𝑋
𝑥 𝑛−𝑥
𝑎 − 𝑥 ! 𝑥! 𝑁−𝑎− 𝑛−𝑥 ! 𝑛−𝑥 !
= 𝑥 𝑁 =
𝑁!
𝑥=0 𝑛 𝑥=1
𝑁 − 𝑛 ! 𝑛!
𝑎(𝑎 − 1)! 𝑁 − 1 − (𝑎 − 1 )!
𝑛 𝑋
𝑎 − 1 − 𝑥 − 1 ! (𝑥 − 1)! 𝑁 − 1 − (𝑎 − 1) − 𝑛 − 1 − (𝑥 − 1 ! 𝑛 − 1 − (𝑥 − 1) !
=
𝑁(𝑁 − 1)!
𝑥=1
𝑁 − 1 − (𝑛 − 1) ! 𝑛 (𝑛 − 1)!
𝑎−1 𝑁−𝑎
𝑎𝑛 𝑛 𝑎𝑛
Mean = E(X)= σ𝑥=1 𝑥−1𝑁−1𝑛−𝑥 = , [ put x-1=y, then summation varies from0 to n-1]
𝑁 ( 𝑛−1 ) 𝑁
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Moments
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Problem
If 95% of certain high performance radial tires last at lest 30,000
miles, find the mean and standard deviation of the distribution
of the number of these tires among 20 selected at random that
last atleast 30,000 miles using
1) table 1, the formula which defines mean and the computing
formula for variance.
2) The special formulas for the mean and the variance of a
binomial distribution.
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Solution
𝑛
Binomial distribution : b( x; n , p)=𝑓 𝑥 = 𝑥
𝑝 𝑥 (1 − 𝑝)𝑛−𝑥
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Problem
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Solution
𝑎 𝑁−𝑎
𝑥 𝑛−𝑥
ℎ 𝑥; 𝑛, 𝑎, 𝑁 = 𝑓(𝑥) = 𝑁
𝑛
Table : x 0 1 2 3
f(x) 4/56 24/56 24/56 4/56
Mean = 𝜇 = 𝐸 𝑋 =
4 24 24
σ 𝑥𝑓 𝑥 = 0 ∗ + 1 ∗ + 2 ∗ + 3 ∗ 4/56=1.5
56 56 56
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
RL2.3.3 = Chebyshev's theorem
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Chebyshev’s theorem
1
𝑃( 𝑥 − 𝜇 ≥ 𝑘𝜎) ≤
𝑘2
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Chebyshev’s theorem
Breaking real line into 3 parts :
i ) (-,( μ-k ) ] ii ) [( μ-k ), ( μ k )] iii ) [( μ k ) , )
Making use of the definition of Variance :
V (X ) 2
( x ) 2 f ( x)
( μ-k ) ( μ k )
(x )
2
f ( x) ( x ) 2
f ( x) (x )
2
f ( x)
( μ-k ) ( μ k )
In Region i ) : x k ( x ) 2 k 2 2
In Region iii ) : x k ( x ) 2 k 2 2
( μ k )
2
k P ( X k )
2 2
( x )
( μ-k )
2
f ( x ) k 2 2 P ( X k )
2 k 2 2 P ( X k ) k 2 2 P ( X k )
k 2 2 1 P ( k X k )
2
2 2 2 1 P ( k X k ) P ( k X k ) 1 2
1 1
k k k
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Problem
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Solution
1
By Chebyshev’s theorem we have 𝑃 𝑥 − 𝜇 ≥ 𝑘𝜎 ≤ −− −1
𝑘2
K=3.
1 1 8
Required probability is 𝑃 𝑥 − 𝜇 ≤ 0.006 ≥ 1 − =1− =
𝑘2 32 9
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Problem
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Solution
Given information is the product is meet the requirement or not
meet the requirement ----- Binomial distribution;
1
By Chebyshev’s theorem we have 𝑃 𝑥 − 𝜇 ≥ 𝑘𝜎 ≤
𝑘2
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
Solution
1
𝑃 𝑥 − 67.5 ≥ 𝑘 ∗ 7.5 ≤ 2
𝑘
Course Number: AAOC ZC111, Course Title : Probability and Statistics , Dr. KVR , BITS Pilani, Hyderabad Campus
1
6
7
/
2
5
Lecture - 06
Course Number: AAOC ZC111
[email protected]
Outline
Chebyshev’s Theorem
Poisson Processes
Geometric Distribution
Simulation
Chebyshev’s TheoremThe Poisson DistributionPoisson ProcessesGeometric DistributionSimulation
Theorem
Chebyshev’s Theorem
If a probability distribution has mean µ and standard deviation σ, the
probability of getting a value which deviates from µ by at least kσ is at
most k12
• The above theorem gives bounds on the probability of getting a
value that deviates from mean
3/25
Chebyshev’s TheoremThe Poisson DistributionPoisson ProcessesGeometric DistributionSimulation
Theorem
Chebyshev’s Theorem
If a probability distribution has mean µ and standard deviation σ, the
probability of getting a value which deviates from µ by at least kσ is at
most 1
• k2
• The above theorem gives bounds on the probability of getting a value that de
• Mathematically, it can be written as
P(|X − µ| ≥ kσ) ≤ 2
1
k
3/25
Chebyshev’s TheoremThe Poisson DistributionPoisson ProcessesGeometric DistributionSimulation
Theorem
Chebyshev’s Theorem
If a probability distribution has mean µ and standard deviation σ, the
probability of getting a value which deviates from µ by at least kσ is at
most 1
• k2
• The above theorem gives bounds on the probability of getting a value that de
• Mathematically, it can be written as
P(|X − µ| ≥ kσ) ≤ 2
1
k
Chebyshev’s Theorem
Example
The number of customers who visit a car dealer’s showroom on a Sunday
morning is a random variable with µ = 18 and σ = 2.5. What is the
probability that there will be more than 8 but fewer than 28 customers ?
4/25
Chebyshev’s TheoremThe Poisson DistributionPoisson ProcessesGeometric DistributionSimulation
Chebyshev’s Theorem
Example
The number of customers who visit a car dealer’s showroom on a Sunday
morning is a random variable with µ = 18 and σ = 2.5. What is the
probability that there will be more than 8 but fewer than 28 customers ?
Example
On a multiple choice test given to 200 psychology students the TA notes
a class average of 75 percent and a standard deviation of 2.0 percent.
Based on Chebyshev’s rule find the minimum number of students who
could have received marks between 70 and 80.
4/25
Chebyshev’s TheoremThe Poisson DistributionPoisson ProcessesGeometric DistributionSimulation
5/25
Chebyshev’s TheoremThe Poisson DistributionPoisson ProcessesGeometric DistributionSimulation
5/25
Chebyshev’s TheoremThe Poisson DistributionPoisson ProcessesGeometric DistributionSimulation
λ x e− λ
P( X = x) = f (x; λ) =
x!
• x is the number of successes in the given interval
• Events that are rather rare and don’t happen that often follow a
Poisson distribution
10/25
1 Chebyshev’s TheoremThe Poisson DistributionPoisson ProcessesGeometric DistributionSimulation
1
/
2
5
Example
It is known that 5% of the books bound at a certain bindery have
defective bindings. Find the probability that 2 of 200 books bound by
this bindery will have defective bindings.
1 Chebyshev’s TheoremThe Poisson DistributionPoisson ProcessesGeometric DistributionSimulation
2
/
2
5
Poisson
• Processes
The Poisson process
in probability theory
is one of the most important random processes
Poisson Processes
Then the probability of x successes during the time interval T is given by
the binomial probability b(x; n, p) with
T
n= and p = α ∆ t
∆t
• When n → ∞ the probability of x successes during the interval T is
given by Poisson probability with the parameter λ, given by
T
λ = np = α ∆ t = αT
∆t
Example
Suppose if a bank receives on the average 6 bad cheques per day.
What are the possibilities that it will receive
Geometric Distribution
Consider a sequence of
• Function
Bernoulli trials. We are interested in the
number of the trial at which the first success occurs.
• We want to find the probability of getting the first success on the
x th trial
• It is clear that we have failures in x − 1 trials
• Let p be the probability of a success
• Then the probability of failure is p − 1
• The probability of x − 1 failures in x − 1 trials is (1 − p) (x−1).
• Then the probability of getting the first success on the x th trial is
given by
g(x; p) = p(1 − p) (x−1), x = 1, 2, 3, . . .
Example
Example
Problems: Geometric Dist
Let X be a geometric random variable with p = 0.25. What is the
probability that X = 4 (that is the first success occurs on the fourth
trial) ?
20/25
Chebyshev’s TheoremThe Poisson DistributionPoisson ProcessesGeometric DistributionSimulation
Example
Example
Problems: Geometric Dist
Let X be a geometric random variable with p = 0.25. What is the
probability that X = 4 (that is the first success occurs on the fourth
trial) ?
Example
Products produced by a machine has a 3% defective rate.
• What is the probability that the first defective occurs in the fifth
item inspected ?
• What is the probability that the first defective occurs in the first five
inspections ?
20/25
Chebyshev’s TheoremThe Poisson DistributionPoisson ProcessesGeometric DistributionSimulation
21/25
Chebyshev’s TheoremThe Poisson DistributionPoisson ProcessesGeometric DistributionSimulation
Example
I am new to basketball and so I am practising to shoot the ball through
the basket. If the probability of success at each throw is 0.2, how many
times would I fail on average before a success occurs.
21/25
2 Chebyshev’s TheoremThe Poisson DistributionPoisson ProcessesGeometric DistributionSimulation
2
/
2
5
Example
Products are inspected until first defective is found. X is a geometric
random variable with parameter p. The first 10 trials have been found to
be free of defectives. What is the probability that the first defective will
occur in the 15th trial ?
2 Chebyshev’s TheoremThe Poisson DistributionPoisson ProcessesGeometric DistributionSimulation
3
/
2
5
Simulation
• Central to the idea of simulation is a numerical scheme
• Some times it is also referred as simulation techniques
• Typically a computer program is written to for the numerical
solution of processes
• The program is executed on
laptop/desktop/workstation/cluster/supercomputer
• Over the decades a large number of numerical schemes have been
developed and applied to a large number of problems in several
streams of Engineering and Sciences
2 Chebyshev’s TheoremThe Poisson DistributionPoisson ProcessesGeometric DistributionSimulation
5
/
2
5
Simulation
• A numerical scheme that is used to simulate processes that involve
an element of chance is of particular interest to us
• Such schemes are called as Monte Carlo Methods
• Example: Monte Carlo methods are used to determine the value of π
• These methods are used to measure the risk in quantitative analysis
and decision making
• Widely used in the fields of finance, project management, energy,
manufacturing, insurance, oil & gas exploration, transportation, etc
1Geometric DistributionSimulationContinuous Random VariableProbability Density FunctionCumulative Distribution FunctionMean
9
9
/
2
7
Lecture - 07
Course Number: AAOC ZC111
[email protected]
Outline
Geometric Distribution
Simulation
Example
Example
Problems: Geometric Dist
Let X be a geometric random variable with p = 0.25. What is the
probability that X = 4 (that is the first success occurs on the fourth
trial) ?
6/27
Geometric DistributionSimulationContinuous Random VariableProbability Density FunctionCumulative Distribution FunctionMean
Example
Example
Problems: Geometric Dist
Let X be a geometric random variable with p = 0.25. What is the
probability that X = 4 (that is the first success occurs on the fourth
trial) ?
Example
Products produced by a machine has a 3% defective rate.
• What is the probability that the first defective occurs in the fifth
item inspected ?
• What is the probability that the first defective occurs in the first five
inspections ?
6/27
Geometric DistributionSimulationContinuous Random VariableProbability Density FunctionCumulative Distribution FunctionMean
7/27
Geometric DistributionSimulationContinuous Random VariableProbability Density FunctionCumulative Distribution FunctionMean
Example
I am new to basketball and so I am practising to shoot the ball through
the basket. If the probability of success at each throw is 0.2, how many
times would I fail on average before a success occurs.
7/27
8Geometric DistributionSimulationContinuous Random VariableProbability Density FunctionCumulative Distribution FunctionMean
/
2
7
Example
Products are inspected until first defective is found. X is a geometric
random variable with parameter p. The first 10 trials have been found to
be free of defectives. What is the probability that the first defective will
occur in the 15th trial ?
9Geometric DistributionSimulationContinuous Random VariableProbability Density FunctionCumulative Distribution FunctionMean
/
2
7
Simulation
10/27
1 Geometric DistributionSimulationContinuous Random VariableProbability Density FunctionCumulative Distribution FunctionMean
1
/
2
7
Simulation
• A numerical scheme that is used to simulate processes that involve
an element of chance is of particular interest to us
• Such schemes are called as Monte Carlo Methods
• Example: Monte Carlo methods are used to determine the value of π
• These methods are used to measure the risk in quantitative analysis
and decision making
• Widely used in the fields of finance, project management, energy,
manufacturing, insurance, oil & gas exploration, transportation, etc
1 Geometric DistributionSimulationContinuous Random VariableProbability Density FunctionCumulative Distribution FunctionMean
2
/
2
7
13/27
Geometric DistributionSimulationContinuous Random VariableProbability Density FunctionCumulative Distribution FunctionMean
13/27
Geometric DistributionSimulationContinuous Random VariableProbability Density FunctionCumulative Distribution FunctionMean
13/27
Geometric DistributionSimulationContinuous Random VariableProbability Density FunctionCumulative Distribution FunctionMean
13/27
1 Geometric DistributionSimulationContinuous Random VariableProbability Density FunctionCumulative Distribution FunctionMean
4
/
2
7
Definition
Continuous Density Function
Let X be a continuous random variable. Then the probability distribution
function of X is a function f (x) such that for any two numbers a and b
with a ≤ b, we have
b
¸
P(a ≤ X ≤ b) = f (x)dx
a
Definition
Continuous Density Function
Let X be a continuous random variable. Then the probability distribution
function of X is a function f (x) such that for any two numbers a and b
with a ≤ b, we have
b
¸
P(a ≤ X ≤ b) = f (x)dx
a
• The above definite integral gives the area under the entire graph of
f (x)
1 Geometric DistributionSimulationContinuous Random VariableProbability Density FunctionCumulative Distribution FunctionMean
7
/
2
7
Definition
Cumulative Distribution Function
The cumulative distribution function cdf F (x) for a continuous random
variable X is defined for every number x by
x
¸
F (x) = P(X ≤ x) = f (s)ds
−∞
Example Problems
Example
If a random variable has the probability density given by
.
2e− 2x , x > 0
f (x) =
0, x ≤0
Example Problems
Example
If a random variable has the probability density given by
.
2e− 2x , x > 0
f (x) =
0, x ≤0
Example Problems
Example
The probability of a random variable taking values between −∞ and ∞ is
given as 1. For the given probability density function f (x), find the
value of k. .
0, x ≤0
f (x) = 2
kxe −4x , x > 0
2 Geometric DistributionSimulationContinuous Random VariableProbability Density FunctionCumulative Distribution FunctionMean
5
/
2
7
Example Problems
Example
In a certain city, the daily consumption of electric power is a random
variable having the probability density
.
1 − x3 ,
9 xe x >0
f (x) =
0, x ≤0
Example Problems
Example
The phase error in a tracking device has probability density given by
.
cos(x), 0 < x < π2
f (x) =
0, elsewhere
• Greater than π
4
Continuous Random Variables and Properties Uniform Distribution Exponential Distribution Gamma Distribution
Lecture - 08
Course Number: AAOC ZC111
[email protected]
February 5, 2017
1 /41
Continuous Random Variables and Properties Uniform Distribution Exponential Distribution Gamma Distribution
Outline
Uniform Distribution
Exponential Distribution
Gamma Distribution
2 /41
Continuous Random Variables and Properties Uniform Distribution Exponential Distribution Gamma Distribution
Definition
A random variable X is said to be continuous if its set of possible values
is infinite and uncountable.
• That is the range of a continuous random variable is infinite
• This implies that the continuous random variable can assume any
value in an interval (or in a collection of intervals) on the real line
• For example, if we consider the range of X as [a, b], then X can
take any value between a and b. That is a ≤ x ≤ b
• On the contrary, for a discrete random variable, the range is a finite
and countable set
3 /41
Continuous Random Variables and Properties Uniform Distribution Exponential Distribution Gamma Distribution
4 /41
Continuous Random Variables and Properties Uniform Distribution Exponential Distribution Gamma Distribution
4 /41
Continuous Random Variables and Properties Uniform Distribution Exponential Distribution Gamma Distribution
4 /41
Continuous Random Variables and Properties Uniform Distribution Exponential Distribution Gamma Distribution
4 /41
Continuous Random Variables and Properties Uniform Distribution Exponential Distribution Gamma Distribution
Definition
Let X be a continuous random variable. Then the probability distribution
function of X is a function f (x) such that for any two numbers a and b
with a ≤ b, we have
Zb
P (a ≤ X ≤ b) = f (x)dx
a
5 /41
Continuous Random Variables and Properties Uniform Distribution Exponential Distribution Gamma Distribution
Zb
P (a ≤ X ≤ b) = f (x)dx
a
• The above definite integral gives the area under the entire graph of
f (x)
7 /41
Continuous Random Variables and Properties Uniform Distribution Exponential Distribution Gamma Distribution
Note: For any two numbers a and b with a ≤ b, we have the following
Zb
f (x)dx =P (a ≤ X ≤ b)
a
=P (a < X ≤ b)
=P (a ≤ X < b)
=P (a < X < b)
8 /41
Continuous Random Variables and Properties Uniform Distribution Exponential Distribution Gamma Distribution
Definition
The cumulative distribution function cdf F (x) for a continuous random
variable X is defined for every number x by
Zx
F (x) = P (X ≤ x) = f (s)ds
−∞
9 /41
Continuous Random Variables and Properties Uniform Distribution Exponential Distribution Gamma Distribution
Definition
The expectation or the mean of a continuous random variable X with the
probability density function f (x) is given by
Z∞
µ = xf (x)dx
−∞
11 /41
Continuous Random Variables and Properties Uniform Distribution Exponential Distribution Gamma Distribution
Definition
The nth moment of a continuous random variable X with the probability
density function f (x) is given by
Z∞
µn = xn f (x)dx
−∞
12 /41
Continuous Random Variables and Properties Uniform Distribution Exponential Distribution Gamma Distribution
Definition
The variance of a continuous random variable X with the probability
density function f (x) and mean µ is given by
Z∞ Z∞
σ 2 = (x − µ)2 f (x)dx = x2 f (x)dx − µ2
−∞ −∞
13 /41
Continuous Random Variables and Properties Uniform Distribution Exponential Distribution Gamma Distribution
Example Problems
Example
If a random variable has the probability density given by
(
2e−2x , x >0
f (x) =
0, x≤0
14 /41
Continuous Random Variables and Properties Uniform Distribution Exponential Distribution Gamma Distribution
Example Problems
Example
If a random variable has the probability density given by
(
2e−2x , x >0
f (x) =
0, x≤0
15 /41
Continuous Random Variables and Properties Uniform Distribution Exponential Distribution Gamma Distribution
Example Problems
Example
The probability of a random variable taking values between −∞ and ∞
is given as 1. For the given probability density function f (x), find the
value of k. (
0, x≤0
f (x) =
kxe−4x 2 , x > 0
16 /41
Continuous Random Variables and Properties Uniform Distribution Exponential Distribution Gamma Distribution
Example Problems
Example
In a certain city, the daily consumption of electric power is a random
variable having the probability density
(
1
xe − x3 , x >0
9
f (x) =
0, x≤0
17 /41
Continuous Random Variables and Properties Uniform Distribution Exponential Distribution Gamma Distribution
Example Problems
Example
The phase error in a tracking device has probability density given by
(
cos(x), 0 < x < π
f (x) = 2
0, elsewhere
18 /41
Continuous Random Variables and Properties Uniform Distribution Exponential Distribution Gamma Distribution
Definition
A continuous random variable X has a uniform distribution, if its
probability density function is
(
1
b−a , a≤x≤b
f (x) =
0, elsewhere
19 /41
Continuous Random Variables and Properties Uniform Distribution Exponential Distribution Gamma Distribution
Rb Rb
• P (a ≤ X ≤ b) = f (x)dx = b−a
1 dx =
a a
1
• Therefore the area under the curve f (x) and above the line
bounded by a and b is 1
• Each point in [a, b] is equally likely to be a value of X
• All intervals of equal length have equal probability of occurrence 20 /41
Continuous Random Variables and Properties Uniform Distribution Exponential Distribution Gamma Distribution
• If [c, d] ⊂ [a, b], then then probability that X lies in any subinterval
[c, d] is given by
Zd Zd
1 d−c
P (c ≤ X ≤ d) = f (x)dx = dx =
b−a b−a
c c
21 /41
Continuous Random Variables and Properties Uniform Distribution Exponential Distribution Gamma Distribution
Definition
The mean of a uniform random variable X is
Z∞ Zb
x a +b
µ = xf (x)dx = dx =
b−a 2
−∞ a
Definition
The nth moment of a random variable X with uniform probability density
function f (x) is given by
Z∞ Zb
µn = xn f (x)dx = xn 1 bn+1− bn+1
dx =
b−a n +1 b−a
−∞ a
22 /41
Continuous Random Variables and Properties Uniform Distribution Exponential Distribution Gamma Distribution
Definition
The variance of a uniform random variable X is
Z∞ Zb
1 1
σ2 = (x − µ)2 f (x)dx = (x − µ)2 dx = (b − a)2
b−a 12
−∞ a
23 /41
Continuous Random Variables and Properties Uniform Distribution Exponential Distribution Gamma Distribution
Zx 0, x<a
F (x) = f (t)dt = x−a ,
b−a
a≤x≤b
−∞ 1, x >b
Example
The current (in mA) measured in a piece of copper wire is known to
follow a uniform distribution over the interval [0, 25].
• Write down the formula for the probability density function f (x) of
the random variable X representing the current.
• Calculate the mean and variance of the distribution
• Find the cumulative distribution function F (x).
25 /41
Continuous Random Variables and Properties Uniform Distribution Exponential Distribution Gamma Distribution
Example
The thickness x of a protective coating applied to a conductor designed
to work in corrosive conditions follows a uniform distribution over the
interval [20, 40] microns.
• Find the mean, standard deviation and cumulative distribution
function of the thickness of the protective coating.
• Find also the probability that the coating is less than 35 microns
thick.
26 /41
Continuous Random Variables and Properties Uniform Distribution Exponential Distribution Gamma Distribution
Definition
The nth moment of a random variable X with exponential probability
density function f (x) is given by
Z∞ Z∞
xn f (x)dx = 1− x
µn = xn e β dx = n!β n
β
−∞ 0
28 /41
Continuous Random Variables and Properties Uniform Distribution Exponential Distribution Gamma Distribution
Definition
The variance of an exponential random variable X is
Z∞ Z∞
1
σ2 = (x − µ)2 f (x)dx = (x − µ)2 e− β dx = β 2
x
β
−∞ 0
29 /41
Continuous Random Variables and Properties Uniform Distribution Exponential Distribution Gamma Distribution
Definition
The cumulative distribution function F (x) of a random variable X with
exponential probability density function f (x) is given by
Zx (
1 − e−x/β , x ≥ 0; β > 0
F (x; β) = f (t)dt =
0, x <0
−∞
30 /41
Continuous Random Variables and Properties Uniform Distribution Exponential Distribution Gamma Distribution
Example
Let X be a random variable that gives the amount of time (in minutes) a
postal section officer spends with his/her customer. The time is known
to have an exponential distribution with the average amount of time
equal to 4 minutes.
• Find the mean, variance and standard deviation of X
• Find the probability density function
• Find the probability that a clerk spends four to five minutes with a
randomly selected customer
31 /41
Continuous Random Variables and Properties Uniform Distribution Exponential Distribution Gamma Distribution
Example
On the average, a certain computer part lasts 10 years. The length of
time the computer part lasts is exponentially distributed.
• What is the probability that a computer part lasts more than 7 years
?
• On the average, how long would 5 computer parts last if they are
used one after another ?
• What is the probability that a computer part lasts between 9 and 11
years ?
32 /41
Continuous Random Variables and Properties Uniform Distribution Exponential Distribution Gamma Distribution
Example
Suppose that the length of a phone call, in minutes is an exponential
random variable with decay parameter 1/12. If another person arrives at a
public telephone just before you, find the probability that you will have to
wait more than 5 minutes.
33 /41
Continuous Random Variables and Properties Uniform Distribution Exponential Distribution Gamma Distribution
Example
Consider the example of births at a country hospital, in which we assume
that the time between successive births, T , has an exponential
distribution with rate 1/7. What is the chance that there is a birth in the
next 10 days? 10 hours? 10 minutes?
34 /41
Continuous Random Variables and Properties Uniform Distribution Exponential Distribution Gamma Distribution
•
For an integer n, Γ(n) = (n − 1)!
√
• Γ( 12 ) = π
35 /41
Continuous Random Variables and Properties Uniform Distribution Exponential Distribution Gamma Distribution
Definition
A continuous random variable X is said to have a Gamma distribution
function if its probability density function is
(
1
β α Γ(α) x
(α−1) −x/β
e ,x ≥ 0
f (x; α, β) =
0, x < 0
36 /41
Continuous Random Variables and Properties Uniform Distribution Exponential Distribution Gamma Distribution
Definition
The mean of a random variable X with gamma pdf is given by
Z∞
µ = xf (x)dx = αβ
−∞
37 /41
Continuous Random Variables and Properties Uniform Distribution Exponential Distribution Gamma Distribution
Definition
The variance of a random variable X with gamma pdf is given by
Z∞
σ 2 = (x − µ)2 f (x)dx = αβ 2
−∞
38 /41
Continuous Random Variables and Properties Uniform Distribution Exponential Distribution Gamma Distribution
Definition
The cumulative distribution function F (x) of a random variable X with a
standard gamma distribution is given by
Zx Zx α−1 −y
y e
F (x; α) = f (t)dt = dy, x > 0 = P (X ≤ x)
Γ(α)
−∞ 0
39 /41
Continuous Random Variables and Properties Uniform Distribution Exponential Distribution Gamma Distribution
Example
Suppose the reaction time X of a randomly selected individual to a
certain stimulus has a standard gamma distribution with α = 2. What is
the probability that the reaction time is more than 4 seconds ?
40 /41
Continuous Random Variables and Properties Uniform Distribution Exponential Distribution Gamma Distribution
Example
Suppose the survival time X in weeks of a randomly selected mouse
exposed to 240 rads of gamma radiation has a gamma distribution with
α = 8 and β = 15.
• Find the mean survival time
41 /41
Gamma Distribution Normal Distribution Beta Distribution
Probability
274/ 26 & Statistics
Lecture - 10
Course Number: AAOC ZC111
[email protected]
Outline
275/ 26
Gamma Distribution
Normal Distribution
Beta Distribution
Gamma Distribution Normal Distribution Beta Distribution
Z∞
Γ(α) = xα− 1e− x dx
0
Definition
A continuous random variable X is said to have a Gamma distribution
function if its probability density function is
(
β α Γ1(α) x(α− 1) e− x /β , x ≥ 0
f (x; α, β) = 0,
x< 0
Definition
The mean of a random variable X with gamma pdf is given by
Z∞
µ= xf (x)dx = αβ
−∞
Gamma Distribution Normal Distribution Beta Distribution
Definition
The variance of a random variable X with gamma pdf is given by
Z∞
σ2 = (x − µ) 2f (x)dx = αβ2
−∞
Gamma Distribution Normal Distribution Beta Distribution
Definition
The cumulative distribution function F (x) of a random variable X with a
standard gamma distribution (β = 1) is given by
x
x Z
yα− 1e− y
F (x; α) = P (X ≤ x) = Z f (t)dt = dy, x > 0
Γ(α)
−∞ 0
Example
Suppose the reaction time X of a randomly selected individual to a
certain stimulus has a standard gamma distribution with α = 2. What is
the probability that the reaction time is more than 4 seconds ?
Gamma Distribution Normal Distribution Beta Distribution
Example
Suppose the survival time X in weeks of a randomly selected mouse
exposed to 240 rads of gamma radiation has a gamma distribution with
α = 8 and β = 15.
• Find the mean survival time
Definition
A continuous random variable X is said to have a normal distribution
with parameters µ and σ, if the probability density function (pdf) of X is
(x − µ )2
f (x; µ, σ) = √1 e
−
2σ 2 ,∞ < x < ∞
o 2π
Definition
A continuous random variable X is said to have a normal distribution
with parameters µ and σ, if the probability density function (pdf) of X is
(x − µ )2
f (x; µ, σ) = √1 e
−
2σ 2 ,∞ < x < ∞
o 2π
• Since µ and σ 2 can both vary, there are infinitely many normal
distributions
Gamma Distribution Normal Distribution Beta Distribution
Definition
A continuous random variable X is said to have a normal distribution
with parameters µ and σ, if the probability density function (pdf) of X is
(x − µ )2
f (x; µ, σ) = √1 e
−
2σ 2 ,∞ < x < ∞
o 2π
F (z) = P (Z ≤ z) = Z f (y)dy
−∞
• How to convert X to Z ?
a− µ b− µ b− µ a− µ
P (a ≤ X ≤ b) = P ≤Z ≤ = F −F
σ σ o σ
a− µ
• P (X ≤ a) = F
o
b− µ
•
P (X ≥ b) = 1 − F σ
Gamma Distribution Normal Distribution Beta Distribution
STANDARD NORMAL DISTRIBUTION: Table Values Represent AREA to the LEFT of the Z score.
Z .00 .01 .02 .03 .04 .05 .06 .07 .08 .09
-3.9 .00005 .00005 .00004 .00004 .00004 .00004 .00004 .00004 .00003 .00003
-3.8 .00007 .00007 .00007 .00006 .00006 .00006 .00006 .00005 .00005 .00005
-3.7 .00011 .00010 .00010 .00010 .00009 .00009 .00008 .00008 .00008 .00008
-3.6 .00016 .00015 .00015 .00014 .00014 .00013 .00013 .00012 .00012 .00011
-3.5 .00023 .00022 .00022 .00021 .00020 .00019 .00019 .00018 .00017 .00017
-3.4 .00034 .00032 .00031 .00030 .00029 .00028 .00027 .00026 .00025 .00024
-3.3 .00048 .00047 .00045 .00043 .00042 .00040 .00039 .00038 .00036 .00035
-3.2 .00069 .00066 .00064 .00062 .00060 .00058 .00056 .00054 .00052 .00050
-3.1 .00097 .00094 .00090 .00087 .00084 .00082 .00079 .00076 .00074 .00071
-3.0 .00135 .00131 .00126 .00122 .00118 .00114 .00111 .00107 .00104 .00100
-2.9 .00187 .00181 .00175 .00169 .00164 .00159 .00154 .00149 .00144 .00139
-2.8 .00256 .00248 .00240 .00233 .00226 .00219 .00212 .00205 .00199 .00193
-2.7 .00347 .00336 .00326 .00317 .00307 .00298 .00289 .00280 .00272 .00264
-2.6 .00466 .00453 .00440 .00427 .00415 .00402 .00391 .00379 .00368 .00357
-2.5 .00621 .00604 .00587 .00570 .00554 .00539 .00523 .00508 .00494 .00480
-2.4 .00820 .00798 .00776 .00755 .00734 .00714 .00695 .00676 .00657 .00639
-2.3 .01072 .01044 .01017 .00990 .00964 .00939 .00914 .00889 .00866 .00842
-2.2 .01390 .01355 .01321 .01287 .01255 .01222 .01191 .01160 .01130 .01101
-2.1 .01786 .01743 .01700 .01659 .01618 .01578 .01539 .01500 .01463 .01426
-2.0 .02275 .02222 .02169 .02118 .02068 .02018 .01970 .01923 .01876 .01831
-1.9 .02872 .02807 .02743 .02680 .02619 .02559 .02500 .02442 .02385 .02330 18/ 26
Gamma Distribution Normal Distribution Beta Distribution
STANDARD NORMAL DISTRIBUTION: Table Values Represent AREA to the LEFT of the Z score.
Z .00 .01 .02 .03 .04 .05 .06 .07 .08 .09
0.0 .50000 .50399 .50798 .51197 .51595 .51994 .52392 .52790 .53188 .53586
0.1 .53983 .54380 .54776 .55172 .55567 .55962 .56356 .56749 .57142 .57535
0.2 .57926 .58317 .58706 .59095 .59483 .59871 .60257 .60642 .61026 .61409
0.3 .61791 .62172 .62552 .62930 .63307 .63683 .64058 .64431 .64803 .65173
0.4 .65542 .65910 .66276 .66640 .67003 .67364 .67724 .68082 .68439 .68793
0.5 .69146 .69497 .69847 .70194 .70540 .70884 .71226 .71566 .71904 .72240
0.6 .72575 .72907 .73237 .73565 .73891 .74215 .74537 .74857 .75175 .75490
0.7 .75804 .76115 .76424 .76730 .77035 .77337 .77637 .77935 .78230 .78524
0.8 .78814 .79103 .79389 .79673 .79955 .80234 .80511 .80785 .81057 .81327
0.9 .81594 .81859 .82121 .82381 .82639 .82894 .83147 .83398 .83646 .83891
1.0 .84134 .84375 .84614 .84849 .85083 .85314 .85543 .85769 .85993 .86214
1.1 .86433 .86650 .86864 .87076 .87286 .87493 .87698 .87900 .88100 .88298
1.2 .88493 .88686 .88877 .89065 .89251 .89435 .89617 .89796 .89973 .90147
1.3 .90320 .90490 .90658 .90824 .90988 .91149 .91309 .91466 .91621 .91774
1.4 .91924 .92073 .92220 .92364 .92507 .92647 .92785 .92922 .93056 .93189
1.5 .93319 .93448 .93574 .93699 .93822 .93943 .94062 .94179 .94295 .94408
1.6 .94520 .94630 .94738 .94845 .94950 .95053 .95154 .95254 .95352 .95449
1.7 .95543 .95637 .95728 .95818 .95907 .95994 .96080 .96164 .96246 .96327
1.8 .96407 .96485 .96562 .96638 .96712 .96784 .96856 .96926 .96995 .97062
1.9 .97128 .97193 .97257 .97320 .97381 .97441 .97500 .97558 .97615 .97670
2.0 .97725 .97778 .97831 .97882 .97932 .97982 .98030 .98077 .98124 .98169 19/ 26
Gamma Distribution Normal Distribution Beta Distribution
Example
X is a normally distributed variable with mean µ = 30 and standard
deviation σ = 4.
Example
The annual salaries of employees in a large company are approximately
normally distributed with a mean of Rs. 50, 000 and a standard deviation
of Rs. 20, 000.
• What percent of people earn less than Rs. 40, 000 ?
• What percent of people earn between Rs. 45, 000 and Rs. 65, 000 ?
Example
Suppose that the height X in inches of a person is a normal random
variable with mean µ = 70 inches. If P (X > 79) = 0.025, what is the
standard deviation of this random normal variable ?
22/ 26
Gamma Distribution Normal Distribution Beta Distribution
Example
Suppose that the height X in inches of a person is a normal random
variable with mean µ = 70 inches. If P (X > 79) = 0.025, what is the
standard deviation of this random normal variable ?
Example
Suppose that the weight (X ) in pounds of a person is a normal random
variable with standard deviation σ = 20 pounds. If 5% of the population
is heavier than 214 pounds what is the mean of this distribution ?
22/ 26
Gamma Distribution Normal Distribution Beta Distribution
Example
A bag of cookies is underweight if it weighs less than 500 grams. The
filling process dispenses cookies with weight that follows the normal
distribution with mean 510 grams and standard deviation 4 grams.
• What is the probability that a randomly selected bag is underweight?
Definition
When a random variable takes values on the interval from 0 and 1, one
choice of a probability density function is the beta distribution function,
given by
( α− 1 β− 1
ΓΓ(α)Γ (β) x
(α+β) (1 − x) , 0 < x < 1, α > 0, β > 0
f (x) =
0, elsewhere
Definition
The mean of a random variable with beta distribution is given by
α
µ=
α+ β
Definition
The variance of a random variable with beta distribution is given by
αβ
σ2 =
(α + β) 2(α + β + 1)
Gamma Distribution Normal Distribution Beta Distribution
Example
In a certain county, the proportion of highway sections requiring repairs
in any given year is a random variable having the beta distribution with
α = 3 and β = 2.
• On the average, what percentage of the highway sections require
repairs in any given year ?
• Find the probability that at most half of the highway sections will
require repairs in any given year.
Gamma Distribution Normal Distribution Beta Distribution
Probability
301/ 26 & Statistics
Lecture - 10
Course Number: AAOC ZC111
[email protected]
Outline
302/ 26
Gamma Distribution
Normal Distribution
Beta Distribution
Gamma Distribution Normal Distribution Beta Distribution
Z∞
Γ(α) = xα− 1e− x dx
0
Definition
A continuous random variable X is said to have a Gamma distribution
function if its probability density function is
(
β α Γ1(α) x(α− 1) e− x /β , x ≥ 0
f (x; α, β) = 0,
x< 0
Definition
The mean of a random variable X with gamma pdf is given by
Z∞
µ= xf (x)dx = αβ
−∞
Gamma Distribution Normal Distribution Beta Distribution
Definition
The variance of a random variable X with gamma pdf is given by
Z∞
σ2 = (x − µ) 2f (x)dx = αβ2
−∞
Gamma Distribution Normal Distribution Beta Distribution
Definition
The cumulative distribution function F (x) of a random variable X with a
standard gamma distribution (β = 1) is given by
x
x Z
yα− 1e− y
F (x; α) = P (X ≤ x) = Z f (t)dt = dy, x > 0
Γ(α)
−∞ 0
Example
Suppose the reaction time X of a randomly selected individual to a
certain stimulus has a standard gamma distribution with α = 2. What is
the probability that the reaction time is more than 4 seconds ?
Gamma Distribution Normal Distribution Beta Distribution
Example
Suppose the survival time X in weeks of a randomly selected mouse
exposed to 240 rads of gamma radiation has a gamma distribution with
α = 8 and β = 15.
• Find the mean survival time
Definition
A continuous random variable X is said to have a normal distribution
with parameters µ and σ, if the probability density function (pdf) of X is
(x − µ )2
f (x; µ, σ) = √1 e
−
2σ 2 ,∞ < x < ∞
o 2π
Definition
A continuous random variable X is said to have a normal distribution
with parameters µ and σ, if the probability density function (pdf) of X is
(x − µ )2
f (x; µ, σ) = √1 e
−
2σ 2 ,∞ < x < ∞
o 2π
• Since µ and σ 2 can both vary, there are infinitely many normal
distributions
Gamma Distribution Normal Distribution Beta Distribution
Definition
A continuous random variable X is said to have a normal distribution
with parameters µ and σ, if the probability density function (pdf) of X is
(x − µ )2
f (x; µ, σ) = √1 e
−
2σ 2 ,∞ < x < ∞
o 2π
F (z) = P (Z ≤ z) = Z f (y)dy
−∞
• How to convert X to Z ?
a− µ b− µ b− µ a− µ
P (a ≤ X ≤ b) = P ≤Z ≤ = F −F
σ σ o σ
a− µ
• P (X ≤ a) = F
o
b− µ
•
P (X ≥ b) = 1 − F σ
Gamma Distribution Normal Distribution Beta Distribution
STANDARD NORMAL DISTRIBUTION: Table Values Represent AREA to the LEFT of the Z score.
Z .00 .01 .02 .03 .04 .05 .06 .07 .08 .09
-3.9 .00005 .00005 .00004 .00004 .00004 .00004 .00004 .00004 .00003 .00003
-3.8 .00007 .00007 .00007 .00006 .00006 .00006 .00006 .00005 .00005 .00005
-3.7 .00011 .00010 .00010 .00010 .00009 .00009 .00008 .00008 .00008 .00008
-3.6 .00016 .00015 .00015 .00014 .00014 .00013 .00013 .00012 .00012 .00011
-3.5 .00023 .00022 .00022 .00021 .00020 .00019 .00019 .00018 .00017 .00017
-3.4 .00034 .00032 .00031 .00030 .00029 .00028 .00027 .00026 .00025 .00024
-3.3 .00048 .00047 .00045 .00043 .00042 .00040 .00039 .00038 .00036 .00035
-3.2 .00069 .00066 .00064 .00062 .00060 .00058 .00056 .00054 .00052 .00050
-3.1 .00097 .00094 .00090 .00087 .00084 .00082 .00079 .00076 .00074 .00071
-3.0 .00135 .00131 .00126 .00122 .00118 .00114 .00111 .00107 .00104 .00100
-2.9 .00187 .00181 .00175 .00169 .00164 .00159 .00154 .00149 .00144 .00139
-2.8 .00256 .00248 .00240 .00233 .00226 .00219 .00212 .00205 .00199 .00193
-2.7 .00347 .00336 .00326 .00317 .00307 .00298 .00289 .00280 .00272 .00264
-2.6 .00466 .00453 .00440 .00427 .00415 .00402 .00391 .00379 .00368 .00357
-2.5 .00621 .00604 .00587 .00570 .00554 .00539 .00523 .00508 .00494 .00480
-2.4 .00820 .00798 .00776 .00755 .00734 .00714 .00695 .00676 .00657 .00639
-2.3 .01072 .01044 .01017 .00990 .00964 .00939 .00914 .00889 .00866 .00842
-2.2 .01390 .01355 .01321 .01287 .01255 .01222 .01191 .01160 .01130 .01101
-2.1 .01786 .01743 .01700 .01659 .01618 .01578 .01539 .01500 .01463 .01426
-2.0 .02275 .02222 .02169 .02118 .02068 .02018 .01970 .01923 .01876 .01831
-1.9 .02872 .02807 .02743 .02680 .02619 .02559 .02500 .02442 .02385 .02330 18/ 26
Gamma Distribution Normal Distribution Beta Distribution
STANDARD NORMAL DISTRIBUTION: Table Values Represent AREA to the LEFT of the Z score.
Z .00 .01 .02 .03 .04 .05 .06 .07 .08 .09
0.0 .50000 .50399 .50798 .51197 .51595 .51994 .52392 .52790 .53188 .53586
0.1 .53983 .54380 .54776 .55172 .55567 .55962 .56356 .56749 .57142 .57535
0.2 .57926 .58317 .58706 .59095 .59483 .59871 .60257 .60642 .61026 .61409
0.3 .61791 .62172 .62552 .62930 .63307 .63683 .64058 .64431 .64803 .65173
0.4 .65542 .65910 .66276 .66640 .67003 .67364 .67724 .68082 .68439 .68793
0.5 .69146 .69497 .69847 .70194 .70540 .70884 .71226 .71566 .71904 .72240
0.6 .72575 .72907 .73237 .73565 .73891 .74215 .74537 .74857 .75175 .75490
0.7 .75804 .76115 .76424 .76730 .77035 .77337 .77637 .77935 .78230 .78524
0.8 .78814 .79103 .79389 .79673 .79955 .80234 .80511 .80785 .81057 .81327
0.9 .81594 .81859 .82121 .82381 .82639 .82894 .83147 .83398 .83646 .83891
1.0 .84134 .84375 .84614 .84849 .85083 .85314 .85543 .85769 .85993 .86214
1.1 .86433 .86650 .86864 .87076 .87286 .87493 .87698 .87900 .88100 .88298
1.2 .88493 .88686 .88877 .89065 .89251 .89435 .89617 .89796 .89973 .90147
1.3 .90320 .90490 .90658 .90824 .90988 .91149 .91309 .91466 .91621 .91774
1.4 .91924 .92073 .92220 .92364 .92507 .92647 .92785 .92922 .93056 .93189
1.5 .93319 .93448 .93574 .93699 .93822 .93943 .94062 .94179 .94295 .94408
1.6 .94520 .94630 .94738 .94845 .94950 .95053 .95154 .95254 .95352 .95449
1.7 .95543 .95637 .95728 .95818 .95907 .95994 .96080 .96164 .96246 .96327
1.8 .96407 .96485 .96562 .96638 .96712 .96784 .96856 .96926 .96995 .97062
1.9 .97128 .97193 .97257 .97320 .97381 .97441 .97500 .97558 .97615 .97670
2.0 .97725 .97778 .97831 .97882 .97932 .97982 .98030 .98077 .98124 .98169 19/ 26
Gamma Distribution Normal Distribution Beta Distribution
Example
X is a normally distributed variable with mean µ = 30 and standard
deviation σ = 4.
Example
The annual salaries of employees in a large company are approximately
normally distributed with a mean of Rs. 50, 000 and a standard deviation
of Rs. 20, 000.
• What percent of people earn less than Rs. 40, 000 ?
• What percent of people earn between Rs. 45, 000 and Rs. 65, 000 ?
Example
Suppose that the height X in inches of a person is a normal random
variable with mean µ = 70 inches. If P (X > 79) = 0.025, what is the
standard deviation of this random normal variable ?
22/ 26
Gamma Distribution Normal Distribution Beta Distribution
Example
Suppose that the height X in inches of a person is a normal random
variable with mean µ = 70 inches. If P (X > 79) = 0.025, what is the
standard deviation of this random normal variable ?
Example
Suppose that the weight (X ) in pounds of a person is a normal random
variable with standard deviation σ = 20 pounds. If 5% of the population
is heavier than 214 pounds what is the mean of this distribution ?
22/ 26
Gamma Distribution Normal Distribution Beta Distribution
Example
A bag of cookies is underweight if it weighs less than 500 grams. The
filling process dispenses cookies with weight that follows the normal
distribution with mean 510 grams and standard deviation 4 grams.
• What is the probability that a randomly selected bag is underweight?
Definition
When a random variable takes values on the interval from 0 and 1, one
choice of a probability density function is the beta distribution function,
given by
( α− 1 β− 1
ΓΓ(α)Γ (β) x
(α+β) (1 − x) , 0 < x < 1, α > 0, β > 0
f (x) =
0, elsewhere
Definition
The mean of a random variable with beta distribution is given by
α
µ=
α+ β
Definition
The variance of a random variable with beta distribution is given by
αβ
σ2 =
(α + β) 2(α + β + 1)
Gamma Distribution Normal Distribution Beta Distribution
Example
In a certain county, the proportion of highway sections requiring repairs
in any given year is a random variable having the beta distribution with
α = 3 and β = 2.
• On the average, what percentage of the highway sections require
repairs in any given year ?
• Find the probability that at most half of the highway sections will
require repairs in any given year.