R E G R E S S I O N A NA LYS I S
Regression Analysis measures the nature and extent of the
relationship between two or more variables, thus enables us to
make predictions.
Regressionis the measure of the average relationship
between two or more variables
UTILITY OF REGRESSION
Degree & Nature of relationship
Estimation of relationship
Prediction
D I F F E R E N C E BETWEEN CORRELATION &
R E G R E S SION
Degree & Nature of Relationship
⚫ Correlation is a measure of degree of relationship between X & Y
⚫ Regression studies the nature of relationship between the variables so
that one may be able to predict the value of one variable on the basis of
another.
Cause & Effect Relationship
⚫ Correlation does not always assume cause and effect relationship between
two variables.
⚫ Regression clearly expresses the cause and effect relationship between two
variables. The independent variable is the cause and dependent variable is
effect.
D I F F E R E N C E BETWEEN CORRELATION &
R E G R E S SION
Prediction
⚫ Correlation doesn’t help in making predictions
⚫ Regression enable us to make predictions using regression line
Symmetric
⚫ Correlation coefficients are symmetrical i.e. rxy = ryx .
⚫ Regression coefficients are not symmetrical i.e. bxy ≠ byx .
Origin & Scale
⚫ Correlation is independent of the change of origin and scale
⚫ Regression coefficient is independent of change of origin
• but not of scale
•TYPES OF REGRESSION ANALYSIS
Simple & Multiple Regression
Linear & Non Linear Regression
Partial & Total Regression
Simple Regression
Regressio
Regression Regression
n
Line Equation
Coefficie
nt
•R E G R E S S I O N L I N E S
The regression line shows the average relationship between two variables. It is
also called Line of Best Fit.
If two variables X & Y are given, then there are two regression lines:
⚫ Regression Line of X on Y
⚫ Regression Line of Y on X
Nature of Regression Lines
⚫ If r = ±1, then the two regression lines are coincident.
⚫ If r = 0, then the two regression lines intersect each other at 90°.
⚫ The nearer the regression lines are to each other, the greater will be the degree of
correlation.
⚫ If regression lines rise from left to right upward, then correlation is positive.