0% found this document useful (0 votes)
29 views

Hypothesis Testing or Inferential Testing

Thank you for the insightful quote. As an AI, my goal is to provide helpful information to users, while avoiding human biases or judgments.
Copyright
© © All Rights Reserved
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd
0% found this document useful (0 votes)
29 views

Hypothesis Testing or Inferential Testing

Thank you for the insightful quote. As an AI, my goal is to provide helpful information to users, while avoiding human biases or judgments.
Copyright
© © All Rights Reserved
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd
You are on page 1/ 23

BASICS OF

STATISTICAL
MODELING

Regression analysis

LADY JANE MAKIPUTIN


IMEE JENNIFER QUIPOT
Purpose of regression analysis
1.) To study and measure the statistical relationships that exist
between two or more variables.
2.)It is developed to describe the patient or functional nature of the
relationship that exists between the variables.
3.)To predict the (MEAN) average value of the dependent variable on
the basis of the know of fixed values of the explanatory variable.
Regression Analysis

-It is a statistical method or a


predictive modeling
technique which investigate
and estimates the relationship
between the variables.
Dependent Variable-is a value that is affected when the value of
the dependent variable changes.
Regressed/Response/Predicted/Explained variable – vertically Y
axis.

Independent Variables- is a value that the researcher can freely


change to test its effect on the dependent variable. –
Regressor/Predictor/Explanatory variable- horizontal X axis
Regression Analysis is performed for the following
purposes:

1.) Measure relationship 2.) To predict or estimate values of


between one or more variables. dependent variable from known
values of independent variables.

Example: Example:
What influences childrens How long does a patient stay in
ability to concentrate? the hospital.
Types of regression analysis

SIMPLE LINEAR REGRESSION MULTI LINEAR REGRESSION

Use only one independent variable Several dependent variable to infer


to infer the dependent variables. the dependent variable.
Types of regression analysis

Use only one independent variable to Uses several independent variable to


infer the dependent variables infer the the dependent variable.
Example
Simple Linear Regression Multiple Linear Regression

Weekly working time have an Does the weekly working time and
influence on the hourly wage of the age of the employees has an
employees influence on the hourly wages.
Scatter Plots
allows to identify the flow of the dots
to determine whether the two variables are related
MINITAB
DATA FROM THE PASTE IN THE
MICROSOFT EXCEL MINITAB
GRAPH SIMPLE
SCATTER PLOT
VARIABLES SCATTER PLOT
TYPES OF LINES
REGRESSION
EQUATION
Is a mathematical equation
that allows us to predict
values of one dependent
variable from known values
of one or more independent
variables.
REGRESSION EQUATION
The linear equation is specified as follows:
Standard Regression Equation/A Simple
Regression Model can be written as

REGRESSI Y = α + βX + ε

ON Value of Dependent variable = Constant + Slope ×

EQUATIO Value of Indep. variable + Error

N Regression analysis provides reasonable


(statistically unbiased) values for slope(s) and
intercept.
Y = α + βX + ε

Where
y–
is the value of the dependent variable (y),
what is being predicted or explained.
α–
a constant term,
REGRESSION equals the value of y when the value of x = 0.
β–
EQUATION slope
is the regression coefficient of X,
tells how much Y changes if X changes by one unit.
x–
is the value of the independent variable (x),
what is predicting or explaining the value of y.
ɛ-
is the error term,
are unknown,
MULTIPLE
REGRESSION
MODEL • Here, bi’s (i=1,2…n) are the regression
coefficients, which represent the value at
y = b 1x 1 + b 2x 2 + … + which the criterion variable changes
when the predictor variable changes.
b nx n + c
More than two variables in which one is
dependent and others are independent
variables.
Multiple regression is a statistical
technique that can be used to analyze the
relationship between a single dependent
variable and several independent variables.
REGRESSION
EQUATION
Regression Coefficient
indicates the direction and
strength of the relationship
between the two quantitative
variables.
REGRESSION
EQUATION
Error (ε)
Represents the average distance that the
observed values fall from the regression line.
REGRESSION EQUATION
Residual
Is the difference between the predicted value of Y and the observed
value of Y.
R-SQUARED

Measures how close the data are to the fitted


regression line.
Also known as the coefficient of determination.
TWO COMPONENT PARTS OF TOTAL
VARIANCE

1.) Regression Sum of Squares


Difference between the mean and the predicted value of Y.
Explained part of the deviation.
A higher regression sum of squares describes that the model
does not fit the observed data well.
2.) Residual Sum of squares
Measures the prediction errors.
Unexplained part of the deviation.
A lower residual sum of squares describes that the
regression model can better explain the observed data while
a higher residual sum of squares describes that the model
poorly explains the observed data.
Your best quote that reflects your
approach… “It’s one small step for
man, one giant leap for mankind.”

- NEIL ARMSTRONG

You might also like