ISQS 6339, Data Management & Business
Intelligence
Data Preparation for
Analytics Using SAS
Zhangxi Lin
Texas Tech University
ISQS 6347, Data & Text Mining
Outline
An overview of data preparation for analytics
SAS Programming Essentials
Running SAS programs
Mastering fundamental concepts
SAS program debugging
Make use of SAS Enterprise Guide for programming
ISQS 6347, Data & Text Mining
Structure and Components of
Business Intelligence
ISQS 6347, Data & Text Mining
Overview: From Data
Warehousing to Data Analysis
Previous major topics in data warehousing (using SQL Server
2008)
Dimensional model design
ETL
Cubes design and OLAP
Data analysis topics (using SAS)
Data preparation
Analytic business questions
Data format and data conversion
Data cleansing
Data exploratory
Data analysis
Data visualization
ISQS 6347, Data & Text Mining
Components of the SAS
System
Reporting
And
Graphics
Data Access
And
Management
User
Interface
Analytical
Base SAS
Application
Development
Visualization
And Discovery
Business
Solutions
Web
Enablement
ISQS 6347, Data & Text Mining
SAS Programming Essentials
Find more information from
http://support.sas.com
ISQS 6347, Data & Text Mining
Data-driven Tasks
The functionality of the SAS System is built around
four data-driven tasks common to virtually any
applications
Data access
Data management
Data analysis
Data presentation
ISQS 6347, Data & Text Mining
Turning Data into
Information
Process of delivery meaningful information
80% data-related
Access
Scrub
Transform
Mange
Store and retrieve
20% analysis
ISQS 6347, Data & Text Mining
Turning Data into
Information DATA
Data
Step
SAS
Data Sets
PROC
Steps
Information
ISQS 6347, Data & Text Mining
Design of the SAS System
MultiVendor Architecture
90%
independent
PC
10%
dependent
Workstation
Servers/
Midrange
Mainframe
ISQS 6347, Data & Text Mining
Super
Computer
10
...
Design of the SAS System
MultiEngine Architecture
DB2
Teradata
SAP
dBase
DATA
DATA
ORACLE
SYBASE
Microsoft Excel
ISQS 6347, Data & Text Mining
11
SAS Programming Level
I
Fundamentals (ch1-3)
Producing list reports (ch4)
Enhancing output (ch5)
Creating data sets (ch6)
Data step programming (ch7)
Reading data
Creating variables
Conditional processing
Keeping and dropping variables
Reading Excel files
Combining SAS data sets (ch8)
Producing summary reports (ch9)
SAS graphing (ch10)
ISQS 6347, Data & Text Mining
12
Course Scenario
In
this course, you work with business data
from International Airlines (IA). The various
kinds of data that IA maintains are listed below:
flight data
passenger data
cargo data
employee data
revenue data
ISQS 6347, Data & Text Mining
13
Course Scenario
The
following are some tasks that you will
perform:
importing data
creating a list of employees
producing a frequency table of job codes
summarizing data
creating a report of salary information
ISQS 6347, Data & Text Mining
14
SAS Programs
A SAS program is a sequence of steps that the user
submits for execution.
Raw
Raw
Data
Data
DATA steps are typically used to create SAS
data sets.
DATA
DATA
Step
Step
SAS
Data
Set
SAS
Data
Set
PROC
PROC
Step
Step
Report
Report
PROC steps are typically used to process
SAS data sets (that is, generate reports
and graphs, edit data, and sort data).
ISQS 6347, Data & Text Mining
15
SAS Programs
data work.staff;
infile 'raw-data-file';
input LastName $ 1-20 FirstName $ 21-30
JobTitle $ 36-43 Salary 54-59;
run;
DATA
Step
proc print data=work.staff;
run;
proc means data=work.staff;
class JobTitle;
var Salary;
run;
ISQS 6347, Data & Text Mining
PROC
Steps
16
Step Boundaries
SAS steps begin with either of the following:
DATA statement
PROC statement
SAS detects the end of a step when it encounters
one of the following:
a RUN statement (for most steps)
a QUIT statement (for some procedures)
the beginning of another step (DATA statement
or PROC statement)
ISQS 6347, Data & Text Mining
17
Step Boundaries
data work.staff;
infile 'raw-data-file';
input LastName $ 1-20 FirstName $ 21-30
JobTitle $ 36-43 Salary 54-59;
run;
proc print data=work.staff;
proc means data=work.staff;
class JobTitle;
var Salary;
run;
ISQS 6347, Data & Text Mining
18
Running a SAS Program
You can invoke SAS in the following ways:
interactive windowing mode (SAS windowing
environment)
interactive menu-driven mode (SAS Enterprise Guide,
SAS/ASSIST, SAS/AF, or SAS/EIS software)
batch mode
noninteractive mode
ISQS 6347, Data & Text Mining
19
Preparation of SAS
Programming
Data sets: \SAS-Programming
Create a user defined library reference
Statement
LIBNAME libref SAS-data-library <options>;
Example
LIBNAME ia c:\workshop\winsas\prog1;
Two-levels of SAS files names
Libref.fielname
ISQS 6347, Data & Text Mining
20
SAS Programming Essentials
Demon: c02s2d1
Exercise: c02ex1
ISQS 6347, Data & Text Mining
21
Browsing the Descriptor
Portion
General form of the CONTENTS procedure:
PROC
PROCCONTENTS
CONTENTS DATA=SAS-data-set;
DATA=SAS-data-set;
RUN;
RUN;
Example:
proc contents data=work.staff;
run;
ISQS 6347, Data & Text Mining
c02s3d1
22
SAS Data Sets: Data Portion
The data portion of a SAS data set is a rectangular table
of character and/or numeric data values.
JobTitle
Salary
TORRES
LANGKAMM
SMITH
WAGSCHAL
TOERMOEN
JAN
SARAH
MICHAEL
NADJA
JOCHEN
Pilot
Mechanic
Mechanic
Pilot
Pilot
50000
80000
40000
77500
65000
Character values
Variable
values
FirstName
Variable
names
LastName
Numeric
values
Variable names are part of the descriptor portion, not the
data portion.
ISQS 6347, Data & Text Mining
23
SAS Variable Values
There are two types of variables:
character
contain any value: letters, numbers, special
characters, and blanks. Character values are
stored with a length of 1 to 32,767 bytes. One
byte equals one character.
numeric
stored as floating point numbers in 8 bytes
of storage by default. Eight bytes of floating point
storage provide space for 16 or 17 significant
digits. You are not restricted to
8 digits.
ISQS 6347, Data & Text Mining
24
SAS Data Set and Variable
SAS names have these characteristics:
Names
can be 32 characters long.
can be uppercase, lowercase, or mixed-case.
are not case sensitive.
must start with a letter or underscore.
Subsequent characters can be letters,
underscores, or numerals.
ISQS 6347, Data & Text Mining
25
Valid SAS Names
Select the valid default SAS names.
data5mon
ISQS 6347, Data & Text Mining
26
...
Valid SAS Names
Select the valid default SAS names.
data5mon
ISQS 6347, Data & Text Mining
27
...
Valid SAS Names
Select the valid default SAS names.
data5mon
5monthsdata
ISQS 6347, Data & Text Mining
28
...
Valid SAS Names
Select the valid default SAS names.
data5mon
5monthsdata
ISQS 6347, Data & Text Mining
29
...
Valid SAS Names
Select the valid default SAS names.
data5mon
5monthsdata
data#5
ISQS 6347, Data & Text Mining
30
...
Valid SAS Names
Select the valid default SAS names.
data5mon
5monthsdata
data#5
ISQS 6347, Data & Text Mining
31
...
Valid SAS Names
Select the valid default SAS names.
data5mon
5monthsdata
data#5
five months data
ISQS 6347, Data & Text Mining
32
...
Valid SAS Names
Select the valid default SAS names.
data5mon
5monthsdata
data#5
five months data
ISQS 6347, Data & Text Mining
33
...
Valid SAS Names
Select the valid default SAS names.
data5mon
5monthsdata
data#5
five months data
fivemonthsdata
ISQS 6347, Data & Text Mining
34
...
Valid SAS Names
Select the valid default SAS names.
data5mon
5monthsdata
data#5
five months data
fivemonthsdata
ISQS 6347, Data & Text Mining
35
...
Valid SAS Names
Select the valid default SAS names.
data5mon
5monthsdata
data#5
five months data
fivemonthsdata
FiveMonthsData
ISQS 6347, Data & Text Mining
36
...
Valid SAS Names
Select the valid default SAS names.
data5mon
5monthsdata
data#5
five months data
fivemonthsdata
FiveMonthsData
ISQS 6347, Data & Text Mining
37
...
Missing Data Values
A value must exist for every variable for each observation.
Missing values are valid values.
LastName
FirstName
JobTitle
Salary
TORRES
LANGKAMM
SMITH
WAGSCHAL
TOERMOEN
JAN
SARAH
MICHAEL
NADJA
JOCHEN
Pilot
Mechanic
Mechanic
Pilot
50000
80000
.
77500
65000
A character missing
value is displayed as
a blank.
ISQS 6347, Data & Text Mining
A numeric
missing value
is displayed
as a period.
39
Browsing the Data Portion
The
PRINT procedure displays the data
portion
of a SAS data set.
By
default, PROC PRINT displays the
following:
all observations
all variables
an Obs column on the left side
ISQS 6347, Data & Text Mining
40
Browsing the Data Portion
General form of the PRINT procedure:
PROC
PROCPRINT
PRINT DATA=SAS-data-set;
DATA=SAS-data-set;
RUN;
RUN;
Example:
proc print data=work.staff;
run;
ISQS 6347, Data & Text Mining
c02s3d1
41
SAS Data Set Terminology
SAS documentation and text in the SAS windowing
environment use the following terms interchangeably:
SAS
SASData
DataSet
Set
SAS
SASTable
Table
Variable
Variable
Column
Column
Observation
Observation
Row
Row
ISQS 6347, Data & Text Mining
42
SAS Syntax Rules
SAS statements have these characteristics:
usually begin with an identifying keyword
always end with a semicolon
data work.staff;
infile 'raw-data-file';
input LastName $ 1-20 FirstName $ 21-30
JobTitle $ 36-43 Salary 54-59;
run;
proc print data=work.staff;
run;
proc means data=work.staff;
class JobTitle;
var Salary;
run;
ISQS 6347, Data & Text Mining
43
SAS Syntax Rules
SAS statements are free-format.
One or more blanks or special characters can
be used to separate words.
They can begin and end in any column.
A single statement can span multiple lines.
Several statements can be on the same line.
Unconventional Spacing
data work.staff;
infile 'raw-data-file';
input LastName $ 1-20 FirstName $ 21-30
JobTitle $ 36-43 Salary 54-59;
run;
proc means data=work.staff;
class JobTitle; ISQS 6347,
var
Salary;run;
Data & Text Mining
44
...
SAS Syntax Rules
SAS statements are free-format.
One or more blanks or special characters can
be used to separate words.
They can begin and end in any column.
A single statement can span multiple lines.
Several statements can be on the same line.
Unconventional Spacing
data work.staff;
infile 'raw-data-file';
input LastName $ 1-20 FirstName $ 21-30
JobTitle $ 36-43 Salary 54-59;
run;
proc means data=work.staff;
class JobTitle; ISQS 6347,
var
Salary;run;
Data & Text Mining
46
...
SAS Syntax Rules
SAS statements are free-format.
One or more blanks or special characters can
be used to separate words.
They can begin and end in any column.
A single statement can span multiple lines.
Several statements can be on the same line.
Unconventional Spacing
data work.staff;
infile 'raw-data-file';
input LastName $ 1-20 FirstName $ 21-30
JobTitle $ 36-43 Salary 54-59;
run;
proc means data=work.staff;
class JobTitle; ISQS 6347,
var
Salary;run;
Data & Text Mining
47
...
...
SAS Syntax Rules
SAS statements are free-format.
One or more blanks or special characters can
be used to separate words.
They can begin and end in any column.
A single statement can span multiple lines.
Several statements can be on the same line.
Unconventional Spacing
data work.staff;
infile 'raw-data-file';
input LastName $ 1-20 FirstName $ 21-30
JobTitle $ 36-43 Salary 54-59;
run;
proc means data=work.staff;
class JobTitle; ISQS 6347,
var
Salary;run;
Data & Text Mining
48
...
...
SAS Syntax Rules
SAS statements are free-format.
One or more blanks or special characters can
be used to separate words.
They can begin and end in any column.
A single statement can span multiple lines.
Several statements can be on the same line.
Unconventional Spacing
data work.staff;
infile 'raw-data-file';
input LastName $ 1-20 FirstName $ 21-30
JobTitle $ 36-43 Salary 54-59;
run;
proc means data=work.staff;
class JobTitle; ISQS 6347,
var
Salary;run;
Data & Text Mining
49
SAS Syntax Rules
Good spacing makes the program easier to read.
Conventional Spacing
data work.staff;
infile 'raw-data-file';
input LastName $ 1-20 FirstName $ 21-30
JobTitle $ 36-43 Salary 54-59;
run;
proc print data=work.staff;
run;
proc means data=work.staff;
class JobTitle;
var Salary;
run;
ISQS 6347, Data & Text Mining
50
SAS Comments
Type /* to begin a comment.
Type your comment text.
Type */ to end the comment.
/* Create work.staff data set */
data work.staff;
infile 'raw-data-file';
input LastName $ 1-20 FirstName $ 21-30
JobTitle $ 36-43 Salary 54-59;
run;
/* Produce listing report of work.staff */
proc print data=work.staff;
run;
ISQS 6347, Data & Text Mining
c02s3d2
51
Syntax Errors
Syntax errors include the following:
misspelled keywords
missing or invalid punctuation
invalid options
daat work.staff;
infile 'raw-data-file';
input LastName $ 1-20 FirstName $ 21-30
JobTitle $ 36-43 Salary 54-59;
run;
proc print data=work.staff
run;
proc means data=work.staff average max;
class JobTitle;
var Salary;
run;
ISQS 6347, Data & Text Mining
52
Debugging a SAS
Program
c02s4d1.sas
userid.prog1.sascode(c02s4d1)
c02s4d2.sas
userid.prog1.sascode(c02s4d2)
This demonstration illustrates how to submit a
SAS program that contains errors, diagnose
the errors, correct the errors, and save the
corrected program.
ISQS 6347, Data & Text Mining
53
Recall a Submitted Program
Program statements accumulate in a recall buffer
each time you issue a SUBMIT command.
daat work.staff;
infile 'raw-data-file';
input LastName $ 1-20 FirstName $ 21-30
JobTitle $ 36-43 Salary 54-59;
run;
proc print data=work.staff
run;
proc means data=work.staff average max;
class JobTitle;
var Salary;
run;
data work.staff;
infile 'raw-data-file';
input LastName $ 1-20 FirstName $ 21-30
JobTitle $ 36-43 Salary 54-59;
run;
proc print data=work.staff;
run;
proc means data=work.staff mean max;
class Jobtitle;
var Salary;
ISQS 6347, Data & Text Mining
run;
Submit
Number 1
Submit
Number 2
54
Recall a Submitted Program
Issue the RECALL command once to recall the most
recently submitted program.
Submit
Number 1
Issue RECALL
once.
Submit
Number 2
data work.staff;
infile 'raw-data-file';
input LastName $ 1-20 FirstName $ 21-30
JobTitle $ 36-43 Salary 54-59;
run;
proc print data=work.staff;
run;
proc means data=work.staff mean max;
class JobTitle;
var Salary;
run;
Submit Number 2 statements
are recalled.
ISQS 6347, Data & Text Mining
55
Recall a Submitted Program
Issue the RECALL command again to recall Submit
Number 1 statements.
Submit
Number 1
Issue RECALL
again.
Submit
Number 2
daat work.staff;
infile 'raw-data-file';
input LastName $ 1-20 FirstName $ 21-30
JobTitle $ 36-43 Salary 54-59;
run;
proc print data=work.staff
run;
proc means data=work.staff average max;
class JobTitle;
var Salary;
run;
data work.staff;
infile 'raw-data-file';
input LastName $ 1-20 FirstName $ 21-30
JobTitle $ 36-43 Salary 54-59;
run;
proc print data=work.staff;
run;
proc means data=work.staff mean max;
class JobTitle;
var Salary;
run;
56
ISQS 6347, Data & Text Mining
Exercise 8: Basic SAS
Programming
Define library IA and Out
Go through all SAS programs in Chapter 2-5.
Write a SAS program to read a dataset created by
yourself or simply use Person0.txt in
\\TechShare\coba\d\ISQS3358\OtherDatasets\ .
The dataset is output to your library Out.
Try to apply whatever SAS features in Chapter 5 of Prog-I
to general a nice looking report.
Go through all exercises for Ch 2, 3, 4, 5, 6 (answer keys
are available, so no need to submit the results)
ISQS 6347, Data & Text Mining
57
Hands-on exercise
Write a SAS program to calculate the number
of dates passed in 2012 to 3/3/2012. The
input is in the format: date9.
01JAN2012 03MAR2012
Answer: 62 days
ISQS 6347, Data & Text Mining
58
Making Use of SAS Enterprise
Guide Code
Import a text file
Example: Orders.txt
Import an Excel file
Example: SupplyInfo.xls
ISQS 6347, Data & Text Mining
59
Learn from Examples
SAS Help
Contents -> Learning to use SAS -> Sample SAS
Programs -> Base SAS
Base Usage Guide Examples
Chapter 3, 4
ISQS 6347, Data & Text Mining
60
Import an Excel Sheet
proc import out=work.commrex
datafile ="C:\Lin\Shared\ISQS6339\Commrex_3358.xls" dbms=excel
replace;
sheet="Company";
getnames=yes;
mixed=no;
scantext=yes;
usedate=yes;
scantime=yes;
run;
proc print data=work.commrex;
run;
ISQS 6347, Data & Text Mining
61
Excel SAS/ACCESS LIBNAME
Engine
libname xlsdata 'C:\Lin\Shared\ISQS6339\Commrex_3358.xls';
proc print data=xlsdata.New1;
run;
ISQS 6347, Data & Text Mining
62
Exercise 8: SAS Data Step
Programming
http://zlin.ba.ttu.edu/6339/ExerciseSASProgramming.htm
ISQS 6347, Data & Text Mining
63
