Introduction to data analytics
with Python
Introduction to Data Analytics
• Business organizations use huge amounts of data.
• Modern technology makes it easier to capture, process, store, distribute,
and transmit digital information.
• The data are available in a variety of forms such as flat files, databases,
records, and digital archives.
• Most of these data are useful for making decisions. Data have to be
converted to information, which is processed data.
• Information includes patterns, associations, or relationships among data.
For example, the sales data can be analysed to extract information like
popularity of a product launched by an organization in the market and
which product needs to phased out from the market.
Steps of Data Analytics
• Data Analytics is a general term and data analysis is a part of it.
• Data analytics refers to the process of data collection, pre-processing,
and analysis of such data.
Types of Data Analytics
Dataset and Data Analysis
• A dataset is collection of data objects. The data objects may have
many attributes. An attribute can be defined as the property or
characteristics of an object. For Example.
Data Analytic Process
• Cross Industry Standard Process–Data Mining (DM) model is the
popular model that is used for data analytics.
• This model involves six steps. The steps are listed below.
1. Understanding the Business
2. Understanding the Data
3. Preparation of data and Data Pre-processing
4. Modelling
5. Evaluation of a Model
6. Deployment
Arrays in Python
• Most programming languages provide a data structure called arrays.
In Python, array is a package and it is different from "core" python
lists.
• Arrays are similar to lists and the differences between arrays lists are
given
Importing and creating an Array
Three ways of importing are:
1) import array (using modules)
>>> import array
2) import array as arr (using alias)
>>> import array as arr
Here, arr is called an alias.
3) import array * (import all the functionalities of the array module) import
array * would import all the functionalities of the array. The arrays are
indexed from 0 to n-1. n is the total number of elements of the array. The
first element is indexed as zero.
Array Operations
• 1. Arrays are mutable. The array is a container in Python that stores
objects of different types. It is also a fundamental data structure that
is useful for processing data. It works similarly to lists and stores
objects of similar types.
Introduction to NumPy
• NumPy is a library of Python, and it is a shorthand form of numerical
Python.
• NumPy provides an array data structure and helps in numerical
analysis. NumPy is used to manipulate arrays.
• The manipulation includes mathematical and logical operations.
Array Creation in NumPy
NumPy Properties
• The important characteristics of defining a NumPy array are listed below.
• Data type
• Item size
• Shape–dimensions
• Data
• Data types are integers, unit, float, and complex; other data types are
Boolean, string, date time, and Python objects. Item size is the memory
requirement of data elements in bytes.
• The shape is the dimension of the array. Data are the elements of a NumPy
array.
Arithmetic Operation on NumPy
• One can create an array and apply the following commands to
perform statistical operations. Array operations are shown in Table
Data Analysis Using NumPy
• Descriptive analytics is about describing the main features of the
data. Descriptive analytics only focuses on the description part of the
data and not the inference part.
• Some of the descriptive statistics are given in Table
Pandas
• Pandas is a name from "panel data" and was designed by Wes
McKinney in 2008. Pandas is used for data manipulation and analysis.
The core of pandas is their data structures. It provides three data
structures.
1) series 1D (Column)
2) data frame 2D (Single Sheet)
3) Panel 3D (Multiple Sheets)
• A panel may have multiple sheets (df) and every df may have many
columns (series)
Series in Pandas
• One dimensional series can be created as
Data Visualization Using Pandas and
Matplotlib
• The process of visualizing data to identify patterns is called data
visualization. A pattern is a trend or repetition of some data. By visualizing,
one can observe some trends that may be helpful in business decision
making.
• For example, by observing the trend, one can take some important
decisions. Data visualization is useful in many domains such as
1) Data science
2) Machine learning
3) Data mining
4) Data analytics
• Matplotlib is one of the most important libraries. One can import the
pyplot module from Matplotlib import library.
Pandas and Matplotlib Visualization
• Pandas can be used for data visualization also. Pandas can read
comma-separated values (CSV),
• Excel and Tab-Separated values 0 files into data frame. The first
requirement of Pandas visualization is that the data files need to be
imported into data frame. Let us assume that the following dataset is
available for data.
• This is followed by the dot operator. This is followed by the name of
the plot. For example, the histogram of salesJan in the above table
can be done as follows.
Scikit-Learn and Data Analysis
• Regression analysis is used to model the relationship between one or
more independent variables and a dependent variable. Regression
analysis discovers the relation between the variables. In the simplest
form, the model can be created as
Y = a0 + a1 * x
Here, a0 is the intercept that represents the bias, and a1 represents the
slope. These are called regression coefficients. This specifies the Y-
Intercept and slope of the line. The values of estimates of a and b are
given as follows.
Scikit-Learn for Regression
• The above calculations can be done by scikit-learn. Scikit-learn is a third-party Python package that provides
the routines for regression. The following is the program for linear regression.
