Machine Learning with Python

K. Anvesh
Assistant Professor
Dept. of Information Technology

K. Anvesh, Dept. of IT
Topics to be covered…..

• Introduction to Machine Learning

• Supervised Learning
• Unsupervised Learning
• Python libraries for Machine Learning

K. Anvesh, Dept. of IT
 What is Machine Learning?
• The capability of Artificial Intelligence systems
to learn by extracting patterns from data is
known as Machine Learning.
• Machine Learning is an idea to learn from
examples and experience, without being explicitly
programmed. Instead of writing code, you feed
data to the generic algorithm, and it builds logic
based on the data given.

K. Anvesh, Dept. of IT
 Introduction to Machine Learning
• Python is a popular platform used for research
and development of production systems. It is
a vast language with number of modules,
packages and libraries that provides multiple
ways of achieving a task.
• Python and its libraries like NumPy, Pandas,
SciPy, Scikit-Learn, Matplotlib are used in data
science and data analysis. They are also
extensively used for creating scalable machine
learning algorithms.
K. Anvesh, Dept. of IT
• Python implements popular machine learning
techniques such as Classification, Regression,
Recommendation, and Clustering.
• Python offers ready-made framework for
performing data mining tasks on large
volumes of data effectively in lesser time

K. Anvesh, Dept. of IT
What is Machine Learning?

• Data science, machine learning and artificial

intelligence are some of the top trending
topics in the tech world today. Data mining
and Bayesian analysis are trending and this is
adding the demand for machine learning.
• Machine Learning
– Study of algorithms that improve their
performance at some task with experience

K. Anvesh, Dept. of IT
• Machine learning is a discipline that deals with
programming the systems so as to make them
automatically learn and improve with experience.
• Here, learning implies recognizing and understanding the
input data and taking informed decisions based on the
supplied data.
• It is very difficult to consider all the decisions based on all
possible inputs. To solve this problem, algorithms are
developed that build knowledge from a specific data and
past experience by applying the principles of statistical
science, probability, logic, mathematical optimization,
reinforcement learning,K. Anvesh,
andDept.control
of IT
th
 ML
Machine Learning (ML) is an automated learning
with little or no human intervention. It involves
programming computers so that they learn from
the available inputs. The main purpose of
machine learning is to explore and construct
algorithms that can learn from the previous data
and make predictions on new input data.

K. Anvesh, Dept. of IT
 Growth of Machine Learning
• Machine learning is preferred approach to
– Speech recognition, Natural language processing
– Computer vision
– Medical outcomes analysis
– Robot control
– Computational biology
• This trend is accelerating
– Improved machine learning algorithms
– Improved data capture, networking, faster computers
– Software too complex to write by hand
– New sensors / IO devices
– Demand for self-customization to user, environment
– It turns out to be difficult to extract knowledge from human
expertsfailure of expert systems in the 1980’s.
K. Anvesh, Dept. of IT
 Applications of Machine Learning Algorithms
• The developed machine learning algorithms are used in various
applications such as:
Web search Vision processing
Computational biology Language processing
Finance
E-commerce Forecasting things like
Space exploration stock market trends,
Robotics weather
Information extraction Pattern recognition
Social networks
Debugging Games
Data mining [Your favorite area]
Expert systems
Robotics
K. Anvesh, Dept. of IT
Benefits of Machine Learning

• Powerful Processing
• Better Decision Making & Prediction
• Quicker Processing
• Accurate
• Affordable Data Management
• Inexpensive
• Analyzing Complex Big Data

K. Anvesh, Dept. of IT
Steps Involved in Machine Learning

• A machine learning project involves the

following steps:
– Defining a Problem
– Preparing Data
– Evaluating Algorithms
– Improving Results
– Presenting Results

K. Anvesh, Dept. of IT
K. Anvesh, Dept. of IT
K. Anvesh, Dept. of IT
K. Anvesh, Dept. of IT
 Magic?
No, more like gardening

• Seeds = Algorithms
• Nutrients = Data
• Gardener = You
• Plants = Programs

K. Anvesh, Dept. of IT
So what the machine learning is…

• Automating automation
• Getting computers to program themselves
• Writing software is the bottleneck
• Let the data do the work instead!

K. Anvesh, Dept. of IT
 Machine Learning Techniques
Given below are some techniques in this Machine
Learning tutorial.
• Classification
• Categorization
• Clustering
• Trend analysis
• Anomaly detection
• Visualization
• Decision making
K. Anvesh, Dept. of IT
 ML in a Nutshell
• Machine Learning is a sub-set of Artificial
Intelligence where computer algorithms are used to
autonomously learn from data and
information. Machine learning computers can
change and improve their algorithms all by
themselves.
• Tens of thousands of machine learning algorithms
• Every machine learning algorithm has three
components:
– Representation
– Evaluation
– Optimization
K. Anvesh, Dept. of IT
 Representation
• Decision trees
• Sets of rules / Logic programs
• Instances
• Graphical models
• Neural networks
• Support vector machines (SVM)
• Model ensembles
etc………

K. Anvesh, Dept. of IT
 Evaluation
• Accuracy
• Precision and recall
• Squared error
• Likelihood
• Posterior probability
• Cost / Utility
• Margin
• Entropy
• K-L divergence
• Etc.

K. Anvesh, Dept. of IT
 Optimization
• Combinatorial optimization
– E.g.: Greedy search
• Convex optimization
– E.g.: Gradient descent
• Constrained optimization
– E.g.: Linear programming

K. Anvesh, Dept. of IT
 Features of Machine Learning
Let us look at some of the features of Machine
Learning.
• Machine Learning is computing-intensive and
generally requires a large amount of training
data.
• It involves repetitive training to improve the
learning and decision making of algorithms.
• As more data gets added, Machine Learning
training can be automated for learning new data
patterns and adapting its algorithm.
K. Anvesh, Dept. of IT
Machine Learning Algorithms

• Machine Learning can learn from labeled data

(known as supervised learning) or unlabelled
data (known as unsupervised learning).
• Machine Learning algorithms involving
unlabelled data, or unsupervised learning, are
more complicated than those with the labeled
data or supervised learning
• Machine Learning algorithms can be used to
make decisions in subjective areas as well.

K. Anvesh, Dept. of IT
 Examples
• Logistic Regression can be used to predict which
party will win at the ballots.
• Naïve Bayes algorithm can separate valid emails from
spam.
• Face detection: Identify faces in images (or indicate if
a face is present).
• Email filtering: Classify emails into spam and not-
spam.
• Medical diagnosis: Diagnose a patient as a sufferer
or non-sufferer of some disease.
• Weather prediction: Predict, for instance, whether
or not it will rain tomorrow.
K. Anvesh, Dept. of IT
Concepts of Learning
• Learning is the process of converting
experience into expertise or knowledge.
• Learning can be broadly classified into three
categories, as mentioned below, based on the
nature of the learning data and interaction
between the learner and the environment.
• Supervised Learning
• Unsupervised Learning
• Semi-supervised learning

K. Anvesh, Dept. of IT
 Types of Learning
• Supervised (inductive) learning
– Training data includes desired outputs
• Unsupervised learning
– Training data does not include desired outputs
• Semi-supervised learning
– Training data includes a few desired outputs
• Reinforcement learning
– Rewards from sequence of actions

K. Anvesh, Dept. of IT
• Similarly, there are four categories of machine
learning algorithms as shown below:
• Supervised learning algorithm
• Unsupervised learning algorithm
• Semi-supervised learning algorithm
• Reinforcement learning algorithm

K. Anvesh, Dept. of IT
 Supervised Learning
• A majority of practical machine learning uses
supervised learning.
• In supervised learning, the system tries to learn from
the previous examples that are given. (On the other
hand, in unsupervised learning, the system attempts
to find the patterns directly from the example
given.)
• Speaking mathematically, supervised learning is
where you have both input variables (x) and output
variables(Y) and can use an algorithm to derive the
mapping function from the input to the output.
• The mapping function is expressed as Y = f(X).
K. Anvesh, Dept. of IT
• When an algorithm learns from example data and
associated target responses that can consist of
numeric values or string labels, such as classes or
tags, in order to later predict the correct response
when posed with new examples comes under the
category of Supervised learning.
• This approach is indeed similar to human learning
under the supervision of a teacher. The teacher
provides good examples for the student to
memorize, and the student then derives general
rules from these specific examples.

K. Anvesh, Dept. of IT
K. Anvesh, Dept. of IT
 Categories of Supervised learning

• Supervised learning problems can be further

divided into two parts, namely classification, and
regression.
• Classification: A classification problem is when
the output variable is a category or a group, such
as “black” or “white” or “spam” and “no spam”.
• Regression: A regression problem is when the
output variable is a real value, such as “Rupees”
or “height.”
•

K. Anvesh, Dept. of IT
 Unsupervised Learning
• In unsupervised learning, the algorithms are left
to themselves to discover interesting structures in
the data.
• Mathematically, unsupervised learning is when
you only have input data (X) and no
corresponding output variables.
• This is called unsupervised learning because
unlike supervised learning above, there are no
given correct answers and the machine itself
finds the answers.
K. Anvesh, Dept. of IT
• Unsupervised learning is used to detect anomalies,
outliers, such as fraud or defective equipment, or
to group customers with similar behaviours for a
sales campaign. It is the opposite of supervised
learning. There is no labelled data here.
• When learning data contains only some indications
without any description or labels, it is up to the
coder or to the algorithm to find the structure of
the underlying data, to discover hidden patterns,
or to determine how to describe the data. This kind
of learning data is called unlabeled data.
K. Anvesh, Dept. of IT
 Categories of Unsupervised learning
• Unsupervised learning problems can be further
divided into association and clustering
problems.
• Association: An association rule learning problem
is where you want to discover rules that describe
large portions of your data, such as “people that
buy X also tend to buy Y”.
• Clustering: A clustering problem is where you
want to discover the inherent groupings in the
data, such as grouping customers by purchasing
behaviour.
K. Anvesh, Dept. of IT
 Reinforcement Learning
• A computer program will interact with a dynamic
environment in which it must perform a
particular goal (such as playing a game with an
opponent or driving a car). The program is
provided feedback in terms of rewards and
punishments as it navigates its problem space.
• Using this algorithm, the machine is trained to
make specific decisions. It works this way: the
machine is exposed to an environment where it
continuously trains itself using trial and error
method.

K. Anvesh, Dept. of IT
• Here learning data gives feedback so that the
system adjusts to dynamic conditions in order
to achieve a certain objective. The system
evaluates its performance based on the
feedback responses and reacts accordingly.
The best known instances include self-driving
cars and chess master algorithm AlphaGo.

K. Anvesh, Dept. of IT
 Semi-supervised learning
• If some learning samples are labeled, but some other
are not labelled, then it is semi- supervised learning. It
makes use of a large amount of unlabeled data for
training and a small amount of labelled data for
testing. Semi-supervised learning is applied in cases
where it is expensive to acquire a fully labelled dataset
while more practical to label a small subset.
• For example, it often requires skilled experts to
label certain remote sensing images, and lots of field
experiments to locate oil at a particular location, while
acquiring unlabeled data is relatively easy.

K. Anvesh, Dept. of IT
• Here an incomplete training signal is given: a
training set with some (often many) of the
target outputs missing. There is a special case
of this principle known as Transduction where
the entire set of problem instances is known
at learning time, except that part of the
targets are missing.

K. Anvesh, Dept. of IT
 Categorizing on the basis of required Output
Another categorization of machine learning tasks arises
when one considers the desired output of a machine-learned
system:
• Classification : When inputs are divided into two or more
classes, and the learner must produce a model that
assigns unseen inputs to one or more (multi-label
classification) of these classes. This is typically tackled in a
supervised way. Spam filtering is an example of
classification, where the inputs are email (or other)
messages and the classes are “spam” and “not spam”.
• Regression : Which is also a supervised problem, A case
when the outputs are continuous rather than discrete.
• Clustering : When a set of inputs is to be divided into
groups. Unlike in classification, the groups are not known
beforehand, making this typically an unsupervised task.
K. Anvesh, Dept. of IT
 Libraries and Packages
• To understand machine learning, you need to have basic
knowledge of Python programming. In addition, there are a
number of libraries and packages generally used in
performing various machine learning tasks as listed below:

– numpy - is used for its N-dimensional array objects

– pandas – is a data analysis library that includes dataframes
– matplotlib – is 2D plotting library for creating graphs and plots
– scikit-learn - the algorithms used for data analysis and data mining
tasks
– seaborn – a data visualization library based on matplotlib

K. Anvesh, Dept. of IT