Human Behaviour Recognition
Using Multiscale Convolutional
Neural Networks
Abstract
• "Video based pedestrian detection and
behavior recognition"
• The key problem in human behavior
recognition is how to build a spatiotemporal
feature extraction and classification network.
Aiming at the problem that the existing
channel attention mechanism directly pools
the global average information of each
channel and ignores its local spatial
information, this paper proposes two
Introduction
• In the field of computer vision, the research
on human behavior recognition can not only
develop the relevant theoretical basis, but
also expand its engineering application. For
the theoretical basis, the field of behavior
recognition integrates the knowledge of many
disciplines, such as image processing,
computer vision, artificial intelligence, human
kinematics and bioscience. Human behavior
recognition is an important method to process
Problem Statement
• The key problem in human behavior
recognition is how to build a spatiotemporal
feature extraction and classification network.
Aiming at the problem that the existing
channel attention mechanism directly pools
the global average information of each
channel and ignores its local spatial
information, this paper proposes two
improved channel attention modules, namely
the space-time (ST) interaction module of
Objectives
• The key problem in human behavior
recognition is how to build a spatiotemporal
feature extraction and classification network.
Aiming at the problem that the existing
channel attention mechanism directly pools
the global average information of each
channel and ignores its local spatial
information, this paper proposes two
improved channel attention modules, namely
the space-time (ST) interaction module of
Existing System
• However, due to the complexity of human
behavior itself, and human behavior is easily
disturbed by complex background, occlusion,
light and other environmental factors, most of
the current feature extraction methods are
cumbersome and prone to error transmission,
Moreover, it is difficult to effectively model
the relatively slow or static behavior. In
addition, the convolutional neural network
with a single scale can not fully describe the
Proposed System
• In propose work author applying 3DCNN
algorithm for human behaviour prediction as
all existing algorithms were directly employing
global average information of each channel
(taking all channels of images as single data)
which ignores spatial and depth information
from image features which leads to inaccurate
recognition. If model has accurate information
or each shape from the image then it can
predict accurately. So in propose work author
Literature Review
• "Human behavior recognition based on bone
spatial-temporal map"
• The key problem in human behavior
recognition is how to build a spatiotemporal
feature extraction and classification network.
Aiming at the problem that the existing
channel attention mechanism directly pools
the global average information of each
channel and ignores its local spatial
information, this paper proposes two
Dataset Model
• 3. preprocess dataset
4.preprocess dataset successfully
• 5. Run Calculate Metrices 6.Random
Calculate Metrices
• 7. run Cnn Algorithm 8. Run Cnn
Algorithm Successfully
• 9.run MCNN_MDN_model 10. Successfully
Run MCNN_MDN_model
• 11.Run extension_model 12.
Successfully run extension_model
Architecture
• "Progress and application prospect of video
behavior recognition"
• "Identification method and experiment of
unsafe behaviors of subway passengers based
on Kinect"
• In order to solve the problem of the low action
recognition accuracy of passengers’ unsafe
behaviors caused by redundant joints, this
study proposes an efficient recognition
method based on a Kinect sensor. The method
Sequence Diagram
• Collaboration diagram:
• A collaboration diagram describes interactions
among objects in terms of sequenced
messages. Collaboration diagrams represent a
combination of information taken from class,
sequence, and use case diagrams describing
both the static structure and dynamic
behaviour of a system.
• Component Diagram:
• In the Unified Modelling Language, a
Optimizers
• Content not found for this section.
Experimental Setup
• "Video based pedestrian detection and
behavior recognition"
• The key problem in human behavior
recognition is how to build a spatiotemporal
feature extraction and classification network.
Aiming at the problem that the existing
channel attention mechanism directly pools
the global average information of each
channel and ignores its local spatial
information, this paper proposes two
Evaluation Metrics
• plt.show()
• #train existing CNN algorithm which will use
many parameters for training and can increase
computation complexity
• X_train1 = np.reshape(X_train,
(X_train.shape[0], X_train.shape[1],
X_train.shape[2], (X_train.shape[3] *
X_train.shape[4])))
• X_test1 = np.reshape(X_test, (X_test.shape[0],
X_test.shape[1], X_test.shape[2],
Results
• In the research of domain, a large number of
efficient network structures have emerged,
such as C3R, eco, TSN etc. Although these
network models are different in structure,
they all have high modelling ability for video
data and can effectively distinguish different
human behaviors in natural scenes.
Theoretically, the feature description vectors
obtained from different network models are
sensitive to category information (taking the
Comparison
• In the research of domain, a large number of
efficient network structures have emerged,
such as C3R, eco, TSN etc. Although these
network models are different in structure,
they all have high modelling ability for video
data and can effectively distinguish different
human behaviors in natural scenes.
Theoretically, the feature description vectors
obtained from different network models are
sensitive to category information (taking the
Test Cases
• Integration & Test Stage:
• Installation & Acceptance Test:
• After customer personnel have verified that
the initial production data load is correct and
the test suite has been executed with
satisfactory results, the customer formally
accepts the delivery of the software.
• The primary outputs of the installation and
acceptance stage include a production
application, a completed acceptance test
References
• The title of each requirement is also placed
into the first version of the RTM, along with
the title of each goal from the project plan.
The purpose of the RTM is to show that the
product components developed during each
stage of the software development lifecycle
are formally connected to the components
developed in prior stages.
• In the requirements stage, the RTM consists of
a list of high-level requirements, or goals, by
Conclusion
• Pandas can clean messy data sets, and make
them readable and relevant.
• Relevant data is very important in data
science. Pandas are a Python library for data
analysis. Started by Wes McKinney in 2008 out
of a need for a powerful and flexible
quantitative analysis tool, pandas have grown
into one of the most popular Python libraries.
It has an extremely active community of
contributors. The name is derived from the
