100% found this document useful (1 vote)
38 views82 pages

Machine Vision and Industrial Robotics in Manufacturing Approaches Technologies and Applications Alex Khang Vugar Abdullayev Hajimahmud Anuradha Misra Eugenia Litvinova Instant Download

The book 'Machine Vision and Industrial Robotics in Manufacturing' explores the integration of machine vision and robotics in manufacturing, focusing on intelligent machines' roles in product traceability, monitoring, and supply chain management. It discusses advanced technologies related to Artificial Intelligence and the Industrial Internet of Things, emphasizing their applications in smart manufacturing and Industry 4.0. Targeted at a diverse audience, the book covers various topics including productivity, defect detection, and the challenges of implementing these technologies in modern manufacturing environments.

Uploaded by

ginetzukko
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
100% found this document useful (1 vote)
38 views82 pages

Machine Vision and Industrial Robotics in Manufacturing Approaches Technologies and Applications Alex Khang Vugar Abdullayev Hajimahmud Anuradha Misra Eugenia Litvinova Instant Download

The book 'Machine Vision and Industrial Robotics in Manufacturing' explores the integration of machine vision and robotics in manufacturing, focusing on intelligent machines' roles in product traceability, monitoring, and supply chain management. It discusses advanced technologies related to Artificial Intelligence and the Industrial Internet of Things, emphasizing their applications in smart manufacturing and Industry 4.0. Targeted at a diverse audience, the book covers various topics including productivity, defect detection, and the challenges of implementing these technologies in modern manufacturing environments.

Uploaded by

ginetzukko
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 82

Machine Vision And Industrial Robotics In

Manufacturing Approaches Technologies And


Applications Alex Khang Vugar Abdullayev
Hajimahmud Anuradha Misra Eugenia Litvinova
download
https://ebookbell.com/product/machine-vision-and-industrial-
robotics-in-manufacturing-approaches-technologies-and-
applications-alex-khang-vugar-abdullayev-hajimahmud-anuradha-
misra-eugenia-litvinova-57916366

Explore and download more ebooks at ebookbell.com


Here are some recommended products that we believe you will be
interested in. You can click the link to download.

Machine Vision And Augmented Intelligence Select Proceedings Of Mai


2022 Koushlendra Kumar Singh

https://ebookbell.com/product/machine-vision-and-augmented-
intelligence-select-proceedings-of-mai-2022-koushlendra-kumar-
singh-50006290

Machine Vision And Its Applications Martha Lesley

https://ebookbell.com/product/machine-vision-and-its-applications-
martha-lesley-56321078

Machine Vision And Image Recognition Johan Pehcevski

https://ebookbell.com/product/machine-vision-and-image-recognition-
johan-pehcevski-22155638

Machine Vision And Augmented Intelligence Theory And Applications


Manish Kumar Bajpai

https://ebookbell.com/product/machine-vision-and-augmented-
intelligence-theory-and-applications-manish-kumar-bajpai-36246876
Machine Vision And Mechatronics In Practice 1st Edition John
Billingsley

https://ebookbell.com/product/machine-vision-and-mechatronics-in-
practice-1st-edition-john-billingsley-4975926

Machine Vision And Navigation 1st Ed 2020 Oleg Sergiyenko Wendy


Floresfuentes

https://ebookbell.com/product/machine-vision-and-navigation-1st-
ed-2020-oleg-sergiyenko-wendy-floresfuentes-10797684

Machine Vision Beyond Visible Spectrum Augmented Vision And Reality


Hammoud

https://ebookbell.com/product/machine-vision-beyond-visible-spectrum-
augmented-vision-and-reality-hammoud-20009724

Precision Landmark Location For Machine Vision And Photogrammetry


Gutierrez J

https://ebookbell.com/product/precision-landmark-location-for-machine-
vision-and-photogrammetry-gutierrez-j-2043724

Surface Inspection Techniques Using The Integration Of Innovative


Machine Vision And Graphical Modelling Techniques Smith

https://ebookbell.com/product/surface-inspection-techniques-using-the-
integration-of-innovative-machine-vision-and-graphical-modelling-
techniques-smith-4321674
Machine Vision and Industrial
Robotics in Manufacturing

This book covers the basics of machine vision and robotics in the manufacturing industry.
Major applicability of intelligent machines and robotics in the manufacturing sector are
explored in three major areas of product traceability, remote product-monitoring, supply
chain, logistics, and product record management. Machine Vision and Industrial
Robotics in Manufacturing: Approaches, Technologies, and Applications explains
advanced technologies based on Artificial Intelligence and Industrial Internet of
Things related to smart manufacturing applications.

The book introduces the emerging machines and robotics applications that are
enabling smart factories initiatives worldwide. The chapters examine labor produc-
tivity, factory device installation, and defective product detection. The authors share
modern models, emerging technologies, designs, frameworks, theories, practices,
and sustainable approaches to design and implement machine vision with indus-
trial robotics. They also examine the challenging issues associated with the leverag-
ing of technologies related to machine vision, computer vision, robotics, Internet of
Things, Industrial Internet of Things technologies, Artificial Intelligence-equipped
machines, applications, and automatic techniques for intelligent manufacturing sys-
tems and smart factory infrastructure in the era of Industry 4.0 manufacturing. The
authors also examine topics such as the role of existing management and production
solutions, their limitations, and future directions in manufacturing industry.

This book targets a mixed audience of students, engineers, scholars, researchers, aca-
demics, and professionals who are learning, researching, and working in the fields
of machine vision, Artificial Intelligence, Industrial Internet of Things, computer
vision, and robotic technologies from different industries and economics.
Machine Vision and
Industrial Robotics
in Manufacturing
Approaches, Technologies,
and Applications

Edited by
Alex Khang, Vugar Abdullayev Hajimahmud,
Anuradha Misra, and Eugenia Litvinova
Designed cover image: © Shutterstock

First edition published 2025


by CRC Press
2385 NW Executive Center Drive, Suite 320, Boca Raton FL 33431

and by CRC Press


4 Park Square, Milton Park, Abingdon, Oxon, OX14 4RN

CRC Press is an imprint of Taylor & Francis Group, LLC

© 2025 selection and editorial matter, Alex Khang, Vugar Abdullayev Hajimahmud, Anuradha Misra,
and Eugenia Litvinova; individual chapters, the contributors

Reasonable efforts have been made to publish reliable data and information, but the author and pub-
lisher cannot assume responsibility for the validity of all materials or the consequences of their use.
The authors and publishers have attempted to trace the copyright holders of all material reproduced in
this publication and apologize to copyright holders if permission to publish in this form has not been
obtained. If any copyright material has not been acknowledged please write and let us know so we may
rectify in any future reprint.

Except as permitted under U.S. Copyright Law, no part of this book may be reprinted, reproduced,
transmitted, or utilized in any form by any electronic, mechanical, or other means, now known or here-
after invented, including photocopying, microfilming, and recording, or in any information storage or
retrieval system, without written permission from the publishers.

For permission to photocopy or use material electronically from this work, access www.copyright.com
or contact the Copyright Clearance Center, Inc. (CCC), 222 Rosewood Drive, Danvers, MA 01923, 978-
750-8400. For works that are not available on CCC please contact [email protected]

Trademark Notice: Product or corporate names may be trademarks or registered trademarks and are
used only for identification and explanation without intent to infringe.

ISBN: 978-1-032-56597-2 (hbk)


ISBN: 978-1-032-57164-5 (pbk)
ISBN: 978-1-003-43813-7 (ebk)

DOI: 10.1201/9781003438137

Typeset in Times
by KnowledgeWorks Global Ltd.
Contents
About the Editors.......................................................................................................ix
List of Contributors....................................................................................................xi
Preface....................................................................................................................xvii
Acknowledgments....................................................................................................xix

Chapter 1 Role of Machine Vision in Manufacturing and Industrial


Revolution 4.0........................................................................................1
Alex Khang, Vugar Abdullayev Hajimahmud, Ragimova Nazila
Ali, Vladimir Hahanov, Zoran Avramovic, and Triwiyanto

Chapter 2 Role of Computer Vision in Manufacturing Industry......................... 14


Mohd Umar, Mahima Gupta, Rajat Verma, and
Namrata Dhanda

Chapter 3 Application of Computer Vision in Manufacturing............................ 36


Roheen Qamar and Baqar Ali Zardari

Chapter 4 Application of Robotics in Manufacturing Industry........................... 57


Rishabh Didwania, Rajat Verma, and Namrata Dhanda

Chapter 5 Application of Industrial Robotics in Manufacturing......................... 85


Alex Khang, Vugar Abdullayev Hajimahmud, Abuzarova
Vusala Alyar, Matlab Khalilov Etibar, Vasila Abbasova
Soltanaga, and Yitong Niu

Chapter 6 Enabling the Future of Manufacturing: Integration of


Robotics and IoT into Smart Factory Infrastructure
in Industry 4.0................................................................................... 101
Kali Charan Rath, Alex Khang, Suresh Kumar Satapathy,
Amaresh Kumar, Sudhansu Ranjan Das, and
Manas Ranjan Panda

Chapter 7 Role of Computer Vision (CV) in Manufacturing: Seeing Is


Believing........................................................................................... 129
Ankita Nayak, Ipseeta Satpathy, Alex Khang, and Arpita Nayak

v
vi Contents

Chapter 8 Application of Artificial Intelligence and Internet of Things in


the Manufacturing Sector.................................................................. 145
Vugar Abdullayev Hajimahmud, Alex Khang, Gardashova
Latafat Abbas, Rashad İsmibeyli, Jale Agazade Firudin,
and Khurshudov Dursun

Chapter 9 Integration of Artificial Intelligence and Internet of Things


Technology Solutions in Smart Manufacturing................................ 155
Kali Charan Rath, Alex Khang, Srimant Kumar Mishra,
Prabin Kumar Patnaik, Gopal Kurushna Mohanty,
Taraprasanna Dash, and Siksha O Anusandhan

Chapter 10 Multimodal Dialogue Systems in the Era of Artificial


Intelligence-Assisted Industry........................................................... 178
Varini Awasthi, Rajat Verma, and Namrata Dhanda

Chapter 11 Artificial Intelligence-Based Human Activity Recognition


Using Real-Time Videos................................................................... 201
Sumita Gupta and Sapna Gambhir

Chapter 12 Application of Industrial Internet of Things Technologies


in the Manufacturing Industry..........................................................224
Vugar Abdullayev Hajimahmud, Ragimova Nazila Ali,
Triwiyanto, Asgarov Taleh Kamran, Mammadov Kanan Hafiz,
and Abuzarova Vusala Alyar

Chapter 13 Internet of Things-Integrated Robotics in Manufacturing................ 238


Manjula Devi Chithiraikannu, Gobinath Arumugam,
Srinivasan Arumugam, Pavithra Devi Ramamoorthy, and
Rajeswari Packianathan

Chapter 14 Robotic Process Applications and Tools for Manufacturing


Sector................................................................................................. 252
Alex Khang, Kali Charan Rath, Suresh Kumar Satapathy,
Amaresh Kumar, and Animesh Agrawal

Chapter 15 Robotics in Real-Time Applications for Aviation


Devices.............................................................................................. 275
Olena Hrybiuk, Maciej Szafrański, and Olena Vedishcheva
Contents vii

Chapter 16 Machine Vision and Industrial Robotics in Manufacturing............. 299


Rajeswari Packianathan, Gobinath Arumugam, Suresh Kumar
Natarajan, and Anandan Malaiarasan

Chapter 17 Application of Pressure Sensors in Manufacturing: Improving


Efficiency and Risk Mitigation......................................................... 314
Arpita Nayak, Atmika Patnaik, Ipseeta Satpathy, B. C. M.
Patnaik, and Alex Khang

Chapter 18 Online Internet of Things-Based Estimation of SoC, SoH and


SoP for a LiB Electric Bus................................................................ 331
Reshma P. and Manohar Joshi

Chapter 19 Influence of Internal and External Conditions on Floating


Solar Photovoltaic Systems with Internet of Things......................... 355
Dhass A. D., Ganesh Babu L., and Dhiren Patel R.

Chapter 20 Analysis of Internet of Things-Integrated Technology in a


Smart Factory.................................................................................... 368
Gurwinder Singh, Priya L., Kumar P., Karthika J.,
Saikumar Tara, and Nidhya M. S.

Chapter 21 Revolutionizing Manufacturing: The Impact of Internet of


Things Technologies in Smart Factories........................................... 385
Hammad Shahab, Muhammad Mohsin Waqas,
and Muthmainnah Muthmainnah

Chapter 22 Green Intelligent and Sustainable Manufacturing: Key


Advancements, Benefits, Challenges, and Applications for
Transforming Industry......................................................................405
Alex Khang and Shalom Akhai

Chapter 23 Enterprise Resource Planning and Accounting Information


Systems: Modeling the Relationship in Manufacturing.................... 418
Md Halimuzzaman, Jaideep Sharma, and Alex Khang

Chapter 24 Ransomware Resilience Strategies for Manufacturing Systems:


Safeguarding the Enterprise Resource Planning and Human
Resource Management Data.............................................................. 435
J. A. Raja, Alex Khang, and R. Vani
viii Contents

Chapter 25 Breaking Barriers: Empowering Women in Manufacturing


with Machine Vision and Industrial Robotics...................................449
Prashasti Pritiprada, Ipseeta Satpathy, Alex Khang,
and B.C.M. Patnaik

Chapter 26 Optimization of Data-Transfer Machines and Cloud Data


Platforms Integration in Industrial Robotics..................................... 459
Tarun Kumar Vashishth, Vikas Sharma, Bhupendra Kumar,
and Kewal Krishan Sharma
Index....................................................................................................................... 485
About the Editors
Alex Khang, D.Sc., D.Litt., is a professor of Information technology, an AI and data
scientist and senior portfolio manager at the Global Research Institute of Technology
and Engineering, Raleigh, North Carolina. He has more than 28 years of experi-
ence in teaching computer and data science at universities and other institutions in
Vietnam, India, and the United States. He has held the titles of software product
manager, data engineer, AI engineer, cloud computing architect, solution architect,
software architect, and database expert working for international corporations in
Germany, Sweden, and Singapore, among others. He has published 74 Scopus-
indexed documents, 54 authored books (on software development), 25 edited books,
and 50 book chapters, in addition to upcoming projects, in the field of artificial intel-
ligence. ORCID: 0000-0001-8379-4659.

Vugar Abdullayev Hajimahmud, D.Sc., is an associate professor at Azerbaijan


University of Architecture and Construction and Azerbaijan State Oil and Industry
University, Baku. He is author of 61 scientific papers. His research is related to the
study of cyber–physical systems, Internet of Things, Big Data, smart city, and infor-
mation technologies. He has published four book chapters and two edited books in
healthcare ecosystems. ORCID: 0000-0002-3348-2267.

Anuradha Misra, D.Sc., is assistant professor at Amity University, Uttar Pradesh,


Lucknow Campus, India. She has taught in higher education for the past 14 years.
She is member of professional organizations such as IAENG and IET (UK), a life-
time member of AUN Research Labs, and a member of IEDRC. She has edited
and reviewed various referred and peer-reviewed journals. She has presented
various papers in different national and international conferences. ORCID: 0000-
0002-7479-7636.

Eugenia Litvinova, D.Sc., is professor at Kharkov National University of Radio


Electronics, Ukraine. Her research areas include: Digital systems testing and test-
able design, SOC design verification, and brain-like computing, computer-aided
system for logic simulation, test generation, and fault diagnosis of digital devices
and systems. She has been a member of an organizing committee of IEEE East-
West Design & Test Symposium since 2007. She also is an assistant editor of the
scientific journal Radio Electronics and Informatics. She has published more than
240 publications, including 9 books, and 90 Scopus-indexed documents. ORCID:
0000-0002-9797-5271.

ix
Contributors
Gardashova Latafat Abbas Varini Awasthi
Department of Science and Technology Pranveer Singh Institute of Technology
Azerbaijan State Oil and Industry Kanpur, Uttar Pradesh, India
University
Baku, Azerbaijan Manjula Devi Chithiraikannu
Department of Information Technology
Shalom Akhai Velammal College of Engineering and
Chandigarh College of Engineering Technology
CGC Jhanjeri Madurai, Tamil Nadu, India
Mohali, Punjab, India
Taraprasanna Dash
Ragimova Nazila Ali Siksha O Anusandhan University,
Department of Science and Technology (Deemed to be University),
Azerbaijan State Oil and Industry Bhubaneswar, Odisha, India
University
Baku, Azerbaijan Namrata Dhanda
Department of Computer Science and
Abuzarova Vusala Alyar Engineering
Department of Educated Information Amity University
Technologies Lucknow Campus, Uttar Pradesh,
Azerbaijan State Oil and Industry India
University
Baku, Azerbaijan A. D. Dhass
Department of Computer Science
Gobinath Arumugam Indus University
Department of Information Technology Kanpur, Uttar Pradesh, India
Velammal College of Engineering and
Technology Rishabh Didwania
Madurai, Tamil Nadu, India Pranveer Singh Institute of Technology,
Kanpur, Uttar Pradesh, India
Srinivasan Arumugam
Department of Information Khurshudov Dursun
Technology Department of Computer Science
Velammal College of Engineering and Azerbaijan University of Architecture
Technology and Construction
Madurai, Tamil Nadu, India Baku, Azerbaijan

Zoran Avramovic Matlab Khalilov Etibar


Faculty of Transport and Traffic Department of Computer Science
Engineering Azerbaijan State Oil and Industry
University of Belgrade University
Belgrade, Serbia Baku, Azerbaijan

xi
xii Contributors

Jale Agazade Firudin Olena Hrybiuk


Department of Computer Science Faculty of Engineering, International
Azerbaijan State Oil and Industry Science and Technology University
University National Academy of Sciences
Baku, Azerbaijan Kharkiv, Ukraine

Sapna Gambhir Rashad İsmibeyli


Department of Computer Science Azerbaijan University of Architecture
George Mason University and Construction
Fairfax, Virginia Baku, Azerbaijan

Mahima Gupta Karthika J.


Department of Computer Science Department of EEE
Pranveer Singh Institute of Sri Krishna College of Engineering,
Technology Coimbatore, Tamil Nadu, India
Kanpur, Uttar Pradesh, India
Manohar Joshi
Sumita Gupta Department of Computer Science and
Department of Computer Science & Engineering
Engineering Presidency University
Amity University Bangalore, Karnataka, India
Noida, India
Asgarov Taleh Kamran
Mammadov Kanan Hafiz Department of Computer Science
Department of Computer Science National Aviation Academy
Azerbaijan State Oil and Industry Baku, Azerbaijan
University
Baku, Azerbaijan Alex Khang
Department of AI and Data Science
Vladimir Hahanov Global Research Institute of Technology
Design Automation Department and Engineering
Kharkiv National University of Radio Fort Raleigh, North Carolina
Electronics
Kharkiv, Ukraine Amaresh Kumar
Department of Production and
Vugar Abdullayev Hajimahmud Industrial Engineering
Department of Computer Science National Institute of Technology
Azerbaijan University of Architecture Jamshedpur, Jharkhand,
and Construction India
Baku, Azerbaijan
Bhupendra Kumar
Md. Halimuzzaman School of Computer Science and
School of Business Applications
Galgotias University IIMT University
Greater Noida, Uttar Pradesh, Meerut, Uttar Pradesh,
India India
Contributors xiii

Ganesh Babu L. Suresh Kumar Natarajan


Department of Computer Science Department of Civil Engineering
Tishk International University Kalasalingam Academy of Research
Erbil, Iraq and Education
Krishnankoil, Tamil Nadu, India
Priya L.
Department of IT M. S. Nidhya
Rajalakshmi Engineering Department of Computer Science &
College Information Technology
Thandalam, Chennai, India Jain Deemed-to-be University
Bangalore, Karnataka, India
Anandan Malaiarasan
Department of Electronics and Yitong Niu
Communication Engineering School of Aeronautical Engineering
Vel Tech Rangarajan Dr. Sagunthala Anyang University
R&D Institute of Science and Anyang, China
Technology
Chennai, Tamil Nadu, India Kumar P.
Department of Information Technology
Srimant Kumar Mishra Rajalakshmi Engineering College,
Department of Mechanical Thandalam, Chennai, India
Engineering
GIET University Reshma P.
Gunupur, Odisha, India Department of Electronics and
Communication Engineering
Gopal Kurushna Mohanty Presidency University
Department of Mechanical Bangalore, Karnataka, India
Engineering
GIET University Rajeswari Packianathan
Gunupur, Odisha, India Department of Electronics and
Communication Engineering
Muthmainnah Muthmainnah Velammal College of Engineering and
English Department Technology
Universitas Al Asyariah Mandar Madurai, Tamil Nadu, India
Sulawesi Barat, Indonesia
Manas Ranjan Panda
Ankita Nayak Department of Mechanical Engineering
Transtrack Aeroservices (P) Ltd. GIET University
Bhubaneswar, Odisha, India Gunupur, Odisha, India

Arpita Nayak Dhiren R. Patel


School of Management Department of Electronics and
Kalinga Institute of Industrial Communication Engineering
Technology Indus University
Bhubaneswar, Odisha, India Ahmedabad, Gujarat, India
xiv Contributors

Atmika Patnaik Ipseeta Satpathy


School of Management School of Management
Kalinga Institute of Industrial Kalinga Institute of Industrial
Technology Technology
Bhubaneswar, Odisha, India Bhubaneswar, Odisha, India

B. C. M. Patnaik Suresh Kumar Satapathy


School of Management Senior VP and Chief Business
Kalinga Institute of Industrial Development Officer
Technology Gurgaon, Haryana, India
Bhubaneswar, Odisha, India
Hammad Shahab
Prabin Kumar Patnaik Institute of Computer and Software
Department of Mechanical Engineering Engineering
GIET University Khwaja Fareed University of
Gunupur, Odisha, India Engineering and Information
Technology
Prashasti Pritiprada Rahim Yar Khan, Punjab,
School of Management Pakistan
Kalinga Institute of Industrial
Technology Jaideep Sharma
Bhubaneswar, Odisha, India School of Business
Galgotias University
Roheen Qamar Greater Noida, Uttar Pradesh,
Quaid-e-Awam University of India
Engineering, Sciences & Technology
Shaheed Benazirabad, Sindh, Pakistan Kewal Krishan Sharma
School of Computer Science and
Pavithra Devi R. Applications
Department of Information Technology IIMT University
Velammal College of Engineering and Meerut, Uttar Pradesh,
Technology India
Madurai, Tamil Nadu, India
Vikas Sharma
J. A. Raja School of Computer Science and
Department of Management Studies Applications
The Oxford College of Business IIMT University
Management Meerut, Uttar Pradesh, India
Bengaluru, Karnataka, India
Gurwinder Singh
Kali Charan Rath Department of Computer Science and
Department of Mechanical Engineering,
Engineering Apex Institute of Technology (CSE),
GIET University Chandigarh University,
Gunupur, Odisha, India Chandigarh, Punjab, India
Contributors xv

Vasila Abbasova Soltanaga Tarun Kumar Vashishth


Department of Computer Science School of Computer Science and
Azerbaijan State Oil and Industry Applications
University IIMT University,
Baku, Azerbaijan Meerut, Uttar Pradesh, India

Maciej Szafrański Olena Vedishcheva


Faculty of Engineering, International Faculty of Engineering, International
Science and Technology Science and Technology University
University National Academy of Sciences
National Academy of Sciences Kyiv, Ukraine
Kyiv, Ukraine
Rajat Verma
Saikumar Tara Department of Computer Science
Department of ECE Pranveer Singh Institute of
BVRIT Hyderabad College of Technology
Engineering for Women, Kanpur, Uttar Pradesh, India
Hyderabad, Telangana, India
Muhammad Mohsin Waqas
Triwiyanto Department of Agricultural
Department of Medical Electronics Engineering
Technology Khwaja Fareed University of
Poltekkes Kemenkes Surabaya Engineering and Information
Surabaya, Jawa Timur, Indonesia Technology
Rahim Yar Khan, Punjab, Pakistan
Mohd Umar
Department of Computer Science Baqar Ali Zardari
Pranveer Singh Institute of Technology Department of Sciences &
Kanpur, Uttar Pradesh, India Technology
Quaid-e-Awam University of
R. Vani Engineering
Department of Management Shaheed Benazirabad, Sindh,
S.I.V.E.T College Pakistan
Chennai, Tamil Nadu, India
Preface
Most recent developments of information technology in manufacturing are related
to machine vision (MV), computer vision (CV), artificial intelligence (AI), Internet
of Things (IoT), Industrial Internet of Things (IIoT), and robotics, which aim to
connect the physical and intelligent digital worlds and make it possible for machines
and humans to communicate using the computer. IIoT technologies equipped with
MV and AI have a wide range of uses in practically every manufacturing industry,
including smart factories, smart cities, smart transportation, and smart healthcare.
Machine vision and robotics are two new technologies that combine machines and
autonomous systems in different ways. A factory where humans and devices interact
is created by integrating communication technologies, sensing technologies, Internet
protocol, embedded devices, pervasive computing, and ubiquitous monitoring. In
smart factories, large amounts of linked devices and data present new prospects for
developing services that can directly benefit the management, working environment,
and individual workers.
The goal of this book is to share with readers modern models, emerging technolo-
gies, designs, frameworks, theories, practices, and sustainable approaches related
to machine and CV, AI, IoT, IIoT, robotics, and automatic techniques for intelligent
systems and smart factory infrastructure in Industry 4.0 manufacturing.
This book targets a mixed audience of students, engineers, scholars, researchers,
academics, and professionals who are learning, researching, and working in the field
of artificial intelligence and IoT technologies from different industries and econom-
ics. Happy reading!

Alex Khang, Vugar Abdullayev Hajimahmud,


Anuradha Misra, Eugenia Litvinova

xvii
Acknowledgments
Machine Vision and Industrial Robotics in Manufacturing: Approaches, Technologies,
and Applications is based on the design and implementation of topics related to
machine vision and robotics, which are two new technologies that combine machines
and autonomous systems. A factory where humans and devices interact is created by
integrating communication technologies, sensing technologies, Internet protocol,
embedded devices, pervasive computing, and ubiquitous monitoring. In smart facto-
ries, large amounts of linked devices and data present new prospects for developing
services that can directly benefit management, working environments, and individ-
ual workers in Industry 4.0.
The editors planned and designed this book for readers across the globe and are
thankful for the contributors whose efforts, knowledge, skills, expertise, enthusiasm,
collaboration, and trust made it a reality. The valued chapter contributors came from
different academic backgrounds including: human resource managers, talent manage-
ment leaders, experts, professors, scientists, engineers, scholars, postgraduate students,
educators, and academic colleagues.
Thanks go to all respected reviewers with whom we had the opportunity to col-
laborate remotely; we acknowledge their tremendous support and valuable com-
ments not only for the book but also for future book projects.
We also express our deep gratitude for all discussion, advice, support, motivation,
sharing, collaboration, and inspiration we received from our faculty, contributors,
educators, professors, scientists, scholars, engineers, and academic colleagues.
Last, we are grateful to our publisher CRC Press (Taylor & Francis Group) for the
wonderful support in processing the manuscript and bringing this book to readers in
a timely manner.

Alex Khang, Vugar Abdullayev Hajimahmud,


Anuradha Misra, and Eugenia Litvinova

xix
1 Role of Machine Vision
in Manufacturing and
Industrial Revolution 4.0
Alex Khang, Vugar Abdullayev Hajimahmud,
Ragimova Nazila Ali, Vladimir Hahanov,
Zoran Avramovic, and Triwiyanto

1.1 INTRODUCTION
1.1.1 Manufacturing
The meaning of manufacturing is similarly explained in different dictionaries as
follows:

• A business or industry that produces large quantities of goods in factories,


among others.
• To process or make (a product) from raw materials, especially as a large-
scale operation using machinery.
• Making goods or articles by hand or by machine, especially on a large
scale.

Manufacturing has recently been known as a machine-assisted process, as the


above definitions suggest, and it continues to evolve, especially with intelligent
machines. As a final definition, manufacturing is a process that includes all stages
of product production as a result of the processing of raw materials with the help
of human labor or machines. The manufacturing industry includes many different
areas. This industry can be divided into three types:

• Basic materials
• Processing and assembly
• Life-related

Each industry type covers different areas separately as discussed below.

1.1.1.1 Basic Materials Industry


• Wood construction and wood products
• Pulp, paper, and processed paper products
• Chemical
• Oil and coal products

DOI: 10.1201/9781003438137-1 1
2 Machine Vision and Industrial Robotics in Manufacturing

• Plastic products
• Rubber products
• Ceramics, earthenware, and stone products
• Steel
• Non-ferrous metal products
• Long-term product image businesses

1.1.1.2 Processing and Assembly Industry


• General equipment
• Electrical equipment
• Transport equipment
• Precision tools

1.1.1.3 Life-Related Industry


• Food
• Beverage/Tobacco/Fodder
• Textile
• Clothing and other textiles
• Furniture and equipment
• Industries related to publishing and printing
• Tanned leather, leather goods, and fur
• Other production

Worldwide, electronic equipment (computer, telephone, and television, among


others) and automobile manufacturing industries are more extensive. Countries with
the largest manufacturing industries in the world in 2023 are listed in Table 1.1
(Sandoval et al., 2018).
The advanced level of the manufacturing industry in countries is one of the main
factors contributing to their development both in terms of economic and general

TABLE 1.1
Top 10 Manufacturing Countries in 2023
Manufacturing
No. Countries Industry (%)
1 China 28.4
2 USA 16.6
3 Japan 7.2
4 Germany 5.8
5 India 3.3
6 South Korea 3.0
7 Italy 2.3
8 France 1.9
9 Great Britain 1.8
10 Mexico 1.5
Role of Machine Vision in Manufacturing and Industrial Revolution 4.0 3

strength. So, considering China’s current situation, it is possible to say that, very
soon, China may become the leading country in economic and other strategic
aspects. Today, it is common to find “Made in China” products in the markets of
many countries. In simple words, it is a key indicator of China’s hegemony in the
manufacturing industry.
When the question “why manufacturing is important” is asked, it is important
to show the statistics mentioned above and to also talk about how the manufactur-
ing industry directly impacts the development of countries—especially economic
development—and raises the level of its well-being and that of its citizens. Thus, the
expansion of the manufacturing sector, or the opening (commissioning) of factories,
plants, and production enterprises in many areas, has a positive effect on a country’s
development for the following reasons:

• Increasing the number of jobs and preventing unemployment and poverty


• Increasing the state budget
• More active foreign and domestic markets

The above shows the importance of the manufacturing industry to both the people
and the government.

1.1.2 Industrial Revolutions
Manufacturing is a concept and act that has existed for many years. Production was
carried out in the early times by special craftsmen where mainly handwork pre-
vailed. The early manufacturing era, where human labor was more abundant, began
to improve and evolve over time with the Industrial Revolution.
Mankind has witnessed four Industrial Revolutions. The world is currently pre-
paring to transition to the 5th Industrial Revolution. Industrial revolutions play a
great role in the history of production. Below is a list of the Industrial Revolutions
and their main characteristics.

• First Industrial Revolution (1760s): The transition from agriculture to the


industrial sector began during this period in England. During this period,
coal was discovered, mass mining began, and the steam engine was intro-
duced into the industry. Various production machines were invented.
Briefly, manual labor was replaced by machine power for the first time. It
soon spread to the United States and Europe. The keyword of this period is
“coal,” and the main discovery is the “steam engine.”
• Second Industrial Revolution (1870s): This period is the basic technology
period. It is related to the discovery and application of gas, oil, energy, and
of primary technologies. During this period, communication technology
was developed and mass production was carried out for the first time. The
keyword of this period is “gas/energy/technology,” and the main discovery
is the “fuel engine.”
• Third Industrial Revolution (1960s): The discovery and development of
nuclear technology and the first digital technologies began during this
4 Machine Vision and Industrial Robotics in Manufacturing

period. Mechanical electrical calculators, computers, and digital communi-


cation equipment were invented and improved. Early Artificial Intelligence
(AI) technologies began to be studied. In production, these newly discov-
ered technologies began to be applied. In this period, technologies were
already applied in everyday life, not only in production. The keyword of
this era is “digital technology.”
• Fourth Industrial Revolution (2000s): This period is currently underway.
It is an era of high-level technology and the replacement of human power
with machine power. It was first proposed in 2011 as Industry 4.0. Concepts
like smart devices, the Internet of Things, cyber-physical-social systems,
databases, process automation, and digitalization, among others are the
foundations of this period. Here, the human worker is secondary, and many
processes are performed by robots/machines. Smart City, Smart Village,
and Smart Home projects have been implemented during this period. This era
is known as the era of “smart technologies.”
• Fifth Industrial Revolution (near future): This period is an advanced version
of Industry 4.0, the creation of fully autonomous machines while support-
ing the coexistence of humans and intelligent machines. It places the person
at the center of the system. The Smart Society Project will form the basis
of the 5th Industrial Revolution. On the other hand, the concept of cyber-
physical-social systems will often be used here. This period is character-
ized by the future of robotics.

As seen from the above list, along with the Fourth Industrial Revolution, new
technologies, especially smart ones, have begun to be integrated into the production
environment. At present, smart technologies have been integrated into many sectors,
not only manufacturing, and have achieved high, productive results.

1.1.3 Smart Technologies in Manufacturing


Like humans, computers, robots, or machines use different tools to see. If the main
visual instrument (organ) of a person is the eye, then in machines and computers it is
a camera-like tool. The first technology and vision ability that comes to mind when
we think of the vision of the computer is known as Computer Vision technology
(Javaid et al., 2021). Computer Vision technology can simulate the process of human
vision at a very high level and can be applied in a wide range of areas as shown in
Figure 1.1.
Computer Vision, like a person, can get information from an image that it sees
live in real-time, and at the same time, it can also get instant information by analyz-
ing past images or videos (objects) that it has seen and stored in its memory (Liao &
Pei, 2011).
From this point of view, Computer Vision technology has a very broad character
and generality. Another technology that is very similar to Computer Vision and is
often treated as the same concept is Machine Vision. Machine Vision technology,
like Computer Vision, can analyze images and videos and extract useful information
from them. At the same time, there are many similarities between their components
Role of Machine Vision in Manufacturing and Industrial Revolution 4.0 5

FIGURE 1.1 Smart technologies in manufacturing.

(Deac et al., 2017). Both use cameras and sensors, and both perform similar pro-
cesses such as pattern recognition and object detection, among others.
However, there are some differences between these two “similar” technologies.
Before mentioning these differences, it is necessary to have detailed information
about Machine Vision technology. Let’s first look at the concept of Machine Vision,
its explanations, and its definitions (Khang & Vladimir et al., 2024).

1.2 MACHINE VISION CONCEPT AND DEFINITIONS


Computer Vision is applied in various industries. One of the technologies that has
this ability to be applied in industrial areas is Machine Vision technology (or system).

1.2.1 Definitions of Machine Vision


There are several similar explanations and definitions for Machine Vision. Simply,
Machine Vision is the vision system integrated into machines and equipment used in
industry that “sees” what work these devices are doing and makes decisions accord-
ingly. In other words, Machine Vision is intelligent systems that see the environment
using sensors. It is an integrated intelligent system that uses the capabilities of a com-
puter to see objects in the environment, obtain information about their state, analyze
this information, and implement a decision-making process. Machine Vision is also
known as Intelligent Vision (Kallen, 2016).

1.2.2 Machine Vision Technology


Machine Vision is mainly applied in specific areas, especially in manufacturing
industries. Machine Vision uses cameras to capture visual information from the
6 Machine Vision and Industrial Robotics in Manufacturing

environment. It then processes the images using a combination of hardware and


software and prepares the data for use in various applications. Machine Vision tech-
nology often uses special optics to acquire images. This approach allows to process,
analyze, and measure certain features of the image. For example, a Machine Vision
application as part of a manufacturing system can be used to analyze a specific fea-
ture of a part being produced on an assembly line. It can determine whether the part
meets the quality criteria (Yasar & Lutkevitch, 2023).

1.2.3 Basic Concepts Related to Machine Vision


There are several concepts connected with Machine Vision which are discussed
below:

• Imaging – This is one of the key concepts for any vision system because
both Machine Vision and Computer Vision technologies work with images,
which are the richest source of information.
• Analysis – The main step after obtaining images is to analyze them and
extract useful information.
• Automatic (Autonomous) – Automation of processes is one of the main con-
cepts for Machine Vision technology. Thus, Machine Vision carries out both
internal and external processes such as monitoring, control, and data analy-
sis, mainly autonomously. Human experts are needed in the general working
principle of this technology.
• Data – Machine Vision works with data and this data plays an important
role in the decision-making process. The system must be able to extract data
from objects.
• Monitoring and Control – Machine Vision technology constantly monitors
equipment, machines, and robots. It controls their working process, safety,
and quality.
• Machine – A key concept related to Machine Vision is that of a “machine.”
This also shows the main difference between Computer Vision and Machine
Vision.

1.3 APPLICATIONS OF MACHINE VISION


According to the basic concepts mentioned above, Machine Vision technology is
used for various purposes in manufacturing industries. These are 11 main use cases
of Machine Vision as shown in Figure 1.2.
Below are the functions and applications of Machine Vision in common use cases.
There are many similarities between the use cases of Machine Vision and Computer
Vision technology.

• Object and Orientation Detection – Detecting objects, their location, and


orientation in (2- or 3-dimensional) space.
• Measuring and Sorting – Obtaining the exact size of objects. It character-
izes the placement of points in the image and the measurement with the
Role of Machine Vision in Manufacturing and Industrial Revolution 4.0 7

FIGURE 1.2 Eleven use cases of Machine Vision.

help of those points. It characterizes the process of classifying and separat-


ing product parts according to attributes such as color, size, or shape.
• Defect Detection – Detecting defects in the object (or product): scratches,
bends, surface defects, and others.
• Identification – Verifying that the product being manufactured is the prod-
uct ordered. It is done by reading barcodes, various codes, numbers, or
symbols. Inspection is the process of checking that all parts of the manufac-
tured product are complete, without unwanted extra parts or defective parts.
• Counting – Determining that the number of products produced corre-
sponds to the order. With Machine Vision, this process is automated and
done faster.
• Automated Vision Testing and Measurement – ​​Determining whether the
correct data is visible to the product.
• Control and Monitoring – Automating the process of monitoring work
processes, products, quality, employees, and equipment.
• Tracking – Monitoring of equipment and tools throughout the work pro-
cess to ensure all the working parts of the equipment are operational.
• Quality Control – Inspecting parts of a manufactured product for any
defects.
• Product Processing – After product preparation comes packing and rout-
ing it following given standards.
• Data Collection – Machine Vision entails pattern recognition, or the col-
lection of data such as size, serial number, and others about a monitored
object in real-time.
8 Machine Vision and Industrial Robotics in Manufacturing

1.4 COMPONENTS AND FEATURES OF MACHINE VISION


When we think of Machine Vision, the first thing that comes to mind is its compo-
nents. This is the basis of Machine Vision and is different from Computer Vision.
Machine Vision components are very widely used parts of individual systems. These
parts work together as a unit to create a Machine Vision system as shown in Figure 1.3
and the list below.

• Illumination System – Highlights the object to be inspected, in whole or in


part, so that it can be clearly seen by the camera.
• Lens – Takes an image and sends it as light to the sensor.
• Sensors – Receive this image in the form of light, convert it into a digital
image, and send it to the processing system.

Here, the sensor performs two processes. The first process is discussed above.
The other is a sensor that starts even before the lighting system. So, when the object
approaches, the sensor detects it, and then the lighting system is activated.

• Processing System – Several different algorithms are used here which


check the image, analyze it, extract the necessary information, and make
decisions based on data.
• Communication System – Sending input/output (I/O) signals and data via
serial communication to the device that sends the data.

FIGURE 1.3 The main components of Machine Vision.


Role of Machine Vision in Manufacturing and Industrial Revolution 4.0 9

FIGURE 1.4 Structure of the Machine Vision system.

The working process of a sensor follows the below steps:

• The sensor detects the physical object, and the process starts.
• The object or part is illuminated by the sensor. The higher the quality of
illumination, the better results will be obtained in subsequent processes.
• The camera (lens) turns on and takes a picture of the illuminated object or
the desired part.
• The image captured by the camera consists mainly of a stream of light and
is then converted into a digital image by a sensor (known as a frame grab-
ber) and sent to an image-processing system.
• The image processing system uses various algorithms to extract the neces-
sary information from the obtained image after it receives the image and
analyzes it. This is the main data for decision-making.
• The obtained data is sent to the appropriate device. It is basically an inter-
face that works for a person to see that information.

As mentioned earlier, each of these parts is used separately in different areas


and is mainly a ready-made component. Together, they form the core components
of a Machine Vision system. These parts and their location in the overall system are
shown in Figure 1.4.

1.5 DIFFERENCES BETWEEN COMPUTER VISION


AND MACHINE VISION TECHNOLOGY
Although Computer Vision and Machine Vision have similar characteristics, they
also have fundamental differences as follows:

• Unlike Computer Vision, which can work separately, Machine Vision oper-
ates as part of a “machine” system in the implementation of the general
business process.
• Although both technologies work on images, there are differences in the
implementation of these processes. Machine Vision acquires real-time
images with the help of cameras and sensors and analyzes these images
10 Machine Vision and Industrial Robotics in Manufacturing

to obtain useful information for decision-making. Computer Vision can


also work on images stored in memory or later loaded from a database or
other data carriers and can get useful information from them. Computer
Vision is the ability of computers to see because in addition to the real-time
mode, they can work with images and videos stored in memory (Khang &
Ragimova et al., 2024). In short, the main difference here is that Machine
Vision operates in real-time mode and requires live capture.
• Computer Vision is used to obtain general information about an object.
On the other hand, Machine Vision is mostly used to get information about
a specific part of an object.
• Machine Vision is sometimes referred to as a subset of Computer Vision.
This may be relatively true. In general, Machine Vision uses the capabilities
of Computer Vision to implement processes.

1.6 APPLICATION AREAS OF MACHINE VISION


The application areas of Machine Vision are as wide as those of Computer Vision
and they are shown in Figure 1.5.
Machine Vision and Computer Vision have similar advantages. With the help of
Machine Vision, processes in production are automated, the flexibility and sustain-
ability of the enterprise are increased, and product quality is improved. These pro-
cesses save both time and money and increase efficiency. Security is also ensured by
a high level of control and monitoring (Khang & Hajimahmud et al., 2024).

FIGURE 1.5 Illustration of the application areas of Machine Vision.


Role of Machine Vision in Manufacturing and Industrial Revolution 4.0 11

FIGURE 1.6 Machine Vision has several benefits in the areas where it is applied.

In addition, customer relations are improved. Timely preparation and delivery of


the customer’s order increases customer satisfaction, which helps maintain regular
customers and attract new ones. And, most importantly, the use of new technologies
and equipment becomes more convenient as they are integrated into the system. The
benefits of Machine Vision are similar to the positive aspects of Computer Vision as
shown in Figure 1.6.

1.7 FUTURE OF MACHINE VISION


The future of Machine Vision depends on the areas in which it is applied.

• The main impetus behind Machine Vision systems comes from the process
of automation. Automation will allow the vision process of Machine Vision
to be more accurate and more autonomous, or to make decisions without
human intervention. Currently, the system operates in a semi-autonomous
form (Khang & Shah et al., 2023).
• Machine Vision systems are known to work in real-time with real foot-
age. On the other hand, Computer Vision needs to improve this skill in the
future. The improvement of Big Data services in the future, especially for
the 5th Industrial Revolution, and its application in more areas will also
allow further development of Machine Vision (Khang & Hajimahmud
et al., 2024).

1.8 CONCLUSION
The creation of vision systems in computers and machines was one of the main rea-
sons that made technology more human-like. A vision system that works on specific
results and is mainly applied in industries is a Machine Vision system. Machine
Vision is known as a subset of general vision systems and is sometimes referred to
as Computer Vision. Machine Vision is an integrated system that performs the basic
12 Machine Vision and Industrial Robotics in Manufacturing

vision process of industrial equipment, technologies, and industrial robots. Its main
components are sensors, lighting systems, lenses, vision processing systems, and
communication systems (Khang & Abdullayev et al., 2024).
Machine Vision and Computer Vision are two technologies that are very similar
in both their advantages and application areas. However, there are certain differ-
ences which include:

• Machine Vision and Computer Vision are used for more specific purposes.
• Machine Vision works on real-time recording, while Computer Vision can
also work with images in memory. Computer Vision is closer to human
vision than Machine Vision.
• Unlike Computer Vision, Machine Vision is an integrated system. It cannot
function in isolation.

In the Net-Zero Emissions or “eco-friendly” era, the manufacturing industry of


the future must take various measures for an ecologically clean world. These are
possible with smart technologies. The manufacturing industry will undoubtedly
evolve further with the further integration of smart technologies. At this point, it is
necessary to go back in history. It is known that with the beginning of the Industrial
Revolution, the world entered a new era of development. Although it was a mainly
positive development, the Industrial Revolution also had some negative aspects. The
first of these was the pollution of the environment and, as a result, the increase of
diseases and the destruction of nature (Anh et al., 2024).
Smart Technologies are one of the solutions for environmental pollution, which is
one of the current global problems. These technologies which are available under the
eco-friendly label, Green Technology, have already begun to take their place in the
manufacturing industry for a clean future. And with that, the manufacturing industry
of the future is also starting to evolve as Green Manufacturing. Examples of Green
Technologies include solar panels, electric vehicles, recycling technologies, smart
meters, carbon capture, storage technologies, and others. The main goal of Green
Technology is to build a sustainable and clean world and a better future for humanity
(Khang & Rath et al., 2023).

REFERENCES
Anh, P. T. N., Vladimir, Hahanov, Triwiyanto, Ragimova, Nazila Ali, İsmibeyli, Rashad,
Hajimahmud, V. A., & Alyar, Abuzarova Vusala, “AI Models for Disease Diagnosis
and Prediction of Heart Disease with Artificial Neural Networks,” Computer Vision
and AI-Integrated IoT Technologies in Medical Ecosystem (1st Ed.). (2024). CRC Press.
https://doi.org/10.1201/9781003429609-9
Deac, Crina, Popa, Cicerone Laurentiu, Ghinea, Mihalache, & Cotet, C.E., (2017).
Machine Vision in Manufacturing Processes and the Digital Twin of Manufacturing
Architectures. In 28th DAAAM International Symposium on Intelligent Manufacturing
and Automation. https://doi.org/10.2507/28th.daaam.proceedings.103
Javaid, Mohd, Haleem, Abid, Singh, Ravi, Rab, Shanay, & Suman, Rajiv, (2021). Exploring
impact and features of Machine Vision for progressive Industry 4.0 culture. Sensors
International, 3, 100132. https://doi.org/10.1016/j.sintl.2021.100132
Role of Machine Vision in Manufacturing and Industrial Revolution 4.0 13

Kallen, Hanna, “Applications of Machine Vision Quality Control, Cancer Detection and
Traffic Surveillance,” Doctoral Theses in Mathematical Sciences (2016), PP: 1.
https://portal.research.lu.se/en/publications/applications-of-machine-vision-quality-
control-cancer-detection-a
Khang, A., Abdullayev, V., Hrybiuk, O., & Shukla, A.K., Computer Vision and AI-Integrated
IoT Technologies in the Medical Ecosystem (1st Ed.). (2024). CRC Press. https://doi.
org/10.1201/9781003429609
Khang, A., Ragimova, Nazila Ali, Bali, Sardarov Yaqub, Hajimahmud, V. A., Bahar,
Askarova, & Mehriban, Mammadova, “Using Big Data to Solve Problems in the Field of
Medicine,” Computer Vision and AI-integrated IoT Technologies in Medical Ecosystem
(1st Ed.) (2024). CRC Press. https://doi.org/10.1201/9781003429609-21
Khang, A., Vladimir, Hahanov, Litvinova, Eugenia, Chumachenko, Svetlana, Zoran,
Avromovic, İsmibeyli, Rashad, Ragimova, Nazila Ali, Hajimahmud, V. A., Alyar,
Abuzarova Vusala, & Anh, P.T.N., “Medical and BioMedical Signal Processing
and Prediction,” Computer Vision and AI-integrated IoT Technologies in Medical
Ecosystem (1st Ed.) (2024). CRC Press. https://doi.org/10.1201/9781003429609-7
Khang, A., Hajimahmud, V. A., Litvinova, Eugenia, Chumachenko, Svetlana, Abuzarova,
Vusala, & Anh, P. T. N., “Application of Computer Vision in the Healthcare Ecosystem,”
Computer Vision and AI-integrated IoT Technologies in Medical Ecosystem (1st Ed.)
(2024). CRC Press. https://doi.org/10.1201/9781003429609-1
Khang, A., Rath, Kali Charan, Kumar Satapathy, Suresh, Kumar, Amaresh, Ranjan
Das, Sudhansu, & Ranjan Panda, Manas, “Enabling the Future of Manufacturing:
Integration of Robotics and IoT to Smart Factory Infrastructure in Industry 4.0,”
AI-Based Technologies and Applications in the Era of the Metaverse (1st Ed.) (2023).
Pages (25–50). IGI Global Press. https://doi.org/10.4018/978-1-6684-8851-5.ch002
Khang, A., Shah, V., & Rani, S., AI-Based Technologies and Applications in the Era of the
Metaverse (1st Ed.) (2023). IGI Global Press. https://doi.org/10.4018/978-1-6684-8851-5
Liao, Wei, & Pei, Xiao. (2011). Research and application of machine vision in industry.
Advanced Engineering Forum, 2–3, 153–155. https://doi.org/10.4028/www.scientific.
net/AEF.2-3.153
Sandoval, Ernesto, Martinez-Rosas, Miguel Enrique, Martínez Sandoval, Jesús Raúl,
Miranda Velasco, Manuel Moises, & de Ávila, Humberto Cervantes. (2018). Machine
Vision Systems - A Tool for Automatic Color Analysis in Agriculture. 10.5772/
intechopen.71935.
Yasar, Kinza, & Lutkevich, Ben. Machine Vision. (2023). https://www.techtarget.com/
searchenterpriseai/definition/machine-vision-computer-vision
2 Role of Computer
Vision in Manufacturing
Industry
Mohd Umar, Mahima Gupta, Rajat Verma,
and Namrata Dhanda

2.1 INTRODUCTION
In today’s era where automation and efficiency are paramount, computer vision has
emerged as a fundamental technology for enhancing productivity and quality control
in manufacturing processes. This chapter provides a comprehensive understanding
of computer vision, its underlying principles, and its core components. It explores
the wide range of applications where computer vision is extensively employed in
manufacturing, including quality inspection, defect detection, and robotic guidance
and control. The integration of computer vision with Artificial Intelligence (AI) and
Machine Learning (ML) is also examined, showcasing the advanced functionalities
enabled by this combination.
The chapter addresses the challenges and considerations in implementing com-
puter vision solutions in manufacturing, such as lighting conditions and occlusions,
and discusses techniques to overcome these challenges. Furthermore, it discusses
future trends and emerging technologies in computer vision for manufacturing, such
as 3D vision and collaborative robotics, which are expected to revolutionize manu-
facturing processes. Overall, this chapter serves as a valuable resource for profes-
sionals in the field, providing insights into the role of computer vision in enhancing
automation, quality control, and overall efficiency in manufacturing.

2.2 COMPUTER VISION


Computer vision is a multidisciplinary field that encompasses various principles and
components to enable machines to understand and interpret visual information. This
section will delve into the fundamental aspects of computer vision systems, includ-
ing their underlying principles and core components (Sokolowski and Banks, 2011).
The key components of computer vision are highlighted in Figure 2.1.

2.2.1 Background of Computer Vision


To grasp the essence of computer vision, it is important to define it and understand
its principles. Computer vision can be defined as a field of study that focuses on
enabling computers to extract meaningful information from digital images or video.
14 DOI: 10.1201/9781003438137-2
Role of Computer Vision in Manufacturing Industry 15

FIGURE 2.1 Key components of computer vision processes.

It involves the development of algorithms and techniques that mimic human visual
perception, allowing machines to recognize, analyze, and interpret visual data
(Verno et al., 2011).
The principles of computer vision are based on understanding the structure and
characteristics of visual information. This includes aspects such as color, texture,
shape, motion, and spatial relationships. By analyzing these visual cues, computer
vision systems can extract valuable information and make intelligent decisions
(Kruger, 2013).

2.2.2 Core Components of Computer Vision


Computer vision systems consist of several core components that work together to
process and analyze visual data. These components are crucial for the effective func-
tioning of computer vision systems and include:

• Image Acquisition: This component captures visual data using various


devices such as cameras, sensors, or scanners. Image acquisition techniques
ensure that the captured data is suitable for further processing (Vora et al.,
2001). The process of image acquisition is illustrated in Figure 2.2.
Initially, the object’s image is captured, then it is digitized for further
processing, then the relevant information is extracted from the digitized
data, and then the information is utilized by the system according to the
task assigned to the system by the user.
• Preprocessing: Once the visual data is acquired, it often undergoes pre-
processing to enhance its quality and remove noise or irrelevant informa-
tion. Preprocessing techniques may include image filtering, noise reduction,
image enhancement, and image normalization (Kumar and Bhatia, 2014).
16 Machine Vision and Industrial Robotics in Manufacturing

FIGURE 2.2 Computer vision image acquisition.

• Feature Extraction: Feature extraction aims to identify and extract rele-


vant features from the preprocessed data. Features can be specific patterns,
edges, textures, or other visual attributes that hold valuable information for
subsequent analysis (Pradhan et al., 2018).
• Object Recognition: Object recognition is a critical component of com-
puter vision systems. It involves identifying and classifying objects or
patterns within an image or video sequence. Techniques such as template
matching, statistical modeling, and ML algorithms are commonly used for
object recognition (Brunelli, 2009).

By understanding these core components of computer vision systems, researchers


who are working in this field can lay the foundation for exploring their applications
and capabilities in the manufacturing sector. These components collectively enable
machines to perceive and interpret visual data, paving the way for enhanced automa-
tion, quality control, and decision-making in manufacturing processes.

2.3 APPLICATIONS OF COMPUTER VISION IN INDUSTRIES


Computer vision has found extensive usage in the manufacturing sector, transform-
ing various aspects of production and quality control. In this section, we will explore
diverse applications where computer vision plays a crucial role in enhancing effi-
ciency and ensuring product excellence (Bogue, 2005). The applications of computer
vision are shown in Figure 2.3.

2.3.1 Quality Inspection


One of the primary applications of computer vision in manufacturing is quality
inspection and defect detection. Computer vision systems can analyze visual data
to identify defects, anomalies, or deviations from desired specifications in products.
Role of Computer Vision in Manufacturing Industry 17

FIGURE 2.3 Computer vision applications.

By comparing captured images with reference images or predefined criteria, com-


puter vision algorithms can detect surface defects, dimensional variations, and other
imperfections with high precision and accuracy. This enables manufacturers to
ensure consistent product quality, minimize defects, and reduce the risk of faulty
products reaching the market (Park and Jeong, 2022).
2.3.1.1 Importance of Quality Inspection
Quality inspection is a critical aspect of the manufacturing process, ensuring that
products meet predefined standards and specifications. Computer vision plays a vital
role in automating and enhancing the quality inspection process, enabling efficient
and accurate detection of defects (Patel et al., 2011).
2.3.1.2 Defect Detection Algorithms
Computer vision algorithms are designed to detect and classify various types of
defects. These algorithms leverage ML techniques, such as supervised and unsuper-
vised learning, to train models on large datasets of labeled defect images (Verma &
Mishra et al., 2021). Computers can detect defects in varied materials, textures, and
shapes, ensuring comprehensive defect detection across a wide range of products
(Bergmann et al., 2021).

2.3.1.3 Non-Destructive Testing


Computer vision techniques are extensively used in non-destructive testing (NDT)
methods, such as visual inspection, thermal imaging, X-ray imaging, and ultrasonic
imaging (Okarma and Fastowicz, 2019). These methods enable the detection of inter-
nal defects or hidden anomalies without damaging the product, making them valu-
able for quality control in industries like automotive, aerospace, and electronics.

• Computer vision enables inspecting and evaluating materials, components,


and structures without causing damage or altering their integrity.
18 Machine Vision and Industrial Robotics in Manufacturing

• Various techniques are used in computer vision-based NDT, including


visual inspection, thermal imaging, X-ray imaging, and ultrasound imaging.
• Computer vision algorithms and systems analyze visual data to detect
defects, anomalies, cracks, and other irregularities in the inspected materi-
als or products.
• NDT using computer vision is extensively used in industries such as aero-
space, automotive, electronics, and construction to ensure product quality,
safety, and reliability.
• Computer vision-based NDT systems offer advantages like real-time inspec-
tion, high accuracy, repeatability, and automation, improving efficiency and
reducing human error.
• Integration of AI and ML techniques with computer vision in NDT enables
intelligent defect detection, automated decision-making, and predictive
maintenance.
• Computer vision-based NDT techniques can be applied to various materi-
als, including metals, composites, ceramics, and polymers, expanding their
applicability in diverse manufacturing processes.
• NDT using computer vision contributes to cost savings by identifying
defects early in the production process, minimizing scrap, rework, and
potential product failures.
• Continuous advancements in computer vision algorithms, imaging technol-
ogies, and data processing techniques drive the evolution of NDT, ensur-
ing safer and more reliable products in the manufacturing industry (Verma
et al., 2023b).

2.3.1.4 Advancements in Defect Classification and Localization


Recent advancements in computer vision have focused on improving defect classifi-
cation and localization capabilities. Deep learning algorithms, such as convolutional
neural networks (CNNs), have shown remarkable performance in accurately clas-
sifying defects and precisely localizing their positions within a product (Singh and
Desai, 2022).
Computer vision plays a vital role in quality inspection and defect detection in
manufacturing. It enables automated visual inspection, defect detection algorithms,
real-time quality control, and NDT. Advancements in defect classification, localiza-
tion, and integration with robotic systems further enhance the capabilities of com-
puter vision in ensuring high-quality products and efficient manufacturing processes
(Dong et al., 2022).

2.3.2 Precise Measurement and Metrology


Computer vision plays a vital role in precise measurement and metrology within
manufacturing processes. By leveraging advanced algorithms, computer vision sys-
tems can accurately measure dimensions, distances, angles, and other physical prop-
erties of products or components. This capability eliminates the need for manual
measurements and reduces human errors, ensuring precise adherence to design spec-
ifications. Computer vision-based metrology is particularly valuable in industries
Role of Computer Vision in Manufacturing Industry 19

where precision is critical, such as aerospace, automotive, and electronics manufac-


turing (Razdan and Bateman, 2015).

2.3.2.1 Non-Contact Measurement Techniques


Computer vision enables non-contact measurement techniques that eliminate the
need for physical contact with the object being measured. This reduces the risk of
damage or deformation and allows for the measurement of delicate or complex sur-
faces. Techniques such as stereo vision, structured light, and laser scanning capture
detailed 3D information for precise measurements (Zhou et al., 2022).

2.3.2.2 Dimensional and Geometric Measurements


Computer vision-based systems can accurately measure dimensional parameters
such as the length, width, height, and diameter of objects. Additionally, comput-
ers can perform geometric measurements, including angles, curves, and contours,
enabling comprehensive characterization of complex shapes and profiles (Malamas
et al., 2003).

2.3.2.3 High-Speed and Real-Time Measurements


Computer vision enables high-speed and real-time measurement capabilities, allow-
ing for efficient quality control in manufacturing processes. These systems can
rapidly capture and analyze visual data, providing instant feedback and enabling
prompt adjustments or corrections during production (Li et al., 2022).

2.3.2.4 Integration with Automation System


Advanced metrology software and analysis tools complement computer vision sys-
tems, facilitating data processing, analysis, and visualization. These tools enable
statistical analysis, geometric feature extraction, and comparison with design
specifications, ensuring precise measurement and compliance with tolerance limits
(Malamas et al., 2003).

2.3.2.5 Metrology Software and Analysis Tool


Computer vision-based measurement systems can be seamlessly integrated with
automation systems, enabling automatic measurement and feedback control. This
integration enhances manufacturing efficiency, reduces manual intervention, and
enables real-time adjustments based on measurement results (Gašpar et al., 2020).
Computer vision technology has significantly advanced precise measurement and
metrology in manufacturing. Its non-contact measurement techniques, accuracy
enhancement through calibration, high-speed capabilities, and integration with auto-
mation systems have transformed the way measurements are conducted. Manufacturers
can ensure product quality, optimize production processes, and enhance overall effi-
ciency by leveraging computer vision for precise measurement (Shang et al., 2022).

2.3.3 Robotic Guidance and Control


Computer vision enables precise robotic guidance and control in manufacturing
environments. By equipping robotic systems with vision sensors (Verma et al.,
20 Machine Vision and Industrial Robotics in Manufacturing

2022a), robots can perceive and interpret the surrounding environment and precise
movement. Computer vision-based guidance enables robots to perform complex
tasks such as pick-and-place operations, assembly tasks, and object manipulation
with high accuracy and dexterity (Javaid et al., 2022). This not only improves effi-
ciency, but it also enables flexible automation where robots can adapt to variations in
product positioning, orientation, or shape (Malamas et al., 2003).

2.3.3.1 Adaptive and Precise Movement


Adaptive and precise movement in robotic systems refers to the ability of robots to
dynamically adjust their motions based on real-time data. By equipping robots with
computer vision capabilities, robots can perceive their surroundings, interpret infor-
mation, and make precise and accurate movements accordingly. The use of computer
vision helps us with the following:

• Real-time analysis of visual data.


• Adaptive movement based on environmental changes.
• Achieving precise and accurate robotic control.

2.3.3.2 Complex Task Execution


Complex task execution involves various aspects such as object identification, local-
ization, and planning. Computer vision facilitates these capabilities by enabling
robots to identify objects, estimate their positions and orientations, and plan the nec-
essary actions for the efficient execution of tasks. This level of control and under-
standing of the environment enables robots to perform intricate tasks with accuracy
and dexterity (Ekvall and Kragic, 2008).

2.3.3.3 Flexible Automation


Flexible automation refers to the ability of robotic systems to adapt and respond
to variations in product positioning, orientation, or shape, as well as changes in
the manufacturing environment. By incorporating computer vision, robots can ana-
lyze visual data in real time, allowing them to adjust their movements and actions
accordingly. This adaptability enables robots to handle diverse and dynamic manu-
facturing scenarios, enhancing productivity, versatility, and efficiency in automated
processes.

2.3.4 Visual Inspection and Pattern Recognition


Computer vision systems excel at visual inspection and pattern recognition in manu-
facturing. Computers can analyze complex visual patterns, textures, and shapes to
identify specific features or patterns of interest. This capability is valuable in appli-
cations such as barcode reading, label verification, part identification, and pattern
matching. Computer vision algorithms can quickly and accurately identify objects,
components, or markings, enabling efficient sorting, tracking, and traceability in
manufacturing processes (Malamas et al., 2003). The process of pattern recognition
is depicted in Figure 2.4.
Role of Computer Vision in Manufacturing Industry 21

FIGURE 2.4 Pattern recognition process.

2.3.4.1 Automated Visual Inspection


Automated visual inspection harnesses the capabilities of computer vision to accom-
plish the following:

• Utilizing computer vision algorithms for automated inspection of manufac-


tured products.
• Detection of defects, flaws, and inconsistencies in the visual appearance of
products.
• Real-time analysis of images to identify deviations from predefined stan-
dards or specifications (Lucas et al., 2012).
2.3.4.2 Defect Detection and Classification
Defect detection and classification through computer vision are achieved through
the following:

• Using computer vision to detect and classify various types of defects


(Sun et al., 2019)
• Training algorithms to recognize patterns associated with different defect
categories
• Accurate identification of defects such as cracks, scratches, dents, and sur-
face irregularities
2.3.4.3 Pattern Recognition
Pattern recognition in computer vision involves:

• Leveraging computer vision to recognize and classify complex patterns and


features (Bhatt et al., 2021).
• Training algorithms to identify specific patterns, logos, or symbols on products.
• Enabling efficient quality control by verifying the presence and accuracy
of patterns.

2.3.4.4 Optical Character Recognition


Optical character recognition (OCR) is a technology that enables the conversion of
printed or handwritten text into machine-readable and editable formats. It involves
the use of computer vision techniques for the following:

• To extract and interpret text from images (Mahadas et al., 2023).


• For reading and recognizing characters, numbers, and symbols on products
or labels.
• For facilitating automated data extraction, labeling, and tracking in manu-
facturing processes.
22 Machine Vision and Industrial Robotics in Manufacturing

2.3.4.5 Real-Time Monitoring and Quality Assurance


Real-time monitoring and quality assurance in various industries benefit from com-
puter vision technology due to its ability to provide accurate and efficient visual
analysis. Computer vision enables real-time monitoring by:

• Continuously analyzing visual data to ensure quality standards are met.


• Providing immediate feedback and alerts for deviations or potential issues
(Scime and Beuth, 2018).
• Rapidly identifying quality issues, such as product defects, inconsistencies,
or irregularities.

Computer vision-based visual inspection and pattern recognition offer numerous


advantages in manufacturing. Computers improve the accuracy and reliability of
inspection processes, reduce human error, and enable faster detection and resolution
of quality-related issues. Additionally, the integration of computer vision with ML
techniques allows for continuous improvement and adaptation of inspection algo-
rithms, enhancing their performance over time (Konstantinidis et al., 2021).
By relying on computer vision for visual inspection and pattern recognition, man-
ufacturers can achieve consistent and reliable quality control, streamline produc-
tion processes, and deliver high-quality products to customers. The combination of
advanced image processing algorithms and real-time analysis capabilities ensures
efficient and effective monitoring of manufacturing operations, contributing to over-
all productivity and customer satisfaction (Abualsauod, 2023).

2.3.5 Augmented Reality and Virtual Reality Integration


Computer vision plays a crucial role in integrating Augmented Reality (AR) and
Virtual Reality (VR) technologies into manufacturing (Shukla et al., 2023). By com-
bining computer vision with AR/VR, manufacturers can create immersive and inter-
active experiences for tasks such as product design, assembly guidance, training, and
maintenance. Computer vision enables the recognition of real-world objects and envi-
ronments, facilitating the overlay of virtual information or simulations onto physical
objects, enhancing visualization, and improving decision-making (Li et al., 2018).
The applications mentioned above are just a glimpse of the wide range of pos-
sibilities that computer vision brings to the manufacturing `sector. By harnessing the
power of computer vision, manufacturers can achieve higher efficiency, improved
product quality, and enhanced automation, and they can gain a competitive edge in
the market (Khang & Hajimahmud et al., 2024).

2.3.6 Surveillance Using Computer Vision


Computer vision technology has significantly transformed the field of surveillance,
enabling advanced monitoring and analysis of visual data. By leveraging sophisti-
cated algorithms and ML techniques, computer vision enhances surveillance sys-
tems’ capabilities, providing accurate and efficient monitoring in various settings.
Role of Computer Vision in Manufacturing Industry 23

2.3.6.1 Object Detection and Tracking


Computer vision allows the detection and tracking of objects of interest in surveil-
lance footage. Using techniques like object detection algorithms and motion track-
ing, computer vision systems can identify and track individuals, vehicles, or specific
objects, enabling real-time monitoring and analysis.

2.3.6.2 Intrusion and Activity Recognition


Computer vision-based surveillance systems can analyze video feeds to identify and
recognize unauthorized intrusions or suspicious activities. By applying pattern rec-
ognition and anomaly detection algorithms, these systems can alert security person-
nel to potential threats or abnormal behavior, enhancing the overall security of the
monitored area (Verma et al., 2022c).

2.3.6.3 Facial Recognition


Facial recognition technology in computer vision enables the identification and veri-
fication of individuals captured in surveillance footage. By comparing facial features
against a database of known identities, it can assist in identifying persons of interest,
enhancing security, and aiding in investigations (Verma et al., 2023b).

2.3.6.4 Crowd Monitoring and Crowd Management


Computer vision-based surveillance systems can analyze crowd dynamics, including
crowd density, flow, and behavior patterns. This information is valuable for crowd
management during large events, public spaces, or critical infrastructures, helping
ensure safety, detect potential crowd-related incidents, and optimize crowd flow
(Verma et al., 2022a).

2.3.6.5 Event Detection and Alarm Generation


Computer vision algorithms can analyze video streams in real-time to detect specific
events or activities, such as accidents, objects left behind, or unauthorized access.
When such events are identified, the system can generate alarms or notifications,
enabling rapid response and intervention.

2.3.6.6 Video Analytics and Forensics


Computer vision-based surveillance systems offer advanced video analytics and
forensics capabilities. This includes video summarization, object tracking across
multiple cameras, and post-event analysis for investigative purposes, providing valu-
able insights and evidence (Anh et al., 2024).

2.4 INTEGRATION OF COMPUTER VISION WITH AI AND ML


The integration of Computer Vision with Artificial Intelligence (AI) and Machine
Learning (ML) revolutionizes the capabilities of visual systems in manufacturing
(Verma et al., 2022b). By combining the power of computer vision algorithms with
AI and ML techniques, manufacturers can achieve advanced object tracking, pat-
tern recognition, and adaptive decision-making, leading to improved accuracy and
efficiency in production processes. Deep learning algorithms further enhance the
24 Machine Vision and Industrial Robotics in Manufacturing

robustness and adaptability of computer vision systems, paving the way for intel-
ligent and automated manufacturing environments (Baduge et al., 2022).

2.4.1 Synergies between Computer Vision, AI, and ML


Computer vision, AI, and ML are closely intertwined and mutually beneficial
fields. When integrated, they enhance the capabilities of computer vision systems,
enabling advanced functionalities and intelligent decision-making in manufacturing
(Kotsiopoulos et al., 2021).
By combining computer vision with AI and ML techniques, manufacturers can
develop systems that go beyond simple image processing. AI and ML algorithms
enable computers to learn from data, recognize patterns, and make informed deci-
sions based on visual information. This integration allows computer vision systems
to adapt, improve, and handle complex scenarios (Benbarrad et al., 2021).

2.4.2 Object Tracking, Pattern Recognition,


and Adaptive Decision-Making

One key application of integrating computer vision with AI and ML is object track-
ing. Computer vision algorithms, combined with AI techniques, can track objects in
real-time, even in challenging scenarios such as occlusions or varying appearances.
Machine Learning models can be trained to recognize and track specific objects of
interest, enabling applications like automated robotic picking and sorting in manu-
facturing environments (Yang et al., 2020).
Pattern recognition is another area where the synergy of computer vision and AI
shines. By leveraging ML algorithms, computer vision systems can learn to recog-
nize and classify complex patterns in visual data. This capability is useful for tasks
such as identifying defects on product surfaces, detecting anomalies in production
lines, or recognizing specific components or features during assembly processes
(Mesbah and Graves, 2019).
Furthermore, the integration of AI and ML enables adaptive decision-making
in computer vision systems. By continuously analyzing visual data and learn-
ing from past experiences, these systems can dynamically adjust their decision-
making processes based on changing conditions or new information. Adaptive
decision-making enhances the flexibility and responsiveness of computer vision
systems, improving their ability to handle dynamic manufacturing environments
(Sarker, 2021).

2.4.3 Deep Learning Algorithms for Improved Accuracy and Robustness


Deep learning, a subfield of ML, has garnered significant attention in recent years
for its ability to extract intricate patterns and features from visual data. Deep learn-
ing algorithms, such as CNNs, have demonstrated remarkable performance in vari-
ous computer vision tasks (Arel et al., 2010). When integrated with computer vision
in manufacturing, deep learning algorithms contribute to improved accuracy and
robustness. Computers excel at tasks like object recognition, image segmentation,
Role of Computer Vision in Manufacturing Industry 25

and scene understanding. Deep learning models can automatically learn relevant
features from large datasets, enabling better generalization and adaptability to dif-
ferent manufacturing scenarios (Zhang et al., 2016).
Moreover, deep learning algorithms can handle complex visual data representa-
tions, such as high-resolution images or 3D data, which are common in manufactur-
ing applications. Their hierarchical architectures allow them to extract and analyze
multiple levels of abstraction, leading to a more comprehensive and nuanced under-
standing of visual information. By integrating deep learning algorithms into com-
puter vision systems, manufacturers can achieve higher accuracy in quality control,
more reliable defect detection, and improved performance in various visual inspec-
tion tasks. These advancements contribute to increased automation, enhanced pro-
ductivity, and overall efficiency in manufacturing processes (Khang & Hajimahmud
et al., 2024).
The integration of computer vision with AI and ML opens up a world of pos-
sibilities for intelligent and automated manufacturing systems. By leveraging the
synergies between these fields, manufacturers can develop sophisticated solutions
that improve accuracy, adaptability, and decision-making capabilities, driving the
industry toward a future of smarter and more efficient production (Gupta et al.,
2021).

2.5 CHALLENGES AND CONSIDERATIONS IN COMPUTER VISION


Implementing computer vision solutions in the manufacturing sector comes with
various challenges and considerations. This section explores the key factors that
need to be addressed for the successful deployment of computer vision systems and
highlights important considerations for achieving optimal performance and reliabil-
ity (Huang et al., 2021).

2.5.1 Lighting Conditions and Environment


Effective computer vision in manufacturing heavily relies on appropriate lighting
conditions and a well-controlled environment. Lighting conditions and environ-
mental factors can significantly impact the performance and reliability of com-
puter vision systems. Understanding and addressing these challenges are essential
for the successful implementation of manufacturing processes (Batchelor and
Waltz, 2001).

2.5.1.1 Lighting Uniformity and Intensity


Lighting uniformity and intensity are crucial in computer vision applications because
they ensure the following:

• Consistent and uniform lighting across the manufacturing environment.


• Avoiding shadows, reflections, or glare that can hinder accurate image
acquisition.
• Employing techniques such as diffusers, filters, or directed lighting to opti-
mize illumination.
26 Machine Vision and Industrial Robotics in Manufacturing

2.5.1.2 Variable Lighting Conditions


Variable lighting conditions pose a challenge for computer vision systems in manu-
facturing because, in order to get accurate results, the computer has to manage:

• Variations in lighting conditions due to natural light, artificial light, or


dynamic production settings.
• Implementation of adaptive algorithms that can adjust to changes in light-
ing conditions in real-time.
• Using techniques like image normalization or dynamic thresholding to
compensate for lighting variations (Junaid et al., 2023).

2.5.1.3 Environmental Disturbances


Environmental disturbances pose significant challenges in computer vision applica-
tions, but the following effective management strategies can mitigate their impact.

• Calibration and normalization techniques help to account for variations


in lighting conditions, ensuring consistent image quality and reducing the
impact of lighting changes.
• Implementing protective measures to minimize the impact of environmen-
tal disturbances on vision sensors.
• Utilizing image preprocessing techniques like noise reduction or image sta-
bilization to improve image quality.

Addressing the challenges posed by lighting conditions and the manufacturing


environment is crucial for the successful deployment of computer vision systems.
By implementing appropriate strategies, such as optimal lighting setups, adaptive
algorithms, and robust calibration procedures, manufacturers can overcome these
challenges and ensure reliable and accurate visual analysis in their manufacturing
processes. Additionally, ongoing monitoring and maintenance of the vision system’s
performance and environmental conditions are essential to ensure sustained effec-
tiveness and optimal outcomes.

2.5.2 Occlusions and Complex Scenes


Manufacturing environments often involve occlusions, where objects or parts may
partially or fully obscure each other. Computer vision systems must be capable of
handling occlusions and accurately detecting and recognizing objects of interest,
even in complex scenes. Advanced algorithms, such as multiview reconstruction or
3D point cloud analysis, can help overcome occlusion challenges and enable robust
object detection and tracking (Brunetti et al., 2018).

2.5.2.1 Challenges of Occlusions and Complex Scenes


Occlusions are a common occurrence in computer vision, where objects of interest
are partially or completely obstructed by other objects in the scene. Understanding
and handling occlusions poses significant challenges in various computer vision
tasks. Occlusions can occur due to object–object interactions, self-occlusions, or
Role of Computer Vision in Manufacturing Industry 27

occlusions caused by the scene geometry. Dealing with occlusions becomes even
more complex in scenes with multiple objects and cluttered backgrounds (Cuhadar
and Tsao, 2022).
In computer vision applications such as object detection, tracking, and scene
reconstruction, occlusions can lead to inaccurate or incomplete results. Occlusions
disrupt the continuity of object boundaries and introduce ambiguities in feature
matching, making it difficult to reliably track objects or reconstruct scene geom-
etry. Furthermore, occlusions can cause object misclassification and hinder accurate
depth estimation, affecting the overall understanding and interpretation of complex
scenes (Khang & Ragimova et al., 2024).

2.5.2.2 Occlusion Handling Techniques


Researchers have developed various techniques to address the challenges posed
by occlusions in computer vision. Depth-based occlusion reasoning is a common
approach where depth information is used to reason about occlusions and infer the
presence of occluding objects. This helps in estimating the occluded regions and
recovering the complete shape and structure of objects (Chandel and Vatta, 2015).
Occlusion boundary detection and segmentation methods aim to identify occlusion
boundaries by analyzing image features, such as color, texture, or motion disconti-
nuities. These boundaries help separate occluded and occluding objects, enabling
better object detection and tracking. Contextual information, such as object relation-
ships and scene understanding, is often utilized to handle occlusions. By leveraging
the context, the system can infer occluded parts based on the knowledge of the scene
and the objects involved (Khang & Vladimir et al., 2024).
Temporal consistency plays a crucial role in occlusion handling, especially in
video sequences or dynamic scenes. Tracking algorithms that maintain temporal
coherence and exploit object motion information can help handle occlusions by pre-
dicting object positions even when sensors are temporarily occluded. These tech-
niques ensure the continuity and smoothness of object trajectories, improving the
overall tracking performance in complex scenes.

2.5.2.3 Object Detection and Tracking in Complex Scenes


Object detection and tracking in complex scenes with occlusions require special-
ized algorithms. Multiobject tracking models explicitly handle occlusion events
and association relationships between objects. Fusion of visual cues with other sen-
sor modalities improves occlusion handling. Deep learning-based approaches with
occlusion-aware models and loss functions enhance occlusion recognition and gen-
eralization in complex scenes (Sivaraman and Trivedi, 2013).

2.5.2.4 Scene Reconstruction and Structure from Motion


Occlusions pose challenges in scene reconstruction and structure from motion tasks.
Techniques that consider occlusions during the reconstruction process leverage mul-
tiple viewpoints and reasoning algorithms to estimate the accurate depth and recover
occluded structures. Structures from motion algorithms face difficulties in maintain-
ing feature correspondences and reconstructing complete scenes in the presence of
occlusions (Furukawa and Ponce, 2010).
28 Machine Vision and Industrial Robotics in Manufacturing

Occlusions pose challenges of complex scenes in computer vision tasks. They


also present various techniques and approaches to addressing occlusion handling,
object detection and tracking, scene reconstruction, and structure from motion in
the context of complex scenes. By understanding and overcoming these challenges,
computer vision systems can achieve more accurate and robust performance in
diverse real-world scenarios.

2.5.3 Perspective and Viewpoint Variations


Manufacturing processes may involve variations in perspective or viewpoint, espe-
cially when dealing with objects moving along assembly lines or robotic manip-
ulations. Computer vision systems need to account for these variations and can
handle object detection, recognition, and pose estimation from different viewpoints.
Techniques such as camera calibration, 3D modeling, and pose estimation algo-
rithms can aid in addressing these challenges (Pérez et al., 2016).

2.5.4 Calibration and System Integration


Calibration is a critical aspect of computer vision systems in manufacturing. It
involves aligning and calibrating cameras, sensors, and other hardware components
to ensure accurate measurements and consistent performance. Proper calibration
techniques, along with effective system integration, are essential for reliable and pre-
cise computer vision-based applications in manufacturing. This includes synchroni-
zation of multiple cameras, sensor fusion, and data integration with other systems or
automation platforms (Botterill et al., 2011).

2.5.5 Training Data and Machine Learning


To achieve optimal performance, computer vision algorithms often require exten-
sive training on relevant data. Collecting and annotating high-quality training
datasets can be time-consuming and resource-intensive. Additionally, selecting
appropriate ML algorithms, such as CNNs or deep learning architectures, and
fine-tuning them for specific manufacturing applications is crucial. Careful con-
sideration of training data quantity, quality, and diversity, as well as algorithm
selection and optimization, is essential for successful implementation (Nath and
Behzadan, 2019).

2.5.6 Real-Time Performance and Computational Requirements


Many manufacturing processes require real-time or near-real-time analysis and deci-
sion-making. Computer vision systems must meet stringent performance require-
ments while considering the computational resources available. Efficient algorithm
design, hardware acceleration techniques, such as graphics processing units (GPUs)
or field programmable gate arrays (FPGAs), and optimization strategies play a vital
role in achieving real-time performance in computationally demanding applications
(Pulli et al., 2012).
Role of Computer Vision in Manufacturing Industry 29

By addressing these challenges and considerations, manufacturers can overcome


hurdles in implementing computer vision solutions effectively. It is crucial to care-
fully analyze the specific manufacturing requirements, tailor the computer vision
system accordingly, and continually evaluate and fine-tune the system to ensure opti-
mal performance and reliability in practical manufacturing environments.

2.6 FUTURE TRENDS AND EMERGING TECHNOLOGIES


IN COMPUTER VISION FOR MANUFACTURING
As the manufacturing landscape evolves, future trends and emerging technologies
in computer vision hold immense potential for transforming the industry. From 3D
vision and multispectral imaging to collaborative robotics and edge computing, these
advancements offer new opportunities for enhanced automation, quality control, and
efficiency in manufacturing processes. By staying at the forefront of these develop-
ments, manufacturers can harness the power of computer vision to drive innovation
and maintain a competitive edge in the evolving manufacturing sector (Verma et al.,
2020; Khang & Shah et al., 2023).

2.6.1 Advancements in 3D Vision
In the realm of computer vision for manufacturing, advancements in 3D vision tech-
nology are driving significant developments. Traditional 2D imaging techniques
have limitations when it comes to capturing depth information, which is crucial for
various manufacturing tasks (Khang & Rath et al., 2023). However, with the inte-
gration of 3D vision techniques such as stereo vision, structured light systems, or
Time-of-Flight (ToF) cameras, computer vision systems can obtain richer and more
accurate spatial information. This opens up a wide range of applications in manu-
facturing including:

• 3D Object Inspection: 3D vision allows for precise and detailed inspection


of objects, enabling manufacturers to detect defects, measure dimensions,
and ensure quality control with higher accuracy (Zhang et al., 2023).
• Robotic Manipulation: By incorporating the 3D vision, robots can per-
ceive the environment in three dimensions, improving their ability to grasp
objects, navigate complex spaces, and perform tasks such as pick-and-place
operations with increased efficiency and reliability.
• Virtual Assembly Simulations: 3D vision facilitates virtual assembly
simulations, where components can be digitally fitted and tested for proper
alignment and functionality, reducing errors and optimizing assembly
processes.

2.6.2 Multispectral Imaging


Multispectral imaging is an emerging technology that holds great promise for
computer vision in manufacturing. By capturing and analyzing images at different
wavelengths beyond the visible spectrum, multispectral imaging provides valuable
Random documents with unrelated
content Scribd suggests to you:
The Project Gutenberg eBook of Gettysburg:
Stories of the Red Harvest and the Aftermath
This ebook is for the use of anyone anywhere in the United
States and most other parts of the world at no cost and with
almost no restrictions whatsoever. You may copy it, give it away
or re-use it under the terms of the Project Gutenberg License
included with this ebook or online at www.gutenberg.org. If you
are not located in the United States, you will have to check the
laws of the country where you are located before using this
eBook.

Title: Gettysburg: Stories of the Red Harvest and the Aftermath

Author: Elsie Singmaster

Release date: March 14, 2017 [eBook #54358]


Most recently updated: October 23, 2024

Language: English

Credits: E-text prepared by Barry Abrahamsen and the Online


Distributed Proofreading Team (http://www.pgdp.net)
from page images generously made available by
Internet Archive (https://archive.org)

*** START OF THE PROJECT GUTENBERG EBOOK GETTYSBURG:


STORIES OF THE RED HARVEST AND THE AFTERMATH ***
The Project Gutenberg eBook, Gettysburg, by Elsie Singmaster

Note: Images of the original pages are available through Internet


Archive. See
https://archive.org/details/gettysburgstorie00insing
By Elsie Singmaster

GETTYSBURG. Illustrated

WHEN SARAH WENT TO SCHOOL. Illustrated.


12mo, $1.00.

WHEN SARAH SAVED THE DAY. Illustrated.


12mo, $1.00.

HOUGHTON MIFFLIN COMPANY


Boston and New York
GETTYSBURG
A BATTLE IS TO BE FOUGHT HERE
GETTYSBURG

STORIES
OF THE RED HARVEST
AND THE AFTERMATH

BY
ELSIE SINGMASTER

BOSTON AND NEW YORK


HOUGHTON MIFFLIN COMPANY
1913
COPYRIGHT, 1907, BY CHARLES SCRIBNER'S SONS
COPYRIGHT, 1907, 1909, 1911 AND 1912, BY HARPER AND
BROTHERS
COPYRIGHT, 1909, BY J. B. LIPPINCOTT COMPANY
COPYRIGHT, 1909, BY THE S. S. McCLURE CO.
COPYRIGHT, 1913, BY ELSIE SINGMASTER LEWARS

ALL RIGHTS RESERVED

Published April 1913


TO MY FATHER
JOHN ALDEN SINGMASTER, D.D.
THIS BOOK IS AFFECTIONATELY
DEDICATED
1863-1913

Four Score and seven years ago our fathers brought forth on this
continent, a new nation, conceived in Liberty; and dedicated to the
proposition that all men are created equal.
Now we are engaged in a great civil war, testing whether that
nation, or any nation so conceived and so dedicated, can long
endure. We are met on a great battle-field of that war. We have
come to dedicate a portion of that field, as a final resting place for
those who here gave their lives that that nation might live. It is
altogether fitting and proper that we should do this.
But in a larger sense, we cannot dedicate—we cannot consecrate—
we cannot hallow—this ground. The brave men, living and dead,
who struggled here, have consecrated it, far above our poor power
to add or detract. The world will little note, nor long remember what
we say here, but it can never forget what they did here. It is for us,
the living, rather, to be dedicated here to the unfinished work which
they who fought here have thus far so nobly advanced. It is rather
for us to be here dedicated to the great task remaining before us—
that from these honored dead we take increased devotion to that
cause for which they gave the last full measure of devotion—that we
here highly resolve that these dead shall not have died in vain—that
this nation, under God, shall have a new birth of freedom—and that
government of the people, by the people, for the people, shall not
perish from the earth.
ABRAHAM LINCOLN.
Gettysburg, November 19, 1863.
CONTENTS

Page
I. July the First 1

II. The Home-Coming 21

III. Victory 45

IV. The Battle-ground 65

V. Gunner Criswell 87

VI. The Substitute 109

VII. The Retreat 133

VIII. The Great Day 157

IX. Mary Bowman 181

Note. Grateful acknowledgment is made to the editors for permission


to reprint in this volume chapters that first appeared in Harper's,
Lippincott's, McClure's, and Scribner's Magazines.
ILLUSTRATIONS

A Battle is to be fought 13
here Frontispiece

From the drawing by


Sidney H. Riesenberg,
reproduced by courtesy
of Harper and Brothers

"I can't stand it," he said 26


thickly

From the drawing by


Frederic Dorr Steele
reproduced by courtesy
of McClure's Magazine

He stood where Lincoln had 104


stood:

From the drawing by C.


E. Chambers,
reproduced by courtesy
of Harper and Brothers
They saw the Strange Old 152
Figure on the Porch

From the drawing by F.


Walter Taylor,
reproduced by courtesy
of Chas. Scribner's
Sons
GETTYSBURG

JULY THE FIRST

From the kitchen to the front door, back to the kitchen, out to the
little stone-fenced yard behind the house, where her children played
in their quiet fashion, Mary Bowman went uneasily. She was a
bright-eyed, slender person, with an intense, abounding joy in life.
In her red plaid gingham dress, with its full starched skirt, she
looked not much older than her ten-year-old boy.
Presently, admonishing herself sternly, she went back to her work.
She sat down in a low chair by the kitchen table, and laid upon her
knee a strip of thick muslin. Upon that she placed a piece of linen,
which she began to scrape with a sharp knife. Gradually a soft pile
of little, downy masses gathered in her lap. After a while, as though
this process were too slow, or as though she could no longer endure
her bent position, she selected another piece of linen and began to
pull it to pieces, adding the raveled threads to the pile of lint.
Suddenly, she slipped her hands under the soft mass, and lifted it to
the table. Forgetting the knife, which fell with a clatter, she rose and
went to the kitchen door.
"Children," she said, "remember you are not to go away."
The oldest boy answered obediently. Mounted upon a broomstick,
he impersonated General Early, who, a few days before, had visited
the town and had made requisition upon it; and little Katy and the
four-year-old boy represented General Early's ragged Confederates.
Their mother's bright eyes darkened as she watched them. Those
raiding Confederates had been so terrible to look upon, so ragged,
so worn, so starving. Their eyes had been like black holes in their
brown faces; they had had the figures of youth and the decrepitude
of age. A straggler from their ranks had told her that the Southern
men of strength and maturity were gone, that there remained in his
village in Georgia only little boys and old, old men. The Union
soldiers who had come yesterday, marching in the Emmittsburg
road, through the town and out to the Theological Seminary, were
different; travel-worn as they were, they had seemed, in
comparison, like new recruits.
Suddenly Mary Bowman clasped her hands. Thank God, they
would not fight here! Once more frightened Gettysburg had
anticipated a battle, once more its alarm had proved ridiculous. Early
had gone days ago to York, the Union soldiers were marching
toward Chambersburg. Thank God, John Bowman, her husband, was
not a regular soldier, but a fifer in the brigade band. Members of the
band, poor Mary thought, were safe, danger would not come nigh
them. Besides, he was far away with Hooker's idle forces. No failure
to give battle made Mary indignant, no reproaches of an inert
general fell from her lips. She was passionately grateful that they did
not fight.
It was only on dismal, rainy days, or when she woke at night and
looked at her little children lying in their beds, that the vague,
strange possibility of her husband's death occurred to her. Then she
assured herself with conviction that God would not let him die. They
were so happy, and they were just beginning to prosper. They had
paid the last upon their little house before he went to war; now they
meant to save money and to educate their children. By fall the war
would be over, then John would come back and resume his school-
teaching, and everything would be as it had been.
She went through the kitchen again and out to the front door, and
looked down the street with its scattering houses. Opposite lived
good-natured, strong-armed Hannah Casey; in the next house, a
dozen rods away, the Deemer family. The Deemers had had great
trouble, the father was at war and the two little children were ill with
typhoid fever. In a little while she would go down and help. It was
still early; perhaps the children and their tired nurses slept.
Beyond, the houses were set closer together, the Wilson house
first, where a baby was watched for now each day, and next to it the
McAtee house, where Grandma McAtee was dying. In that
neighborhood, and a little farther on past the new court-house in the
square, which Gettysburg called "The Diamond," men were moving
about, some mounted, some on foot. Their presence did not disturb
Mary, since Early had gone in one direction and the Union soldiers
were going in the other. Probably the Union soldiers had come to
town to buy food before they started on their march. She did not
even think uneasily of the sick and dying; she said to herself that if
the soldiers had wished to fight here, the good men of the village,
the judge, the doctor, and the ministers would have gone forth to
meet them and with accounts of the invalids would have persuaded
them to stay away!
Over the tops of the houses, Mary could see the cupola of the
Seminary lifting its graceful dome and slender pillars against the blue
sky. She and her husband had always planned that one of their boys
should go to the Seminary and learn to be a preacher; she
remembered their hope now. Far beyond Seminary Ridge, the
foothills of the Blue Ridge lay clear and purple in the morning
sunshine. The sun, already high in the sky, was behind her; it stood
over the tall, thick pines of the little cemetery where her kin lay, and
where she herself would lie with her husband beside her. Except for
that dim spot, the whole lovely landscape was unshadowed.
Suddenly she put out her hand to the pillar of the porch and called
her neighbor:—
"Hannah!"
Welcome to our website – the perfect destination for book lovers and
knowledge seekers. We believe that every book holds a new world,
offering opportunities for learning, discovery, and personal growth.
That’s why we are dedicated to bringing you a diverse collection of
books, ranging from classic literature and specialized publications to
self-development guides and children's books.

More than just a book-buying platform, we strive to be a bridge


connecting you with timeless cultural and intellectual values. With an
elegant, user-friendly interface and a smart search system, you can
quickly find the books that best suit your interests. Additionally,
our special promotions and home delivery services help you save time
and fully enjoy the joy of reading.

Join us on a journey of knowledge exploration, passion nurturing, and


personal growth every day!

ebookbell.com

You might also like