Godavari Global University

NH-16, Chaitanya Knowledge City, Rajamahendravaram-533296

Regulation Paper-II:
Godavari Global University
GGU School/Departm
ent Common
Course Code Course
Advanced Optimization Techniques

Teaching Total Contact Hours -48 L T P C

Prerequisite(s): CAD/CAM 4 0 0 4

Course Objectives:
Students undergoing this course will be able to:
• Provide an in-depth understanding of advanced optimization techniques, including
analytical, numerical, and multi-objective approaches
• Explore and explain state-of-the-art swarm intelligence and metaheuristic optimization
methods, emphasizing their applications and limitations.
• Equip with the ability to analyze and apply optimization strategies to real-world
problems.

Course Outcomes:
On completion of the course, student will be able to -
CO1: Explain the fundamental principles and mathematical foundations of
optimization techniques, including convexity, optimality conditions, and
duality.
CO2: Discuss various numerical optimization methods, including direct and
gradient-based techniques, and their convergence properties.
CO3: Explain the principles of multi-objective optimization, including Pareto
optimality, trade-offs, and performance metrics.
CO4: Describe swarm intelligence and metaheuristic techniques, including PSO,
ACO, and hybrid algorithms, and their applications to optimization problems.
CO5: Discuss real-world applications and emerging trends in optimization, such as
robust optimization, machine learning-based optimization, and quantum
optimization.

Syllabus

UNIT I
FUNDAMENTALS OF OPTIMIZATION
Optimization problems and applications, classifications (linear, nonlinear, constrained,
unconstrained), convex sets and convex functions, Karush-Kuhn-Tucker (KKT) conditions,
duality theory, gradient-based optimization, steepest descent, Newton’s method, Lagrange
multipliers, role of analytical techniques in optimization.

UNIT II:
NUMERICAL OPTIMIZATION TECHNIQUES
Differences between numerical and analytical techniques, line search and trust-region methods,
Nelder-Mead method, Powell’s method, conjugate gradient method, quasi-Newton methods
 Godavari Global University
NH-16, Chaitanya Knowledge City, Rajamahendravaram-533296

(BFGS, DFP), penalty methods, barrier methods, stochastic gradient descent (SGD),
convergence analysis, computational complexity.

Unit -III
MULTI-OBJECTIVE OPTIMIZATION
Pareto optimality, dominance relations, weighted-sum method, ε-constraint method, goal
programming, evolutionary multi-objective optimization techniques, NSGA-II, MOEA/D,
performance metrics (hypervolume, spread, attainment surfaces), trade-offs in objectives, real-
world multi-objective optimization applications.

Unit -IV
SWARM INTELLIGENCE AND METAHEURISTICS
Characteristics of swarm intelligence, self-organization principles, particle swarm optimization
(PSO), ant colony optimization (ACO), artificial bee colony algorithm, firefly algorithm,
genetic algorithms, differential evolution, hybrid approaches, metaheuristics for global
optimization problems.

Unit -V
OPTIMIZATION APPLICATIONS AND TRENDS
Optimization of dynamic systems, network optimization, robust optimization, reliability-based
optimization, optimization under uncertainty, machine learning optimization (e.g.,
hyperparameter tuning, Bayesian optimization), applications in robotics, logistics, aerospace,
healthcare, energy systems, trends in quantum optimization, reinforcement learning for
optimization.

Textbooks:
1. Numerical Optimization, Jorge Nocedal and Stephen J. Wright, Springer
2. Multi-Objective Optimization Using Evolutionary Algorithms, Kalyanmoy Deb, John
Wiley & Sons Inc
3. Swarm Intelligence: From Natural to Artificial Systems, Eric Bonabeau, Marco Dorigo,
and Guy Theraulaz, Oxford University Press

Reference Books:
1. Convex Optimization, Stephen Boyd and Lieven Vandenberghe, Cambridge University
Press
2. Engineering Optimization: Theory and Practice, S S Rao, New Age International Pvt
Ltd
3. Optimization for Engineering Design: Algorithms and Examples, Kalyanmoy Deb,
Prentice Hall India Learning Private Limited

Online Learning Resources:

• NPTEL course “Optimization, Prof. A. Goswami, Dr. Debjani Chakraborty, IIT
Kharagpur”, https://nptel.ac.in/courses/111105039
 Godavari Global University
NH-16, Chaitanya Knowledge City, Rajamahendravaram-533296

CO-PO Mapping:
(1: Slight [Low]; 2: Moderate[Medium]; 3: Substantial[High], '-' : No Correlation)

PO1 PO2 PO3 PO4 PO5 PO6 PO7 PO8 PO9 PO10 PO11 PO12 PSO1 PSO2 PSO3 PSO4

CO1 3 3 2 - - - - - - - - - 3 - 3 2

CO2 3 3 2 - - - - - - - - - 3 - 3 2

CO3 3 3 2 - - - - - - - - - 3 - 3 2

CO4 3 3 2 - 3 - - - - - - - 3 - 3 2

CO5 3 3 2 3 3 - - - - - - - 3 - 3 2

Supervisor Co- Supervisor