SlideShare a Scribd company logo
2
Most read
3
Most read
4
Most read
Introduction to Optimization
Module 1
What is Optimization?
• The process of finding the best values for the
variables of a particular problem to minimize or
maximize an objective function
• The action of making the best or most effective use
of given situation - (Google dictionary)
• It is a technique of squeezing best performance out
of provided current state of model
Components of an Optimization Problem
• Objective function
An objective function express performance of a system, need
to be minimized or maximized
• Variable (Design or Decision Variable)
A set of unknowns, define the objective function and
constraints, can be continuous, discrete or boolean
• Constraints
They are conditions, allows the unknowns to take on certain
values but exclude others to render the design to be feasible
Components of an Optimization Problem
Optimization
Problem
Variables
Continuous Discrete
Constraints
Constrained Unconstrained
Objective
Function
Single Multi
Objective function
𝟏 𝟏 𝟐
𝐟 𝐱 , 𝐱𝟐 = 𝐱𝟐+𝟐𝐱𝟐-0.3cos(3 𝛑𝐱𝟏)( 4 𝛑𝐱𝟐)+0.3
𝐨𝐛𝐣𝐞𝐜𝐭𝐢𝐯𝐞 𝐟𝐮𝐧𝐜𝐭𝐢𝐨𝐧 𝐦𝐢𝐧(𝐟)
𝐯𝐚𝐫𝐢𝐚𝐛𝐥𝐞𝐬 ∈ [𝟏𝟎, −𝟏𝟎]
𝐔𝐧𝐜𝐨𝐧𝐬𝐭𝐫𝐚𝐢𝐧𝐞𝐝 𝐏𝐫𝐨𝐛𝐥𝐞𝐦
𝐀𝐧 𝐞𝐱𝐚𝐦𝐩𝐥𝐞 ∶ 𝐬𝐢𝐧𝐠𝐥𝐞 𝐨𝐛𝐣𝐞𝐜𝐭𝐢𝐯𝐞 𝐟𝐮𝐧𝐜𝐭𝐢𝐨𝐧
Objective function
𝐀𝐧 𝐞𝐱𝐚𝐦𝐩𝐥𝐞 ∶ 𝐬𝐢𝐧𝐠𝐥𝐞 𝐨𝐛𝐣𝐞𝐜𝐭𝐢𝐯𝐞 𝐟𝐮𝐧𝐜𝐭
𝐢𝐨𝐧
Min f(z1, z2, z3) = (-100-(z1-5)2 - (z2-5)2 +(z3-5)2)/100
Subject to;
h(z1, z2, z3) = (z1 - 3)2 + (z2 - 2)2 + (z3 - 5)2 – 0.0625 ≤ 0
where;
0 ≤ zi ≤ 10;
𝐂𝐨𝐧𝐬𝐭𝐫𝐚𝐢𝐧𝐞𝐝 𝐏𝐫𝐨𝐛𝐥𝐞𝐦
Objective function
𝐀𝐧 𝐞𝐱𝐚𝐦𝐩𝐥𝐞 ∶ 𝐌𝐮𝐥𝐭𝐢 𝐨𝐛𝐣𝐞𝐜𝐭𝐢𝐯𝐞 𝐟𝐮𝐧𝐜𝐭𝐢𝐨𝐧
𝐨𝐛𝐣𝐞𝐜𝐭𝐢𝐯𝐞 𝐟𝐮𝐧𝐜𝐭𝐢𝐨𝐧 𝐦𝐢𝐧(𝐟𝟏 ) & 𝐦𝐢𝐧(𝐟𝟐 ) & 𝐦𝐢𝐧(𝐟𝟑 )
𝐔𝐧𝐜𝐨𝐧𝐬𝐭𝐫𝐚𝐢𝐧𝐞𝐝 𝐏𝐫𝐨𝐛𝐥𝐞𝐦
𝐀𝐧 𝐞𝐱𝐚𝐦𝐩𝐥𝐞 ∶ 𝐌𝐮𝐥𝐭𝐢 𝐨𝐛𝐣𝐞𝐜𝐭𝐢𝐯𝐞 𝐟𝐮𝐧𝐜𝐭𝐢𝐨𝐧
𝒎𝒊𝒏 =
𝐬𝐮𝐛𝐣𝐞𝐜𝐭 𝐭𝐨;
𝐂𝐨𝐧𝐬𝐭𝐫𝐚𝐢𝐧𝐞𝐝 𝐏𝐫𝐨𝐛𝐥𝐞𝐦
Objective function
{
Type of Optimization Techniques
Optimization
Technique
Conventional
Mathematical
Programming
Calculus
Methods
Network
Methods
Nonconventional Meta-heuristic
algorithms
Meta-heuristicAlgorithms
• Meta-heuristic is a general algorithmic framework
which can be applied to different optimization
problems with relatively few modifications to make
them adapted to a specific problem.
Meta-heuristicAlgorithms
Meta-heuristic
algorithms
Evolutionary
algorithms
GA GP
Physics-based
algorithms
CSS SA
Swarm-based
algorithms
Whale Ant
Colony
Human-based
algorithms
TLBO EMA
Genetic Algorithm (GA) Genetic Programming (GP) Charged System Search (CSS)
Simulated Annealing(SA) Teaching Learning Based Optimization(TLBO) Exchange Market Algorithm (EMA)
An Example : Whale optimization algorithm
1 Encircling prey
2 Bubble-net attacking method (exploitation phase)
3 Search for prey (exploration phase)
Behavior of Whale
An Example : Whale optimization algorithm
Mathematical Model
1- Encircling prey
Where t is the current iteration, A and C are coefficient vectors, X* is the
position vector of the best solution, and X indicates the position vector of a
solution, | | is the absolute value.
An Example : Whale optimization algorithm
Where components of a are linearly decreased from 2 to 0 over the course of
iterations and r is random vector in [0; 1]
Mathematical Model (cont.)
The vectors A and C are calculated asfollows:
An Example : Whale optimization algorithm
Mathematical Model (cont.)
2- Bubble-net mechanism (exploitationphase)
Where the value of A is a random value in interval [-a, a] and the value of a is
decreased from 2 to 0 , D’ =| X*(t) - X(t) | is the distance between the prey (best
solution) and the ith whale, b is a constant, l is a random number in [-1; 1], and p is a
random number in [0; 1]
An Example : Whale optimization algorithm
Mathematical Model (cont.)
3- search for prey (exploration phase)
In order to force the search agent to move
far a way from reference whale, we use the A with
values > 1 or < 1
Where Xrand is a random position vector chosen from the current population.
Module 1: Introduction to Optimization
• END OF CONTENT MODULE

More Related Content

What's hot (20)

PDF
Classification of optimization Techniques
shelememosisa
 
PPTX
NON LINEAR PROGRAMMING
karishma gupta
 
PPTX
Matlab Introduction
ideas2ignite
 
PDF
ADVANCED OPTIMIZATION TECHNIQUES META-HEURISTIC ALGORITHMS FOR ENGINEERING AP...
Ajay Kumar
 
PPT
Simulation and Modeling
anhdbh
 
PPTX
Introduction to optimization
SambandamK1
 
PPTX
Optimization tutorial
Northwestern University
 
PPTX
Linear Regression
Abdullah al Mamun
 
PPTX
Curve Fitting
Sachin Kumar
 
PPTX
Discrete event-simulation
PrimeAsia University
 
PPTX
introduction to modeling, Types of Models, Classification of mathematical mod...
Waqas Afzal
 
PPTX
Numerical methods and its applications
HaiderParekh1
 
PPTX
Modelling and simulation
stjulians school
 
PPTX
Curve fitting
shopnohinami
 
PPTX
Simulation & Modelling
Saneem Nazim
 
PPTX
Introduction to mathematical modelling
Arup Kumar Paria
 
PPTX
Monte Carlo Simulation
Deepti Singh
 
PDF
Introduction to optimization
VARUN KUMAR
 
PDF
Mathematical Modeling for Practical Problems
Liwei Ren任力偉
 
PPTX
Activation function
Astha Jain
 
Classification of optimization Techniques
shelememosisa
 
NON LINEAR PROGRAMMING
karishma gupta
 
Matlab Introduction
ideas2ignite
 
ADVANCED OPTIMIZATION TECHNIQUES META-HEURISTIC ALGORITHMS FOR ENGINEERING AP...
Ajay Kumar
 
Simulation and Modeling
anhdbh
 
Introduction to optimization
SambandamK1
 
Optimization tutorial
Northwestern University
 
Linear Regression
Abdullah al Mamun
 
Curve Fitting
Sachin Kumar
 
Discrete event-simulation
PrimeAsia University
 
introduction to modeling, Types of Models, Classification of mathematical mod...
Waqas Afzal
 
Numerical methods and its applications
HaiderParekh1
 
Modelling and simulation
stjulians school
 
Curve fitting
shopnohinami
 
Simulation & Modelling
Saneem Nazim
 
Introduction to mathematical modelling
Arup Kumar Paria
 
Monte Carlo Simulation
Deepti Singh
 
Introduction to optimization
VARUN KUMAR
 
Mathematical Modeling for Practical Problems
Liwei Ren任力偉
 
Activation function
Astha Jain
 

Similar to Introduction to Optimization.ppt (20)

PPT
introduction to optimizationkajsytdjrfh.ppt
vepelod780
 
PDF
VET4SBO Level 2 module 2 - unit 1 - v1.0 en
Karel Van Isacker
 
PDF
Evolutionary computation 5773-lecture03-Fall24 (8-23-24).pdf
chelseaokwechime21
 
PDF
Fundamentals of Genetic Algorithms (Soft Computing)
Amit Kumar Rathi
 
PDF
1.1optimization.pdf;;;khgggggggggggghhjj
m0mazen2060
 
PPTX
Optimization Using Evolutionary Computing Techniques
Siksha 'O' Anusandhan (Deemed to be University )
 
PPTX
1.1optimization concepts in engineering.pptx
singam_sridhar
 
PPTX
Basics of optimization technique for engineers
SHIVSHANKARKUMAR121M
 
PDF
swarm pso and gray wolf Optimization.pdf
abbas miry
 
PPT
PSO and Its application in Engineering
Prince Jain
 
PPT
UNIT-5 Optimization (Part-1).ppt
TvVignesh3
 
PPTX
whaleoptimizatioalgorithm-161008153549.pptx
xiyegam451
 
PPTX
Introduction to mathematical optimization
ShymaPV
 
PPTX
Whale optimizatio algorithm
Ahmed Fouad Ali
 
PDF
Optimization and its applications usefulness for researchers
rupajnayak66
 
PPTX
Algorithm For optimization.pptx
KARISHMA JAIN
 
PDF
Sca a sine cosine algorithm for solving optimization problems
laxmanLaxman03209
 
PDF
Bertimas
Amit Singh
 
PDF
4optmizationtechniques-150308051251-conversion-gate01.pdf
BechanYadav4
 
PDF
optmizationtechniques.pdf
SantiagoGarridoBulln
 
introduction to optimizationkajsytdjrfh.ppt
vepelod780
 
VET4SBO Level 2 module 2 - unit 1 - v1.0 en
Karel Van Isacker
 
Evolutionary computation 5773-lecture03-Fall24 (8-23-24).pdf
chelseaokwechime21
 
Fundamentals of Genetic Algorithms (Soft Computing)
Amit Kumar Rathi
 
1.1optimization.pdf;;;khgggggggggggghhjj
m0mazen2060
 
Optimization Using Evolutionary Computing Techniques
Siksha 'O' Anusandhan (Deemed to be University )
 
1.1optimization concepts in engineering.pptx
singam_sridhar
 
Basics of optimization technique for engineers
SHIVSHANKARKUMAR121M
 
swarm pso and gray wolf Optimization.pdf
abbas miry
 
PSO and Its application in Engineering
Prince Jain
 
UNIT-5 Optimization (Part-1).ppt
TvVignesh3
 
whaleoptimizatioalgorithm-161008153549.pptx
xiyegam451
 
Introduction to mathematical optimization
ShymaPV
 
Whale optimizatio algorithm
Ahmed Fouad Ali
 
Optimization and its applications usefulness for researchers
rupajnayak66
 
Algorithm For optimization.pptx
KARISHMA JAIN
 
Sca a sine cosine algorithm for solving optimization problems
laxmanLaxman03209
 
Bertimas
Amit Singh
 
4optmizationtechniques-150308051251-conversion-gate01.pdf
BechanYadav4
 
optmizationtechniques.pdf
SantiagoGarridoBulln
 
Ad

Recently uploaded (20)

PDF
Biomechanics of Gait: Engineering Solutions for Rehabilitation (www.kiu.ac.ug)
publication11
 
PDF
MAD Unit - 1 Introduction of Android IT Department
JappanMavani
 
PPTX
artificial intelligence applications in Geomatics
NawrasShatnawi1
 
PDF
AI TECHNIQUES FOR IDENTIFYING ALTERATIONS IN THE HUMAN GUT MICROBIOME IN MULT...
vidyalalltv1
 
PDF
PORTFOLIO Golam Kibria Khan — architect with a passion for thoughtful design...
MasumKhan59
 
PPTX
Green Building & Energy Conservation ppt
Sagar Sarangi
 
PPTX
美国电子版毕业证南卡罗莱纳大学上州分校水印成绩单USC学费发票定做学位证书编号怎么查
Taqyea
 
PPTX
Solar Thermal Energy System Seminar.pptx
Gpc Purapuza
 
PDF
AI TECHNIQUES FOR IDENTIFYING ALTERATIONS IN THE HUMAN GUT MICROBIOME IN MULT...
vidyalalltv1
 
PPTX
Server Side Web Development Unit 1 of Nodejs.pptx
sneha852132
 
PPTX
Worm gear strength and wear calculation as per standard VB Bhandari Databook.
shahveer210504
 
PPTX
Element 7. CHEMICAL AND BIOLOGICAL AGENT.pptx
merrandomohandas
 
PPTX
Heart Bleed Bug - A case study (Course: Cryptography and Network Security)
Adri Jovin
 
PDF
Set Relation Function Practice session 24.05.2025.pdf
DrStephenStrange4
 
PDF
Pressure Measurement training for engineers and Technicians
AIESOLUTIONS
 
PPTX
原版一样(Acadia毕业证书)加拿大阿卡迪亚大学毕业证办理方法
Taqyea
 
PPTX
265587293-NFPA 101 Life safety code-PPT-1.pptx
chandermwason
 
PDF
Electrical Engineer operation Supervisor
ssaruntatapower143
 
PPTX
VITEEE 2026 Exam Details , Important Dates
SonaliSingh127098
 
PPT
Carmon_Remote Sensing GIS by Mahesh kumar
DhananjayM6
 
Biomechanics of Gait: Engineering Solutions for Rehabilitation (www.kiu.ac.ug)
publication11
 
MAD Unit - 1 Introduction of Android IT Department
JappanMavani
 
artificial intelligence applications in Geomatics
NawrasShatnawi1
 
AI TECHNIQUES FOR IDENTIFYING ALTERATIONS IN THE HUMAN GUT MICROBIOME IN MULT...
vidyalalltv1
 
PORTFOLIO Golam Kibria Khan — architect with a passion for thoughtful design...
MasumKhan59
 
Green Building & Energy Conservation ppt
Sagar Sarangi
 
美国电子版毕业证南卡罗莱纳大学上州分校水印成绩单USC学费发票定做学位证书编号怎么查
Taqyea
 
Solar Thermal Energy System Seminar.pptx
Gpc Purapuza
 
AI TECHNIQUES FOR IDENTIFYING ALTERATIONS IN THE HUMAN GUT MICROBIOME IN MULT...
vidyalalltv1
 
Server Side Web Development Unit 1 of Nodejs.pptx
sneha852132
 
Worm gear strength and wear calculation as per standard VB Bhandari Databook.
shahveer210504
 
Element 7. CHEMICAL AND BIOLOGICAL AGENT.pptx
merrandomohandas
 
Heart Bleed Bug - A case study (Course: Cryptography and Network Security)
Adri Jovin
 
Set Relation Function Practice session 24.05.2025.pdf
DrStephenStrange4
 
Pressure Measurement training for engineers and Technicians
AIESOLUTIONS
 
原版一样(Acadia毕业证书)加拿大阿卡迪亚大学毕业证办理方法
Taqyea
 
265587293-NFPA 101 Life safety code-PPT-1.pptx
chandermwason
 
Electrical Engineer operation Supervisor
ssaruntatapower143
 
VITEEE 2026 Exam Details , Important Dates
SonaliSingh127098
 
Carmon_Remote Sensing GIS by Mahesh kumar
DhananjayM6
 
Ad

Introduction to Optimization.ppt

  • 2. What is Optimization? • The process of finding the best values for the variables of a particular problem to minimize or maximize an objective function • The action of making the best or most effective use of given situation - (Google dictionary) • It is a technique of squeezing best performance out of provided current state of model
  • 3. Components of an Optimization Problem • Objective function An objective function express performance of a system, need to be minimized or maximized • Variable (Design or Decision Variable) A set of unknowns, define the objective function and constraints, can be continuous, discrete or boolean • Constraints They are conditions, allows the unknowns to take on certain values but exclude others to render the design to be feasible
  • 4. Components of an Optimization Problem Optimization Problem Variables Continuous Discrete Constraints Constrained Unconstrained Objective Function Single Multi
  • 5. Objective function 𝟏 𝟏 𝟐 𝐟 𝐱 , 𝐱𝟐 = 𝐱𝟐+𝟐𝐱𝟐-0.3cos(3 𝛑𝐱𝟏)( 4 𝛑𝐱𝟐)+0.3 𝐨𝐛𝐣𝐞𝐜𝐭𝐢𝐯𝐞 𝐟𝐮𝐧𝐜𝐭𝐢𝐨𝐧 𝐦𝐢𝐧(𝐟) 𝐯𝐚𝐫𝐢𝐚𝐛𝐥𝐞𝐬 ∈ [𝟏𝟎, −𝟏𝟎] 𝐔𝐧𝐜𝐨𝐧𝐬𝐭𝐫𝐚𝐢𝐧𝐞𝐝 𝐏𝐫𝐨𝐛𝐥𝐞𝐦 𝐀𝐧 𝐞𝐱𝐚𝐦𝐩𝐥𝐞 ∶ 𝐬𝐢𝐧𝐠𝐥𝐞 𝐨𝐛𝐣𝐞𝐜𝐭𝐢𝐯𝐞 𝐟𝐮𝐧𝐜𝐭𝐢𝐨𝐧
  • 6. Objective function 𝐀𝐧 𝐞𝐱𝐚𝐦𝐩𝐥𝐞 ∶ 𝐬𝐢𝐧𝐠𝐥𝐞 𝐨𝐛𝐣𝐞𝐜𝐭𝐢𝐯𝐞 𝐟𝐮𝐧𝐜𝐭 𝐢𝐨𝐧 Min f(z1, z2, z3) = (-100-(z1-5)2 - (z2-5)2 +(z3-5)2)/100 Subject to; h(z1, z2, z3) = (z1 - 3)2 + (z2 - 2)2 + (z3 - 5)2 – 0.0625 ≤ 0 where; 0 ≤ zi ≤ 10; 𝐂𝐨𝐧𝐬𝐭𝐫𝐚𝐢𝐧𝐞𝐝 𝐏𝐫𝐨𝐛𝐥𝐞𝐦
  • 7. Objective function 𝐀𝐧 𝐞𝐱𝐚𝐦𝐩𝐥𝐞 ∶ 𝐌𝐮𝐥𝐭𝐢 𝐨𝐛𝐣𝐞𝐜𝐭𝐢𝐯𝐞 𝐟𝐮𝐧𝐜𝐭𝐢𝐨𝐧 𝐨𝐛𝐣𝐞𝐜𝐭𝐢𝐯𝐞 𝐟𝐮𝐧𝐜𝐭𝐢𝐨𝐧 𝐦𝐢𝐧(𝐟𝟏 ) & 𝐦𝐢𝐧(𝐟𝟐 ) & 𝐦𝐢𝐧(𝐟𝟑 ) 𝐔𝐧𝐜𝐨𝐧𝐬𝐭𝐫𝐚𝐢𝐧𝐞𝐝 𝐏𝐫𝐨𝐛𝐥𝐞𝐦
  • 8. 𝐀𝐧 𝐞𝐱𝐚𝐦𝐩𝐥𝐞 ∶ 𝐌𝐮𝐥𝐭𝐢 𝐨𝐛𝐣𝐞𝐜𝐭𝐢𝐯𝐞 𝐟𝐮𝐧𝐜𝐭𝐢𝐨𝐧 𝒎𝒊𝒏 = 𝐬𝐮𝐛𝐣𝐞𝐜𝐭 𝐭𝐨; 𝐂𝐨𝐧𝐬𝐭𝐫𝐚𝐢𝐧𝐞𝐝 𝐏𝐫𝐨𝐛𝐥𝐞𝐦 Objective function {
  • 9. Type of Optimization Techniques Optimization Technique Conventional Mathematical Programming Calculus Methods Network Methods Nonconventional Meta-heuristic algorithms
  • 10. Meta-heuristicAlgorithms • Meta-heuristic is a general algorithmic framework which can be applied to different optimization problems with relatively few modifications to make them adapted to a specific problem.
  • 11. Meta-heuristicAlgorithms Meta-heuristic algorithms Evolutionary algorithms GA GP Physics-based algorithms CSS SA Swarm-based algorithms Whale Ant Colony Human-based algorithms TLBO EMA Genetic Algorithm (GA) Genetic Programming (GP) Charged System Search (CSS) Simulated Annealing(SA) Teaching Learning Based Optimization(TLBO) Exchange Market Algorithm (EMA)
  • 12. An Example : Whale optimization algorithm 1 Encircling prey 2 Bubble-net attacking method (exploitation phase) 3 Search for prey (exploration phase) Behavior of Whale
  • 13. An Example : Whale optimization algorithm Mathematical Model 1- Encircling prey Where t is the current iteration, A and C are coefficient vectors, X* is the position vector of the best solution, and X indicates the position vector of a solution, | | is the absolute value.
  • 14. An Example : Whale optimization algorithm Where components of a are linearly decreased from 2 to 0 over the course of iterations and r is random vector in [0; 1] Mathematical Model (cont.) The vectors A and C are calculated asfollows:
  • 15. An Example : Whale optimization algorithm Mathematical Model (cont.) 2- Bubble-net mechanism (exploitationphase) Where the value of A is a random value in interval [-a, a] and the value of a is decreased from 2 to 0 , D’ =| X*(t) - X(t) | is the distance between the prey (best solution) and the ith whale, b is a constant, l is a random number in [-1; 1], and p is a random number in [0; 1]
  • 16. An Example : Whale optimization algorithm Mathematical Model (cont.) 3- search for prey (exploration phase) In order to force the search agent to move far a way from reference whale, we use the A with values > 1 or < 1 Where Xrand is a random position vector chosen from the current population.
  • 17. Module 1: Introduction to Optimization • END OF CONTENT MODULE