Nature-Inspired Optimization
Techniques and their Applications
Dr. Amany Arafa
•Research is the process of finding the solution of
the unsolved life problems.
•Why to do research?
•Understand the world
•Solve new problems
•Improve existing solutions
Research
Problem
• Most of the real-world problems, including design,
optimization, scheduling and control etc. are
inherently characterized by multiple conflicting
objectives realization.
• When addressing these problems, the parameters or
variables are frequently imprecise due to
uncontrollable factors, leading to more complicated
problem formulation.
Problem Solving
• While solving any problem one can find multiple
solutions.
• More attention must paid to :
• cost minimization.
• output maximization
• energy saving,
• environmental protection
• sustainable development issues, etc. in various fields.
• There’s lots of values to tune which are hard to predict
Optimize the solution
Set of potential solutions Optimization criteria Evaluation space
Goal: identify best solution(s) w.r.t. optimization criteria
Nature-Inspired Optimization
• Nature can provide a great inspiration to the field of computation and
artificial intelligent.
Nature is the only source of AI
• The beauty of nature is its ability to produce amazingly complex
patterns with amazingly simple algorithms.
• Observe how the nature work. Then Extract the principle
• Ex. Animals can find the solutions of complex problems in less energy
and cost with recovering error strategy.
• Apply natures method in solving our problem
Ex. Firefly Algorithm
Fireflies: Introduction
• One of the family of insects.
• Live in tropical environment.
• Produce-cold light-chemically
• Yellow, green, pale-red light
• Based on the flashing patterns and behavior of fireflies.
Behavior of Fireflies
 Two fundamental functions of such flashes are:
◦ to attract mating partners (communication)
◦ to attract potential prey
◦ protective warning mechanism
 They have unique flashing pattern.
 As the distance increases, light becomes weaker and
weaker because absorption by air.
Rules for Firefly Algorithm
• All fireflies will be attracted to other fireflies.
• Attractiveness is proportional to the brightness, and they both
decrease as their distance increases.
• The brightness of a firefly determined by the objective function.
Pseudo Code
Objective function f(x), x = (x1, ..., xd )
Generate initial population of fireflies xi (i = 1, 2, ..., n) Light intensity Ii at xi is
determined by f(xi)
Define light absorption coefficient
while(t <MaxGeneration)
for i = 1 : n all n fireflies
for j = 1 : i all n fireflies
if(Ij > Ii), Move firefly i towards j in d-dimension; end if
Attractiveness varies with distance r via exp[−r]
Evaluate new solutions and update light intensity
end for j
end for i
Rank the fireflies and find the current best
end while
Postprocess results and visualization.
Nature Inspired Optimization
Algorithms
Progress of Algorithms
Heuristics vs. meta-heuristics
• heuristic, is a function that ranks alternatives in search algorithms at each
branching step based on available information to decide which branch to
follow. For example, it may approximate the exact solution
• The biggest and most important difference between a heuristic and a
meta-heuristic is that heuristics get stuck in local optima, while meta-
heuristics have mechanism to avoid that.
• As examples of this mechanisms, among others, we have:
• Mutation (in Genetic Algorithm);
• Constructive with Restricted Candidate List (GRASP);
• Perturbation (ILS).
• Hyper-heuristics are to tell what sequence of Meta-heuristics to use to
solve the problem at hand. Also it can be used to classify what meta-
heuristic fits better to which problem.
• So for example, if we are solving and instance of TSP problem, it could result that the
best solution is a result of running first GA, then Simulated Annealing then Ant-
colony.
Fields Appear Based on Nature
• When using computers and computation in solving biological or
chemical problem new fields appear (bioinformatics and
cheminformatics)
• Bioinformatics is an interdisciplinary field that develops and applies
computational methods to analyze large collections of biological data.
• Cheminformatics is also known as multidisciplinary science as it
combines Chemistry, Biology, Mathematics, Biochemistry, Statistics
and informatics.
Application in Cheminformatics
• Storing data generated through experiments or from molecular simulation
Retrieval of chemical.
• Structures from chemical database (Software libraries).
• Prediction of physical, chemical and biological properties of chemical compounds.
• Elucidation of the structure of a compound based on spectroscopic data.
• Structure, Substructure, Similarity and diversity searching from chemical
database.
• Docking - Interaction between two macromolecules.
• Drug Discovery
• Molecular Science, Materials Science, Food Science (nutraceuticals),
• Atmospheric chemistry, Polymer chemistry, Textile Industry,
• Combinatorial organic synthesis (COS).
Application in Bioinformatics
• The computational methods used include analytical methods,
mathematical modelling and simulation. The Nature inspired
computational methods Applied for:
• genetic sequences,
• cell populations or
• protein samples,
• to make new predictions or discover new biology.
• Gene selection
• Cancer classification
• Time tabling • Packing
• Placement • Design
• Grouping • renewable Energy design
• The optimal siting of wind turbines
• Position of solar cell
Application in Engineering
Natural-Inspired_Amany_Final.pptx
Robots Inspired by Nature
Robots as interesting complex systems
Similarity to animals
Consequences of having a real body
Real tasks in the real world --- cannot predict all interactions
Lessons learned from biological creatures
Increase physical complexity
Increase behavioral complexity
Inspiration from Insects
Exploit physical modularity
Complex robot made of simpler robots
Sensors
Actuation
Computation
Examples
Hannibal
Reconfigurable robots (Daniela Rus)
Design by Evolution
• Evolutionary Algorithms (EA) are stochastic search methods that
mimic the survival of the fittest process of natural ecosystems. The
algorithms have strong adaptability and self organization, including
Evolutionary Programming (EP) [10],
• Evolutionary Strategy (ES) [11], Genetic Algorithm (GA),
• Differential Evolution Algorithm (DE),
• Harmony Search Algorithm (HS),
• Membrane Computing (P system),
• Particle Swarm Optimization Algorithm (PSO),
• Artificial Bee Colony Algorithm (ABC) [45],
• Artificial Immune System (AIS),
• Teaching-Learning Based Optimization algorithm (TLBO),
• Ant Colony Optimization Algorithm (ACO)[46],
• Cuckoo Search algorithm (CS) [47],
• Firefly Algorithm (FA) [48],
• Bacteria Foraging Optimization algorithm (BFO) [49],
• Coral Reef Optimization algorithm (CROA) [50],
• Shuffled Frog Leaping Algorithm (SFLA) [51],
• Pigeon Inspired Optimization (PIO) [52], etc.
• Teaching-learning based optimization (TLBO).
The common physics inspired algorithms include
• Chaotic Optimization Algorithm (COA),
• Intelligent Water Drops Algorithm (IWD) [68],
• Magnetic Optimization Algorithm (MOA)[69],
• Gravitational Search Algorithm (GSA) [70,71],
• Simulated Annealing (SA)
Geography inspired algorithms are
• one sort of metaheuristic algorithm and generate random solutions in
the geographical search space. These optimization algorithms are
classified as
• Tabu Search Algorithm (TS),
• Imperialistic Competition Algorithm (ICA), etc.

More Related Content

PDF
New Local Search Strategy in Artificial Bee Colony Algorithm
PDF
ADVANCED OPTIMIZATION TECHNIQUES META-HEURISTIC ALGORITHMS FOR ENGINEERING AP...
PPT
Swarm intelligence
PDF
Nature Inspired Metaheuristic Algorithms
PDF
A Brief Review of Nature-Inspired Algorithms for Optimization
PPTX
Foundations-of-Ants-Ant-Colony-Optimization (1).pptx
PDF
Nature-Inspired Metaheuristic Algorithms
PPTX
Metaheuristics for software testing
New Local Search Strategy in Artificial Bee Colony Algorithm
ADVANCED OPTIMIZATION TECHNIQUES META-HEURISTIC ALGORITHMS FOR ENGINEERING AP...
Swarm intelligence
Nature Inspired Metaheuristic Algorithms
A Brief Review of Nature-Inspired Algorithms for Optimization
Foundations-of-Ants-Ant-Colony-Optimization (1).pptx
Nature-Inspired Metaheuristic Algorithms
Metaheuristics for software testing

Similar to Natural-Inspired_Amany_Final.pptx (20)

PDF
Enhanced local search in artificial bee colony algorithm
PDF
Nature-Inspired Optimization Algorithms
PDF
A comprehensive review of the firefly algorithms
PPTX
nature inspired algorithms
PPTX
Bio-inspired computing Algorithms.pptx
PDF
Metaheuristic Algorithms: A Critical Analysis
PDF
Bat Algorithm: Literature Review and Applications
PDF
Nuclear_Reaction_Optimization_A_Novel_and_Powerful.pdf
PPTX
Firefly algorithm
PDF
Improved Firefly Algorithm for Unconstrained Optimization Problems
PDF
Analysis of Nature-Inspried Optimization Algorithms
PPT
Meta Heuristics Optimization and Nature Inspired.ppt
PPT
231semMish.ppt
PPT
231semMish (1).ppt
PDF
1308.3898 1
PDF
1308.3898
PDF
Applied Optimization and Swarm Intelligence (Springer Tracts in Nature-Inspir...
PDF
6 x 9 = 42
PDF
ECE-Swarm-Intelligence-SI-PPT.pdf.......
PPTX
DNA ppt for beginners , how dna works in out body
Enhanced local search in artificial bee colony algorithm
Nature-Inspired Optimization Algorithms
A comprehensive review of the firefly algorithms
nature inspired algorithms
Bio-inspired computing Algorithms.pptx
Metaheuristic Algorithms: A Critical Analysis
Bat Algorithm: Literature Review and Applications
Nuclear_Reaction_Optimization_A_Novel_and_Powerful.pdf
Firefly algorithm
Improved Firefly Algorithm for Unconstrained Optimization Problems
Analysis of Nature-Inspried Optimization Algorithms
Meta Heuristics Optimization and Nature Inspired.ppt
231semMish.ppt
231semMish (1).ppt
1308.3898 1
1308.3898
Applied Optimization and Swarm Intelligence (Springer Tracts in Nature-Inspir...
6 x 9 = 42
ECE-Swarm-Intelligence-SI-PPT.pdf.......
DNA ppt for beginners , how dna works in out body
Ad

Recently uploaded (20)

PPTX
Real Estate Management PART 1.pptxFFFFFFFFFFFFF
PDF
Using Technology to Foster Innovative Teaching Practices (www.kiu.ac.ug)
PDF
AIGA 012_04 Cleaning of equipment for oxygen service_reformat Jan 12.pdf
PPTX
SC Robotics Team Safety Training Presentation
PPTX
Module1.pptxrjkeieuekwkwoowkemehehehrjrjrj
PPT
Basics Of Pump types, Details, and working principles.
PDF
Software defined netwoks is useful to learn NFV and virtual Lans
PDF
electrical machines course file-anna university
PPTX
Soft Skills Unit 2 Listening Speaking Reading Writing.pptx
PPT
Module_1_Lecture_1_Introduction_To_Automation_In_Production_Systems2023.ppt
PPT
UNIT-I Machine Learning Essentials for 2nd years
PDF
ST MNCWANGO P2 WIL (MEPR302) FINAL REPORT.pdf
PDF
IAE-V2500 Engine for Airbus Family 319/320
PDF
Engineering Solutions for Ethical Dilemmas in Healthcare (www.kiu.ac.ug)
PPTX
Research Writing, Mechanical Engineering
PPT
Programmable Logic Controller PLC and Industrial Automation
PDF
Performance, energy consumption and costs: a comparative analysis of automati...
PPTX
DATA STRCUTURE LABORATORY -BCSL305(PRG1)
DOCX
An investigation of the use of recycled crumb rubber as a partial replacement...
PDF
LS-6-Digital-Literacy (1) K12 CURRICULUM .pdf
Real Estate Management PART 1.pptxFFFFFFFFFFFFF
Using Technology to Foster Innovative Teaching Practices (www.kiu.ac.ug)
AIGA 012_04 Cleaning of equipment for oxygen service_reformat Jan 12.pdf
SC Robotics Team Safety Training Presentation
Module1.pptxrjkeieuekwkwoowkemehehehrjrjrj
Basics Of Pump types, Details, and working principles.
Software defined netwoks is useful to learn NFV and virtual Lans
electrical machines course file-anna university
Soft Skills Unit 2 Listening Speaking Reading Writing.pptx
Module_1_Lecture_1_Introduction_To_Automation_In_Production_Systems2023.ppt
UNIT-I Machine Learning Essentials for 2nd years
ST MNCWANGO P2 WIL (MEPR302) FINAL REPORT.pdf
IAE-V2500 Engine for Airbus Family 319/320
Engineering Solutions for Ethical Dilemmas in Healthcare (www.kiu.ac.ug)
Research Writing, Mechanical Engineering
Programmable Logic Controller PLC and Industrial Automation
Performance, energy consumption and costs: a comparative analysis of automati...
DATA STRCUTURE LABORATORY -BCSL305(PRG1)
An investigation of the use of recycled crumb rubber as a partial replacement...
LS-6-Digital-Literacy (1) K12 CURRICULUM .pdf
Ad

Natural-Inspired_Amany_Final.pptx

  • 1. Nature-Inspired Optimization Techniques and their Applications Dr. Amany Arafa
  • 2. •Research is the process of finding the solution of the unsolved life problems. •Why to do research? •Understand the world •Solve new problems •Improve existing solutions Research
  • 3. Problem • Most of the real-world problems, including design, optimization, scheduling and control etc. are inherently characterized by multiple conflicting objectives realization. • When addressing these problems, the parameters or variables are frequently imprecise due to uncontrollable factors, leading to more complicated problem formulation.
  • 4. Problem Solving • While solving any problem one can find multiple solutions. • More attention must paid to : • cost minimization. • output maximization • energy saving, • environmental protection • sustainable development issues, etc. in various fields. • There’s lots of values to tune which are hard to predict
  • 5. Optimize the solution Set of potential solutions Optimization criteria Evaluation space Goal: identify best solution(s) w.r.t. optimization criteria
  • 6. Nature-Inspired Optimization • Nature can provide a great inspiration to the field of computation and artificial intelligent. Nature is the only source of AI • The beauty of nature is its ability to produce amazingly complex patterns with amazingly simple algorithms. • Observe how the nature work. Then Extract the principle • Ex. Animals can find the solutions of complex problems in less energy and cost with recovering error strategy. • Apply natures method in solving our problem
  • 8. Fireflies: Introduction • One of the family of insects. • Live in tropical environment. • Produce-cold light-chemically • Yellow, green, pale-red light • Based on the flashing patterns and behavior of fireflies.
  • 9. Behavior of Fireflies  Two fundamental functions of such flashes are: ◦ to attract mating partners (communication) ◦ to attract potential prey ◦ protective warning mechanism  They have unique flashing pattern.  As the distance increases, light becomes weaker and weaker because absorption by air.
  • 10. Rules for Firefly Algorithm • All fireflies will be attracted to other fireflies. • Attractiveness is proportional to the brightness, and they both decrease as their distance increases. • The brightness of a firefly determined by the objective function.
  • 11. Pseudo Code Objective function f(x), x = (x1, ..., xd ) Generate initial population of fireflies xi (i = 1, 2, ..., n) Light intensity Ii at xi is determined by f(xi) Define light absorption coefficient while(t <MaxGeneration) for i = 1 : n all n fireflies for j = 1 : i all n fireflies if(Ij > Ii), Move firefly i towards j in d-dimension; end if Attractiveness varies with distance r via exp[−r] Evaluate new solutions and update light intensity end for j end for i Rank the fireflies and find the current best end while Postprocess results and visualization.
  • 14. Heuristics vs. meta-heuristics • heuristic, is a function that ranks alternatives in search algorithms at each branching step based on available information to decide which branch to follow. For example, it may approximate the exact solution • The biggest and most important difference between a heuristic and a meta-heuristic is that heuristics get stuck in local optima, while meta- heuristics have mechanism to avoid that. • As examples of this mechanisms, among others, we have: • Mutation (in Genetic Algorithm); • Constructive with Restricted Candidate List (GRASP); • Perturbation (ILS). • Hyper-heuristics are to tell what sequence of Meta-heuristics to use to solve the problem at hand. Also it can be used to classify what meta- heuristic fits better to which problem. • So for example, if we are solving and instance of TSP problem, it could result that the best solution is a result of running first GA, then Simulated Annealing then Ant- colony.
  • 15. Fields Appear Based on Nature • When using computers and computation in solving biological or chemical problem new fields appear (bioinformatics and cheminformatics) • Bioinformatics is an interdisciplinary field that develops and applies computational methods to analyze large collections of biological data. • Cheminformatics is also known as multidisciplinary science as it combines Chemistry, Biology, Mathematics, Biochemistry, Statistics and informatics.
  • 16. Application in Cheminformatics • Storing data generated through experiments or from molecular simulation Retrieval of chemical. • Structures from chemical database (Software libraries). • Prediction of physical, chemical and biological properties of chemical compounds. • Elucidation of the structure of a compound based on spectroscopic data. • Structure, Substructure, Similarity and diversity searching from chemical database. • Docking - Interaction between two macromolecules. • Drug Discovery • Molecular Science, Materials Science, Food Science (nutraceuticals), • Atmospheric chemistry, Polymer chemistry, Textile Industry, • Combinatorial organic synthesis (COS).
  • 17. Application in Bioinformatics • The computational methods used include analytical methods, mathematical modelling and simulation. The Nature inspired computational methods Applied for: • genetic sequences, • cell populations or • protein samples, • to make new predictions or discover new biology. • Gene selection • Cancer classification
  • 18. • Time tabling • Packing • Placement • Design • Grouping • renewable Energy design • The optimal siting of wind turbines • Position of solar cell Application in Engineering
  • 20. Robots Inspired by Nature Robots as interesting complex systems Similarity to animals Consequences of having a real body Real tasks in the real world --- cannot predict all interactions Lessons learned from biological creatures Increase physical complexity Increase behavioral complexity
  • 21. Inspiration from Insects Exploit physical modularity Complex robot made of simpler robots Sensors Actuation Computation Examples Hannibal Reconfigurable robots (Daniela Rus) Design by Evolution
  • 22. • Evolutionary Algorithms (EA) are stochastic search methods that mimic the survival of the fittest process of natural ecosystems. The algorithms have strong adaptability and self organization, including Evolutionary Programming (EP) [10], • Evolutionary Strategy (ES) [11], Genetic Algorithm (GA), • Differential Evolution Algorithm (DE), • Harmony Search Algorithm (HS), • Membrane Computing (P system),
  • 23. • Particle Swarm Optimization Algorithm (PSO), • Artificial Bee Colony Algorithm (ABC) [45], • Artificial Immune System (AIS), • Teaching-Learning Based Optimization algorithm (TLBO), • Ant Colony Optimization Algorithm (ACO)[46], • Cuckoo Search algorithm (CS) [47], • Firefly Algorithm (FA) [48], • Bacteria Foraging Optimization algorithm (BFO) [49], • Coral Reef Optimization algorithm (CROA) [50], • Shuffled Frog Leaping Algorithm (SFLA) [51], • Pigeon Inspired Optimization (PIO) [52], etc.
  • 24. • Teaching-learning based optimization (TLBO). The common physics inspired algorithms include • Chaotic Optimization Algorithm (COA), • Intelligent Water Drops Algorithm (IWD) [68], • Magnetic Optimization Algorithm (MOA)[69], • Gravitational Search Algorithm (GSA) [70,71], • Simulated Annealing (SA)
  • 25. Geography inspired algorithms are • one sort of metaheuristic algorithm and generate random solutions in the geographical search space. These optimization algorithms are classified as • Tabu Search Algorithm (TS), • Imperialistic Competition Algorithm (ICA), etc.