SlideShare a Scribd company logo
Robot Base Disturbance Optimization with
Compact Differential Evolution Light
Giovanni Iacca, Fabio Caraffini,
Ferrante Neri, Ernesto Mininno
University of Jyväskylä
Faculty of Information Technology
evo* 2012 - Málaga, Spain
April 13th
2012
#giovanni_iacca @evostar_2012_málaga
Outline

Memory Issues in Computational Intelligence

Compact Differential Evolution Light (cDElight)

Robot Base Disturbance Optimization

Simulation Results

Conclusions
#giovanni_iacca @evostar_2012_málaga
Memory Issues in Computational Intelligence

Computational Intelligence Optimization is good!

Why, Master?

Because its methods are efficient and robust!

Only that? What else, Master?

In addition to that, they often don't require any information
about the problem at hand, my son.

Oh, cool! But is there any drawback?

Well, actually most of them use plenty of hardware resources
and are computationally expensive.

Mmm...
#giovanni_iacca @evostar_2012_málaga
Memory Issues in Computational Intelligence
So, what if we need to perform an
optimization on board of an embedded
system with limited hardware?
#giovanni_iacca @evostar_2012_málaga
Memory Issues in Computational Intelligence

Single Solution Algorithms
- Simulated Annealing (SA)
- Single Particle Optimization
- Some Local Search Algorithms (e.g. Hooke-Jeeves)

Compact Optimization
- compact Genetic Algorithm (cGA)
- compact Differential Evolution (cDE)
#giovanni_iacca @evostar_2012_málaga

Estimation of Distribution Algorithm (EDA)

Does not use a population of individuals → low memory footprint

Makes use of a statistic model of the population:
Multivariate Gaussian with decision variables normalized in [-1,1]

Convergence: shrinkage of the Gaussian over the best (“elite”)

Sampling introduces beneficial randomness
compact Differential Evolution (cDE)
#giovanni_iacca @evostar_2012_málaga
Probability Vector (PV)
PV update rule
(offspring vs elite)
compact Differential Evolution (cDE)
#giovanni_iacca @evostar_2012_málaga

DE can be straightforwardly
encoded into a compact algorithm
without losing the basic working
principles (instead of cGA)

Survivor selection scheme
(one-to-one spawning logic)

Persistent vs non-persistent elitism

Parameters: F, Cr, Np
compact Differential Evolution (cDE)
Original implementation
(cDE rand/1/bin)
#giovanni_iacca @evostar_2012_málaga
Mutation Light: only one solution is sampled (instead of 3)
→ →
compact Differential Evolution light (cDElight)

Statistic independence

Truncated Gaussian ~ Gaussian
Under the following
assumptions/approximations:
Limited computational overhead!
#giovanni_iacca @evostar_2012_málaga
Exponential Crossover Light: ad hoc xover exp instead of xover bin
compact Differential Evolution light (cDElight)
Exponential Crossover (standard) Exponential Crossover Light
only one
random number
multiple
random numbers
→
#giovanni_iacca @evostar_2012_málaga
Computational Overhead
(vs cDE)
compact Differential Evolution light (cDElight)
Computational Overhead
(vs different algorithms)
~1/3 computational
overhead - O(n)
Tests performed on a single core Pentium 2.8 GHz PC, with the sphere function (Java implementation) for
different dimensions (2:100). The algorithm overhead is computed on 10000 fitness evaluations.
memory-saving
population-based
#giovanni_iacca @evostar_2012_málaga
Robot Base Disturbance Optimization
#giovanni_iacca @evostar_2012_málaga
Robot Base Disturbance Optimization
Trajectory plan: given a task, generate a trajectory (pos, vel, acc) for each joint so that
1) the end effector execute the task, 2) the trajectory is smooth, 3) kinematic/dynamic
constraint are satisfied, 4) the trajectory is optimal according to some criteria
#giovanni_iacca @evostar_2012_málaga
Robot Base Disturbance Optimization

Point-to-point problem:
define inter-knot points and
interpolate
(linear interpolation, spline, etc.)

Motion control: define the
torques to be applied
#giovanni_iacca @evostar_2012_málaga
Robot Base Disturbance Optimization
Free-floating
environment
Mutual disturbance between base and end-effector:
FB
= N-1
FE
↔ FE
= NFB
Fitness function: minimize the integral over
time of the norm of the acceleration vector
on the base
#giovanni_iacca @evostar_2012_málaga
Simulation Results

Matlab/Simulink implementation

{pos, vel, acc} x 2 knots x 3 joints = 18 variables

5th
order spline to model q(t), continuity condition on {pos, vel, acc}

4 different memory-saving optimization algorithms

Parameter setting suggested in original papers

30 runs x 10000 fitness evaluations

Wilcoxon Rank-Sum Test (confidence level 0.95)
#giovanni_iacca @evostar_2012_málaga
Simulation Results
Compact Differential Evolution (cDE)
Intelligent Single Particle Optimization (ISPO)
Non-Uniform Simulated Annealing (nuSA)
Without optimization (beginning of learning period)
With optimization (end of learning period)
#giovanni_iacca @evostar_2012_málaga
Conclusions

Some industrial applications are plagued by limited hardware

Compact algorithms, e.g. cDE, due to their compactness and
robustness are well suited for this kind of applications

We proposed a more efficient cDE (cDElight)

cDE proven to be successful on a complex space robotic
application

Possible alternatives and future works: different compact
frameworks (e.g. cBFO, cPSO), memory-saving MC
#giovanni_iacca @evostar_2012_málaga
Thank you! ¡Muchas gracias! Grazie!
Questions?

More Related Content

Similar to Evo star2012 Robot Base Disturbance Optimization with Compact Differential Evolution Light (20)

PPT
Software tookits for machine learning and graphical models
butest
 
PDF
深度學習在AOI的應用
CHENHuiMei
 
PPTX
DARMDN: Deep autoregressive mixture density nets for dynamical system mode...
Balázs Kégl
 
PDF
Early Benchmarking Results for Neuromorphic Computing
DESMOND YUEN
 
PDF
What Makes Training Multi-modal Classification Networks Hard? ppt
taeseon ryu
 
PDF
Switch Transformers: Scaling to Trillion Parameter Models with Simple and Eff...
taeseon ryu
 
PPT
Thesis Giani UIC Slides EN
Marco Santambrogio
 
PDF
Webpage Personalization and User Profiling
yingfeng
 
PDF
Static Energy Prediction in Software: A Worst-Case Scenario Approach
GreenLabAtDI
 
PDF
GPUs for GEC Competition @ GECCO-2013
Daniele Loiacono
 
PDF
ISC Frankfurt 2015: Good, bad and ugly of accelerators and a complementary path
John Holden
 
PPTX
Data-Centric Parallel Programming
inside-BigData.com
 
PDF
Mastering Advanced Deep Learning Techniques
prasathsankar7
 
PDF
Deep Learning Hardware: Past, Present, & Future
Rouyun Pan
 
PDF
Edge AI: Deep Learning techniques for Computer Vision applied to Embedded Sys...
Giacomo Bartoli
 
PPTX
Thesis_Presentation
Maruf Alam
 
PDF
AI and Deep Learning
Subrat Panda, PhD
 
PDF
6 large-scale-learning.pptx
mustafa sarac
 
PDF
Generation of Random EMF Models for Benchmarks
Markus Scheidgen
 
PDF
Optimize Single Particle Orbital (SPO) Evaluations Based on B-splines
Intel® Software
 
Software tookits for machine learning and graphical models
butest
 
深度學習在AOI的應用
CHENHuiMei
 
DARMDN: Deep autoregressive mixture density nets for dynamical system mode...
Balázs Kégl
 
Early Benchmarking Results for Neuromorphic Computing
DESMOND YUEN
 
What Makes Training Multi-modal Classification Networks Hard? ppt
taeseon ryu
 
Switch Transformers: Scaling to Trillion Parameter Models with Simple and Eff...
taeseon ryu
 
Thesis Giani UIC Slides EN
Marco Santambrogio
 
Webpage Personalization and User Profiling
yingfeng
 
Static Energy Prediction in Software: A Worst-Case Scenario Approach
GreenLabAtDI
 
GPUs for GEC Competition @ GECCO-2013
Daniele Loiacono
 
ISC Frankfurt 2015: Good, bad and ugly of accelerators and a complementary path
John Holden
 
Data-Centric Parallel Programming
inside-BigData.com
 
Mastering Advanced Deep Learning Techniques
prasathsankar7
 
Deep Learning Hardware: Past, Present, & Future
Rouyun Pan
 
Edge AI: Deep Learning techniques for Computer Vision applied to Embedded Sys...
Giacomo Bartoli
 
Thesis_Presentation
Maruf Alam
 
AI and Deep Learning
Subrat Panda, PhD
 
6 large-scale-learning.pptx
mustafa sarac
 
Generation of Random EMF Models for Benchmarks
Markus Scheidgen
 
Optimize Single Particle Orbital (SPO) Evaluations Based on B-splines
Intel® Software
 

More from Fabio Caraffini (8)

PDF
The Importance of Being Structured
Fabio Caraffini
 
PDF
A seriously simple memetic approach with a high performance
Fabio Caraffini
 
PDF
Three rotational invariant variants of the 3SOME algorithms
Fabio Caraffini
 
PDF
Ri-some algorithm
Fabio Caraffini
 
PDF
Meta-Lamarckian 3some algorithm for real-valued optimization
Fabio Caraffini
 
PDF
Micro Differential Evolution with Extra Moves alonf the Axes
Fabio Caraffini
 
PDF
Evoknow17 Large Scale Problems in Practice
Fabio Caraffini
 
PDF
Pechakucha
Fabio Caraffini
 
The Importance of Being Structured
Fabio Caraffini
 
A seriously simple memetic approach with a high performance
Fabio Caraffini
 
Three rotational invariant variants of the 3SOME algorithms
Fabio Caraffini
 
Ri-some algorithm
Fabio Caraffini
 
Meta-Lamarckian 3some algorithm for real-valued optimization
Fabio Caraffini
 
Micro Differential Evolution with Extra Moves alonf the Axes
Fabio Caraffini
 
Evoknow17 Large Scale Problems in Practice
Fabio Caraffini
 
Pechakucha
Fabio Caraffini
 
Ad

Recently uploaded (20)

PPTX
A Power Point Presentaion of 2 test match
katarapiyush21
 
PPTX
2025-07-27 Abraham 09 (shared slides).pptx
Dale Wells
 
PPTX
Enterprise Asset Management Overview with examples
ManikantaBN1
 
PDF
SXSW Panel Picker: Placemaking: Culture is the new cost of living
GabrielCohen28
 
PDF
Helpful but Terrifying: Older Adults' Perspectives of AI in Remote Healthcare...
Daniela Napoli
 
PPTX
DPIC Assingment_1.pptx.pptx for presentation
yashwork2607
 
PPTX
LUBRICANTS presentation slides with types functions and all
dahalsabal2020
 
PPTX
Rotary_Fundraising_Overview_Updated_new video .pptx
allangraemeduncan
 
PDF
Chapter-52-Relationship-between-countries-at-different-levels-of-development-...
dinhminhthu1405
 
PPTX
Iconic Destinations in India: Explore Heritage and Beauty
dhorashankar
 
PPTX
Describing the Organization's General Environment Identifying the Most Impact...
auntorkhastagirpujan
 
PDF
Securing Africa’s future: Technology, culture and the changing face of threat
Kayode Fayemi
 
PPTX
Joy And Peace In All Circumstances.pptx
FamilyWorshipCenterD
 
PPTX
Public Speakingbjdsbkjfdkjdasnlkdasnlknadslnbsjknsakjscbnkjbncs.pptx
ranazunairriaz1
 
PPTX
India Energy and Utility Sector Landscape
Anand Akshay
 
PPTX
Influencing Factors of Business Environment of Vegetables Selling Business
auntorkhastagirpujan
 
PPTX
Marketing Mix Analysis of Singapore Airlines.pptx
auntorkhastagirpujan
 
PPTX
Raksha Bandhan Celebrations PPT festival
sowmyabapuram
 
PDF
Advanced-Web-Design-Crafting-the-Future-Web (1).pdf
vaghelavidhiba591
 
PPTX
Remote Healthcare Technology Use Cases and the Contextual Integrity of Olde...
Daniela Napoli
 
A Power Point Presentaion of 2 test match
katarapiyush21
 
2025-07-27 Abraham 09 (shared slides).pptx
Dale Wells
 
Enterprise Asset Management Overview with examples
ManikantaBN1
 
SXSW Panel Picker: Placemaking: Culture is the new cost of living
GabrielCohen28
 
Helpful but Terrifying: Older Adults' Perspectives of AI in Remote Healthcare...
Daniela Napoli
 
DPIC Assingment_1.pptx.pptx for presentation
yashwork2607
 
LUBRICANTS presentation slides with types functions and all
dahalsabal2020
 
Rotary_Fundraising_Overview_Updated_new video .pptx
allangraemeduncan
 
Chapter-52-Relationship-between-countries-at-different-levels-of-development-...
dinhminhthu1405
 
Iconic Destinations in India: Explore Heritage and Beauty
dhorashankar
 
Describing the Organization's General Environment Identifying the Most Impact...
auntorkhastagirpujan
 
Securing Africa’s future: Technology, culture and the changing face of threat
Kayode Fayemi
 
Joy And Peace In All Circumstances.pptx
FamilyWorshipCenterD
 
Public Speakingbjdsbkjfdkjdasnlkdasnlknadslnbsjknsakjscbnkjbncs.pptx
ranazunairriaz1
 
India Energy and Utility Sector Landscape
Anand Akshay
 
Influencing Factors of Business Environment of Vegetables Selling Business
auntorkhastagirpujan
 
Marketing Mix Analysis of Singapore Airlines.pptx
auntorkhastagirpujan
 
Raksha Bandhan Celebrations PPT festival
sowmyabapuram
 
Advanced-Web-Design-Crafting-the-Future-Web (1).pdf
vaghelavidhiba591
 
Remote Healthcare Technology Use Cases and the Contextual Integrity of Olde...
Daniela Napoli
 
Ad

Evo star2012 Robot Base Disturbance Optimization with Compact Differential Evolution Light

  • 1. Robot Base Disturbance Optimization with Compact Differential Evolution Light Giovanni Iacca, Fabio Caraffini, Ferrante Neri, Ernesto Mininno University of Jyväskylä Faculty of Information Technology evo* 2012 - Málaga, Spain April 13th 2012
  • 2. #giovanni_iacca @evostar_2012_málaga Outline  Memory Issues in Computational Intelligence  Compact Differential Evolution Light (cDElight)  Robot Base Disturbance Optimization  Simulation Results  Conclusions
  • 3. #giovanni_iacca @evostar_2012_málaga Memory Issues in Computational Intelligence  Computational Intelligence Optimization is good!  Why, Master?  Because its methods are efficient and robust!  Only that? What else, Master?  In addition to that, they often don't require any information about the problem at hand, my son.  Oh, cool! But is there any drawback?  Well, actually most of them use plenty of hardware resources and are computationally expensive.  Mmm...
  • 4. #giovanni_iacca @evostar_2012_málaga Memory Issues in Computational Intelligence So, what if we need to perform an optimization on board of an embedded system with limited hardware?
  • 5. #giovanni_iacca @evostar_2012_málaga Memory Issues in Computational Intelligence  Single Solution Algorithms - Simulated Annealing (SA) - Single Particle Optimization - Some Local Search Algorithms (e.g. Hooke-Jeeves)  Compact Optimization - compact Genetic Algorithm (cGA) - compact Differential Evolution (cDE)
  • 6. #giovanni_iacca @evostar_2012_málaga  Estimation of Distribution Algorithm (EDA)  Does not use a population of individuals → low memory footprint  Makes use of a statistic model of the population: Multivariate Gaussian with decision variables normalized in [-1,1]  Convergence: shrinkage of the Gaussian over the best (“elite”)  Sampling introduces beneficial randomness compact Differential Evolution (cDE)
  • 7. #giovanni_iacca @evostar_2012_málaga Probability Vector (PV) PV update rule (offspring vs elite) compact Differential Evolution (cDE)
  • 8. #giovanni_iacca @evostar_2012_málaga  DE can be straightforwardly encoded into a compact algorithm without losing the basic working principles (instead of cGA)  Survivor selection scheme (one-to-one spawning logic)  Persistent vs non-persistent elitism  Parameters: F, Cr, Np compact Differential Evolution (cDE) Original implementation (cDE rand/1/bin)
  • 9. #giovanni_iacca @evostar_2012_málaga Mutation Light: only one solution is sampled (instead of 3) → → compact Differential Evolution light (cDElight)  Statistic independence  Truncated Gaussian ~ Gaussian Under the following assumptions/approximations: Limited computational overhead!
  • 10. #giovanni_iacca @evostar_2012_málaga Exponential Crossover Light: ad hoc xover exp instead of xover bin compact Differential Evolution light (cDElight) Exponential Crossover (standard) Exponential Crossover Light only one random number multiple random numbers →
  • 11. #giovanni_iacca @evostar_2012_málaga Computational Overhead (vs cDE) compact Differential Evolution light (cDElight) Computational Overhead (vs different algorithms) ~1/3 computational overhead - O(n) Tests performed on a single core Pentium 2.8 GHz PC, with the sphere function (Java implementation) for different dimensions (2:100). The algorithm overhead is computed on 10000 fitness evaluations. memory-saving population-based
  • 13. #giovanni_iacca @evostar_2012_málaga Robot Base Disturbance Optimization Trajectory plan: given a task, generate a trajectory (pos, vel, acc) for each joint so that 1) the end effector execute the task, 2) the trajectory is smooth, 3) kinematic/dynamic constraint are satisfied, 4) the trajectory is optimal according to some criteria
  • 14. #giovanni_iacca @evostar_2012_málaga Robot Base Disturbance Optimization  Point-to-point problem: define inter-knot points and interpolate (linear interpolation, spline, etc.)  Motion control: define the torques to be applied
  • 15. #giovanni_iacca @evostar_2012_málaga Robot Base Disturbance Optimization Free-floating environment Mutual disturbance between base and end-effector: FB = N-1 FE ↔ FE = NFB Fitness function: minimize the integral over time of the norm of the acceleration vector on the base
  • 16. #giovanni_iacca @evostar_2012_málaga Simulation Results  Matlab/Simulink implementation  {pos, vel, acc} x 2 knots x 3 joints = 18 variables  5th order spline to model q(t), continuity condition on {pos, vel, acc}  4 different memory-saving optimization algorithms  Parameter setting suggested in original papers  30 runs x 10000 fitness evaluations  Wilcoxon Rank-Sum Test (confidence level 0.95)
  • 17. #giovanni_iacca @evostar_2012_málaga Simulation Results Compact Differential Evolution (cDE) Intelligent Single Particle Optimization (ISPO) Non-Uniform Simulated Annealing (nuSA) Without optimization (beginning of learning period) With optimization (end of learning period)
  • 18. #giovanni_iacca @evostar_2012_málaga Conclusions  Some industrial applications are plagued by limited hardware  Compact algorithms, e.g. cDE, due to their compactness and robustness are well suited for this kind of applications  We proposed a more efficient cDE (cDElight)  cDE proven to be successful on a complex space robotic application  Possible alternatives and future works: different compact frameworks (e.g. cBFO, cPSO), memory-saving MC
  • 19. #giovanni_iacca @evostar_2012_málaga Thank you! ¡Muchas gracias! Grazie! Questions?