Transcript DE - iut.ac.ir
1
Differential Evolution
Hossein Talebi Hassan Nikoo
Outline
History Introduction Differences of DE with other Eas Difference vector Mutation Cross over Selection General DE Parameter control Variation of DE Application References Hassan’s parts 2 Differential Evolution
3 Differential Evolution
history
Ken Storn.
Price's attempts to solve the Chebychev Polynomial fitting Problem that had been posed to him by Rainer
4 Differential Evolution
Introduction
The original DE was developed for continuous value problems Individuals are vectors Distance and direction information from current population is used to guide the search process
5 Differential Evolution
Difference of DE with other EAs
1.
mutation is applied first to generate trial vectors, then cross over is applied to produce offspring 2.
mutation step size are not sampled from prior know PDF, current population it influenced by difference between individual of the
6 Differential Evolution
Difference Vector
Positions of individuals provide valuable information about fitness landscape.
At first, individuals are distributed and over the time they converge to a same solution Differences large evolution in beginning bigger step size (exploring) Differences are small search process (exploiting) at smaller the step end of of size
DE operators
Mutation Crossover Selection 7 Differential Evolution
8 Differential Evolution
mutation
Mutation produces a trial vector for each individual This trial vector then will be used by crossover operator to produce offspring For each parent vector as follow: , we make a trial
mutation (cont)
Target vector 9 Differential Evolution Weighted Differential Where:
10 Differential Evolution
Geometrical Illustration (mutation)
11 Differential Evolution
Crossover
DE crossover is a recombination of trial vector, ,and parent vector , to produce offspring, :
12 Differential Evolution
Methods to determine
Binomial crossover: Problem dimention
13 Differential Evolution
Methods to determine
Exponential crossover:
Differential Evolution 14
Geometrical Illustration (crossover)
15 Differential Evolution
Selection
selecting an individual to take part in mutation to make the trial vector.
Random selection
select a target vector.
Random or Best individual selection between parent and offspring to spring.
Better survive
16
General DE Algorithm
Differential Evolution
17
Control Parameters
Scaling factor
Differential Evolution The smaller the value of step size the smaller the small enough to allow differentials to exploit tight valleys, and large enough to maintain diversity.
Empirical results suggest that provides good performance generally
18 Differential Evolution
Control Parameters
Recombination probability
The higher the more variation is introduced in the new population Increasing often results in faster convergence, while decreasing increases search robustness
Differential Evolution
Variation of DE
19 1.
2.
3.
Target vector is selection (x) Number of difference vectors used (y) How crossover points are determined (z)
20 Differential Evolution Target vector is the best individual in current population, One differential vector is used.
Any of the crossover methods.
21 Differential Evolution Any method for Target vector selection more than one difference vector Any of the crossover methods the larger the value of , the more directions can be explored per generation.
22 Differential Evolution is randomly selected The closer is to 1, the more greedy the search process Value of close to 0 favors exploration.
23 Differential Evolution 1.
2.
At list two difference vectors.
calculated from the best vector and the parent vector while the rest of the difference vectors are calculated using randomly selected vectors Empirical studies have shown DE/current- to-best/2/bin shows good convergence
characteristics
24
application
Multiprocessor synthesis Neural network learning Synthesis of modulators Heat transfer parameter estimation Radio network design … Differential Evolution
25 Differential Evolution
References
1.
2.
3.
Computational Intelligence, an introduction,2 nd edition, Andries Engelbercht, Wiley Differential Evolution - A simple and efficient adaptive scheme for global optimization over continuous spaces, Rainer Storn,Kenneth Price,1995 Differential Evolution, homepage http://www.icsi.berkeley.edu/~storn/code.html
26 Differential Evolution
Thanks For Your Attention
Any Question?