Hybridizing Hypervolume-Based Evolutionary Algorithms and Gradient Descent by Dynamic Resource Allocation

Hybridizing Hypervolume-Based Evolutionary Algorithms and Gradient Descent by Dynamic Resource Allocation

Ha, Damy M.F. (Centrum Wiskunde & Informatica (CWI); Student TU Delft)
Deist, Timo M. (Centrum Wiskunde & Informatica (CWI))
Bosman, P.A.N. (TU Delft Algorithmics; Centrum Wiskunde & Informatica (CWI))

Rudolph, Günter (editor)
Kononova, Anna V. (editor)
Aguirre, Hernán (editor)
Kerschke, Pascal (editor)
Ochoa, Gabriela (editor)
Tušar, Tea (editor)

2022

Evolutionary algorithms (EAs) are well-known to be well suited for multi-objective (MO) optimization. However, especially in the case of real-valued variables, classic domination-based approaches are known to lose selection pressure when approaching the Pareto set. Indicator-based approaches, such as optimizing the uncrowded hypervolume (UHV), can overcome this issue and ensure that individual solutions converge to the Pareto set. Recently, a gradient-based UHV algorithm, known as UHV-ADAM, was shown to be more efficient than (UHV-based) EAs if few local optima are present. Combining the two techniques could exploit synergies, i.e., the EA could be leveraged to avoid local optima while the efficiency of gradient algorithms could speed up convergence to the Pareto set. It is a priori however not clear what would be the best way to make such a combination. In this work, therefore, we study the use of a dynamic resource allocation scheme to create hybrid UHV-based algorithms. On several bi-objective benchmarks, we find that the hybrid algorithms produce similar or better results than the EA or gradient-based algorithm alone, even when finite differences are used to approximate gradients. The implementation of the hybrid algorithm is available at https://github.com/damyha/uncrowded-hypervolume.

Hybrid algorithm
Multi-objective
Real-valued optimization

http://resolver.tudelft.nl/uuid:f8cd73d6-0962-4d48-a5fc-7db09ae1eb57

https://doi.org/10.1007/978-3-031-14721-0_13

Springer

2023-07-01

9783031147203

Parallel Problem Solving from Nature – PPSN XVII - 17th International Conference, PPSN 2022, Proceedings

17th International Conference on Parallel Problem Solving from Nature, PPSN 2022, 2022-09-10 → 2022-09-14, Dortmund, Germany

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 0302-9743, 13399 LNCS

Green Open Access added to TU Delft Institutional Repository 'You share, we take care!' - Taverne project https://www.openaccess.nl/en/you-share-we-take-care Otherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public.

Institutional Repository

conference paper

© 2022 Damy M.F. Ha, Timo M. Deist, P.A.N. Bosman