xiaoming xue

and 5 more

Evolutionary sequential transfer optimization (ESTO), which attempts to enhance the evolutionary search of a target task using the knowledge captured from several previously-solved source tasks, has been receiving increasing research attention in recent years. Despite the tremendous approaches developed, it is worth noting that existing benchmark problems for ESTO are not well designed, as they are often simply extended from other benchmarks in which the relationships between the source and target tasks are not well analyzed. Consequently, the comparisons conducted on these problems are not systematic and can only provide numerical results without a deeper analysis of how an ESTO algorithm performs on problems with different properties. Taking this clue, this two-part paper revisits a large body of solution-based ESTO algorithms on a group of newly developed test problems, to help researchers and practitioners gain a deeper understanding of how to better exploit optimization experience towards enhanced optimization performance. Part A of the series designs a problem generator based on several newly defined concepts to generate benchmark problems with diverse properties, which are competitive in resembling real-world problems. Part B of the series empirically revisits various algorithms by answering five key research questions related to knowledge transfer. The results demonstrated that the performance of many ESTO algorithms is highly problem-dependent, which suggest the necessity of more research efforts on transferability measurement and enhancement in ESTO algorithm design. The source code of the benchmark suite developed in part A is available at https://github.com/XmingHsueh/Revisiting-S-ESTOs-PartA.

xiaoming xue

and 5 more

This paper is the second part of a two-part series on evolutionary sequential transfer optimization (ESTO). The first part designs a problem generator to generate benchmark problems with diverse properties that can better resemble real-world problems. This part proposes five research questions (RQs) to empirically revisit a large body of knowledge transfer techniques in the context of solution-based ESTO (S-ESTO). Particularly, knowledge transfer techniques are organized from a perspective of transfer strategy, including solution selection, solution adaptation, and the integration of them. The results reveal that the performance of many algorithms is highly sensitive to similarity distribution of STOPs, which suggest the necessity of more flexible algorithm design in future studies. Specifically, when an STOP is full of source tasks that are highly similar to the target task in terms of optimum, one can randomly select one source task and reuse its elite solution(s) to accelerate the target search significantly. When an STOP contains source tasks with mixed similarities to the target task, an effective similarity metric that can represent the transferability is able to identify highly transferable solution(s). When an STOP is full of source tasks with low similarities to the target task, the transferability is expected to be improved by solution adaptation. In solution adaptation, a similarity metric in the form of a maximization (or minimization) objective function that is responsible for representing the transferability is optimized to obtain a mapping function for adapting source solution(s). The source code for reproducing our experiments is available at https://github.com/XmingHsueh/Revisiting-S-ESTOs-PartB.