Tutorial: Benchmarking and Analyzing Iterative Optimization Heuristics with IOHprofiler

IOHprofiler is a new benchmarking environment that has been developed for a highly versatile analysis of iterative optimization heuristics (IOHs) such as evolutionary algorithms, local search algorithms, model-based heuristics, etc. A key design principle of IOHprofiler is its highly modular setup, which makes it easy for its users to add algorithms, problems, and performance criteria of their choice. IOHprofiler is also useful for the in-depth analysis of the evolution of adaptive parameters, which can be plotted against fixed-targets or fixed-budgets. The analysis of robustness is also supported.
IOHprofiler supports all types of optimization problems, and is not restricted to a particular search domain. A web-based interface of its analysis procedure is available at http://iohprofiler.liacs.nl, the tool itself is available on GitHub (https://github.com/IOHprofiler/IOHanalyzer) and as CRAN package (https://cran.rstudio.com/web/packages/IOHanalyzer/index.html).
The tutorial addresses all CEC participants interested in analyzing and comparing heuristic solvers. By the end of the tutorial, the participants will known how to benchmark different solvers with IOHprofiler, which performance statistics it supports, and how to contribute to its design.