English
Related papers

Related papers: Guidelines for benchmarking of optimization approa…

200 papers

Systems biology seeks to create math models of biological systems to reduce inherent biological complexity and provide predictions for applications such as therapeutic development. However, it remains a challenge to determine which math…

Quantitative Methods · Quantitative Biology 2022-08-05 Vincent D. Zaballa , Elliot E. Hui

This paper surveys the machine learning literature and presents in an optimization framework several commonly used machine learning approaches. Particularly, mathematical optimization models are presented for regression, classification,…

Optimization and Control · Mathematics 2021-01-12 Claudio Gambella , Bissan Ghaddar , Joe Naoum-Sawaya

Bayesian optimization has become widely popular across various experimental sciences due to its favorable attributes: it can handle noisy data, perform well with relatively small datasets, and provide adaptive suggestions for sequential…

Other Quantitative Biology · Quantitative Biology 2025-08-15 Maximilian Siska , Emma Pajak , Katrin Rosenthal , Antonio del Rio Chanona , Eric von Lieres , Laura Marie Helleckes

Due to the high computational demands executing a rigorous comparison between hyperparameter optimization (HPO) methods is often cumbersome. The goal of this paper is to facilitate a better empirical evaluation of HPO methods by providing…

Machine Learning · Computer Science 2019-05-14 Aaron Klein , Frank Hutter

In recent years, the need for neutral benchmark studies that focus on the comparison of methods from computational sciences has been increasingly recognised by the scientific community. While general advice on the design and analysis of…

Modelling, parameter identification, and simulation play an important role in systems biology. Usually, the goal is to determine parameter values that minimise the difference between experimental measurement values and model predictions in…

Mathematical Software · Computer Science 2013-04-10 Thomas Dierkes , Susanna Röblitz , Moritz Wade , Peter Deuflhard

The rapid advances in the field of optimization methods in many pure and applied science pose the difficulty of keeping track of the developments as well as selecting an appropriate technique that best suits the problem in-hand. From a…

Neural and Evolutionary Computing · Computer Science 2011-12-30 Loris Serafino

Mathematical models are increasingly a part of microbiological research. Here, we share our perspective on how modeling advances the discipline by: (i) enforcing logical consistency, (ii) enabling quantitative prediction, (iii) extracting…

Other Quantitative Biology · Quantitative Biology 2026-04-22 Jamie A. Lopez , Amir Erez

Black-box model-based optimization (MBO) problems, where the goal is to find a design input that maximizes an unknown objective function, are ubiquitous in a wide range of domains, such as the design of proteins, DNA sequences, aircraft,…

Machine Learning · Computer Science 2022-02-18 Brandon Trabucco , Xinyang Geng , Aviral Kumar , Sergey Levine

Neuromorphic computing shows promise for advancing computing efficiency and capabilities of AI applications using brain-inspired principles. However, the neuromorphic research field currently lacks standardized benchmarks, making it…

Artificial Intelligence · Computer Science 2025-01-16 Jason Yik , Korneel Van den Berghe , Douwe den Blanken , Younes Bouhadjar , Maxime Fabre , Paul Hueber , Weijie Ke , Mina A Khoei , Denis Kleyko , Noah Pacik-Nelson , Alessandro Pierro , Philipp Stratmann , Pao-Sheng Vincent Sun , Guangzhi Tang , Shenqi Wang , Biyan Zhou , Soikat Hasan Ahmed , George Vathakkattil Joseph , Benedetto Leto , Aurora Micheli , Anurag Kumar Mishra , Gregor Lenz , Tao Sun , Zergham Ahmed , Mahmoud Akl , Brian Anderson , Andreas G. Andreou , Chiara Bartolozzi , Arindam Basu , Petrut Bogdan , Sander Bohte , Sonia Buckley , Gert Cauwenberghs , Elisabetta Chicca , Federico Corradi , Guido de Croon , Andreea Danielescu , Anurag Daram , Mike Davies , Yigit Demirag , Jason Eshraghian , Tobias Fischer , Jeremy Forest , Vittorio Fra , Steve Furber , P. Michael Furlong , William Gilpin , Aditya Gilra , Hector A. Gonzalez , Giacomo Indiveri , Siddharth Joshi , Vedant Karia , Lyes Khacef , James C. Knight , Laura Kriener , Rajkumar Kubendran , Dhireesha Kudithipudi , Shih-Chii Liu , Yao-Hong Liu , Haoyuan Ma , Rajit Manohar , Josep Maria Margarit-Taulé , Christian Mayr , Konstantinos Michmizos , Dylan R. Muir , Emre Neftci , Thomas Nowotny , Fabrizio Ottati , Ayca Ozcelikkale , Priyadarshini Panda , Jongkil Park , Melika Payvand , Christian Pehle , Mihai A. Petrovici , Christoph Posch , Alpha Renner , Yulia Sandamirskaya , Clemens JS Schaefer , André van Schaik , Johannes Schemmel , Samuel Schmidgall , Catherine Schuman , Jae-sun Seo , Sadique Sheik , Sumit Bam Shrestha , Manolis Sifalakis , Amos Sironi , Kenneth Stewart , Matthew Stewart , Terrence C. Stewart , Jonathan Timcheck , Nergis Tömen , Gianvito Urgese , Marian Verhelst , Craig M. Vineyard , Bernhard Vogginger , Amirreza Yousefzadeh , Fatima Tuz Zohora , Charlotte Frenkel , Vijay Janapa Reddi

Quantum computers have the potential to provide an advantage over classical computers in a number of areas. Numerous metrics to benchmark the performance of quantum computers, ranging from their individual hardware components to entire…

Benchmarking is essential for developing and evaluating black-box optimization algorithms, providing a structured means to analyze their search behavior. Its effectiveness relies on carefully selected problem sets used for evaluation. To…

Neural and Evolutionary Computing · Computer Science 2025-11-17 Iván Olarte Rodríguez , Maria Laura Santoni , Fabian Duddeck , Carola Doerr , Thomas Bäck , Elena Raponi

The increasing attention on deep learning has tremendously spurred the design of intelligence processing hardware. The variety of emerging intelligence processors requires standard benchmarks for fair comparison and system optimization (in…

AI models are increasingly prevalent in high-stakes environments, necessitating thorough assessment of their capabilities and risks. Benchmarks are popular for measuring these attributes and for comparing model performance, tracking…

Artificial Intelligence · Computer Science 2024-11-21 Anka Reuel , Amelia Hardy , Chandler Smith , Max Lamparth , Malcolm Hardy , Mykel J. Kochenderfer

Optimal biomarker combinations for treatment-selection can be derived by minimizing total burden to the population caused by the targeted disease and its treatment. However, when multiple biomarkers are present, including all in the model…

Applications · Statistics 2019-06-07 Sayan Dasgupta , Ying Huang

Mathematical methods provide useful framework for the analysis and design of complex systems. In newer contexts such as biology, however, there is a need to both adapt existing methods as well as to develop new ones. Using a combination of…

Molecular Networks · Quantitative Biology 2017-12-06 Abhishek Dey , Shaunak Sen

Pathways that describe the optimal evolution of energy systems across multiple decades are important in energy system research and policy literature, with net-zero and similar climate policies being common drivers behind them. While there…

Physics and Society · Physics 2026-05-12 Ivan Ruiz Manuel , Meijun Chen , Francesco Lombardi , Stefan Pfenninger-Lee

Mathematical models are routinely applied to interpret biological data, with common goals that include both prediction and parameter estimation. A challenge in mathematical biology, in particular, is that models are often complex and…

Methodology · Statistics 2025-11-18 Alexander P Browning , Jennifer A Flegg , Ryan J Murphy

Quantum optimisation is emerging as a promising approach alongside classical heuristics and specialised hardware, yet its performance is often difficult to assess fairly. Traditional benchmarking methods, rooted in digital complexity…

Quantum Physics · Physics 2025-12-10 Frank Phillipson

Optimizing discrete black-box functions is key in several domains, e.g. protein engineering and drug design. Due to the lack of gradient information and the need for sample efficiency, Bayesian optimization is an ideal candidate for these…