English
Related papers

Related papers: Multi-Objective Optimization and Hyperparameter Tu…

200 papers

A common goal in evolutionary multi-objective optimization is to find suitable finite-size approximations of the Pareto front of a given multi-objective optimization problem. While many multi-objective evolutionary algorithms have proven to…

Neural and Evolutionary Computing · Computer Science 2024-09-26 Hao Wang , Angel E. Rodriguez-Fernandez , Lourdes Uribe , André Deutz , Oziel Cortés-Piña , Oliver Schütze

In this paper, we investigate the problem of optimization multivariate performance measures, and propose a novel algorithm for it. Different from traditional machine learning methods which optimize simple loss functions to learn prediction…

Machine Learning · Computer Science 2015-08-03 Jiachen Yanga , Zhiyong Dinga , Fei Guoa , Huogen Wanga , Nick Hughesb

In this article, we develop a trust-region technique to find critical points of unconstrained set optimization problems with the objective set-valued map defined by finitely many twice continuously differentiable functions. The technique is…

Optimization and Control · Mathematics 2025-09-10 Suprova Ghosh , Debdas Ghosh , Christiane Tammer , Xiaopeng Zhao

Gradient descent method, as one of the major methods in numerical optimization, is the key ingredient in many machine learning algorithms. As one of the most fundamental way to solve the optimization problems, it promises the function value…

Quantum Physics · Physics 2021-02-01 Keren Li , Shijie Wei , Feihao Zhang , Pan Gao , Zengrong Zhou , Tao Xin , Xiaoting Wang , Guilu Long

This paper presents a multi-objective stochastic optimization method for tuning of the controller parameters of Refrigeration Systems based on Vapour Compression. Stochastic Multi Parameter Divergence Optimization (SMDO) algorithm is…

Systems and Control · Computer Science 2018-06-05 Abdullah Ates , Jie Yuan , Sina Dehghan , Yang Zhao , Celaleddin Yeroglu , YangQuan Chen

Probabilistic graphical models have emerged as a powerful modeling tool for several real-world scenarios where one needs to reason under uncertainty. A graphical model's partition function is a central quantity of interest, and its…

Artificial Intelligence · Computer Science 2021-05-25 Durgesh Agrawal , Yash Pote , Kuldeep S Meel

In this paper, an optimization problem with uncertain objective function coefficients is considered. The uncertainty is specified by providing a discrete scenario set, containing possible realizations of the objective function coefficients.…

Data Structures and Algorithms · Computer Science 2023-03-10 Marc Goerigk , Romain Guillaume , Adam Kasperski , Paweł Zieliński

A package query returns a package - a multiset of tuples - that maximizes or minimizes a linear objective function subject to linear constraints, thereby enabling in-database decision support. Prior work has established the equivalence of…

Databases · Computer Science 2023-11-16 Anh L. Mai , Pengyu Wang , Azza Abouzied , Matteo Brucato , Peter J. Haas , Alexandra Meliou

Market area models, such as the Huff model and its extensions, are widely used to estimate regional market shares and customer flows of retail and service locations. Another, now very common, area of application is the analysis of catchment…

Applications · Statistics 2026-04-13 Thomas Wieland

PyUnfold is a Python package for incorporating imperfections of the measurement process into a data analysis pipeline. In an ideal world, we would have access to the perfect detector: an apparatus that makes no error in measuring a desired…

Data Analysis, Statistics and Probability · Physics 2018-06-12 James Bourbeau , Zigfried Hampel-Arias

The control function approach allows the researcher to identify various causal effects of interest. While powerful, it requires a strong invertibility assumption in the selection process, which limits its applicability. This paper expands…

Econometrics · Economics 2026-04-28 Sukjin Han , Hiroaki Kaido

We present a model-agnostic framework for jointly optimizing the predictive performance and interpretability of supervised machine learning models for tabular data. Interpretability is quantified via three measures: feature sparsity,…

Machine Learning · Computer Science 2023-07-18 Lennart Schneider , Bernd Bischl , Janek Thomas

Many real-world multi-objective optimisation problems rely on computationally expensive function evaluations. Multi-objective Bayesian optimisation (BO) can be used to alleviate the computation time to find an approximated set of Pareto…

Machine Learning · Statistics 2022-04-29 Tinkle Chugh

The popularity of Bayesian optimization methods for efficient exploration of parameter spaces has lead to a series of papers applying Gaussian processes as surrogates in the optimization of functions. However, most proposed approaches only…

Machine Learning · Statistics 2015-10-16 Javier González , Zhenwen Dai , Philipp Hennig , Neil D. Lawrence

The goal of multi-objective optimisation is to identify a collection of points which describe the best possible trade-offs between the multiple objectives. In order to solve this vector-valued optimisation problem, practitioners often…

Optimization and Control · Mathematics 2025-05-09 Ben Tu , Nikolas Kantas , Robert M. Lee , Behrang Shafei

Stochastic simulators are increasingly used to expand the frontier of scientific knowledge and inform decision-making across real-world contexts. Simulator calibration, a process by which internal model inputs are tuned to match some…

Computation · Statistics 2026-05-25 David O'Gara , Arindam Fadikar , Mickaël Binois , Nicholson Collier , Jonathan Ozik

There is much interest in using partially observable Markov decision processes (POMDPs) as a formal model for planning in stochastic domains. This paper is concerned with finding optimal policies for POMDPs. We propose several improvements…

Artificial Intelligence · Computer Science 2013-02-01 Nevin Lianwen Zhang , Stephen S. Lee

Advancements in mathematical programming have made it possible to efficiently tackle large-scale real-world problems that were deemed intractable just a few decades ago. However, provably optimal solutions may not be accepted due to the…

Optimization and Control · Mathematics 2023-12-22 Kevin-Martin Aigner , Marc Goerigk , Michael Hartisch , Frauke Liers , Arthur Miehlich

Some quality indicators have been proposed for benchmarking preference-based evolutionary multi-objective optimization algorithms using a reference point. Although a systematic review and analysis of the quality indicators are helpful for…

Neural and Evolutionary Computing · Computer Science 2023-09-27 Ryoji Tanabe , Ke Li

Because the choice and tuning of the optimizer affects the speed, and ultimately the performance of deep learning, there is significant past and recent research in this area. Yet, perhaps surprisingly, there is no generally agreed-upon…

Machine Learning · Computer Science 2019-03-14 Frank Schneider , Lukas Balles , Philipp Hennig