English
Related papers

Related papers: Performance Metrics for Multi-Objective Optimisati…

200 papers

We present MOSS, a multi-objective optimization framework for constructing stable sets of decision rules. MOSS incorporates three important criteria for interpretability: sparsity, accuracy, and stability, into a single multi-objective…

Optimization and Control · Mathematics 2025-07-31 Brian Liu , Rahul Mazumder

We examine how various types of noise in the parallel training data impact the quality of neural machine translation systems. We create five types of artificial noise and analyze how they degrade performance in neural and statistical…

Computation and Language · Computer Science 2020-09-14 Huda Khayrallah , Philipp Koehn

Policy robustness in Reinforcement Learning may not be desirable at any cost: the alterations caused by robustness requirements from otherwise optimal policies should be explainable, quantifiable and formally verifiable. In this work we…

Machine Learning · Computer Science 2023-12-12 Daniel Jarne Ornia , Licio Romao , Lewis Hammond , Manuel Mazo , Alessandro Abate

Machine learning assumes a pivotal role in our data-driven world. The increasing scale of models and datasets necessitates quick and reliable algorithms for model training. This dissertation investigates adaptivity in machine learning…

Machine Learning · Computer Science 2023-11-20 Slavomír Hanzely

The success of nonlinear noise reduction applied to a single channel recording of human voice is measured in terms of the recognition rate of a commercial speech recognition program in comparison to the optimal linear filter. The overall…

Data Analysis, Statistics and Probability · Physics 2007-06-20 Krzysztof Urbanowicz , Holger Kantz

This paper deals with the problem of finding suboptimal values of an unknown function on the basis of measured data corrupted by bounded noise. As a prior, we assume that the unknown function is parameterized in terms of a number of basis…

Optimization and Control · Mathematics 2025-06-10 Jaap Eising , Jorge Cortes

Random forests are among the most popular classification and regression methods used in industrial applications. To be effective, the parameters of random forests must be carefully tuned. This is usually done by choosing values that…

Machine Learning · Statistics 2018-07-03 C. H. Bryan Liu , Benjamin Paul Chamberlain , Duncan A. Little , Angelo Cardoso

In derivative-free and blackbox optimization, the objective function is often evaluated through the execution of a computer program seen as a blackbox. It can be noisy, in the sense that its outputs are contaminated by random errors.…

Optimization and Control · Mathematics 2019-11-15 Stéphane Alarie , Charles Audet , Pierre-Yves Bouchet , Sébastien Le Digabel

We study the problem of optimizing nonlinear objective functions over bipartite matchings. While the problem is generally intractable, we provide several efficient algorithms for it, including a deterministic algorithm for maximizing convex…

Optimization and Control · Mathematics 2008-07-24 Yael Berstein , Shmuel Onn

What is a fair performance metric? We consider the choice of fairness metrics through the lens of metric elicitation -- a principled framework for selecting performance metrics that best reflect implicit preferences. The use of metric…

Machine Learning · Statistics 2020-11-04 Gaurush Hiranandani , Harikrishna Narasimhan , Oluwasanmi Koyejo

We derive the ultimate bounds on the performance of nonlinear measurement schemes in the presence of noise. In particular, we investigate the precision of the second-order estimation scheme in the presence of the two most detrimental types…

Quantum Physics · Physics 2014-02-17 Marcin Zwierz , Howard M. Wiseman

Learning performance can show non-monotonic behavior. That is, more data does not necessarily lead to better models, even on average. We propose three algorithms that take a supervised learning model and make it perform more monotone. We…

Machine Learning · Computer Science 2019-11-26 Tom J. Viering , Alexander Mey , Marco Loog

The aim of this literature is to illustrate the application of multi-objective optimization routines through a case study of face milling operation. For this purpose, the face milling operation is designed as a multi-objective optimization…

Optimization and Control · Mathematics 2023-01-24 Nazmul Hasan

Large language models (LLMs) have achieved top results in recent machine translation evaluations, but they are also known to be sensitive to errors and perturbations in their prompts. We systematically evaluate how both humanly plausible…

Computation and Language · Computer Science 2025-09-03 Patrícia Schmidtová , Niyati Bafna , Seth Aycock , Gianluca Vico , Wiktor Kamzela , Katharina Hämmerl , Vilém Zouhar

It is challenging to quantify numerical preferences for different objectives in a multi-objective decision-making problem. However, the demonstrations of a user are often accessible. We propose an algorithm to infer linear preference…

Artificial Intelligence · Computer Science 2023-04-28 Junlin Lu

We present a multi-objective Bayesian optimisation algorithm that allows the user to express preference-order constraints on the objectives of the type "objective A is more important than objective B". These preferences are defined based on…

Machine Learning · Computer Science 2019-11-14 Majid Abdolshah , Alistair Shilton , Santu Rana , Sunil Gupta , Svetha Venkatesh

Dynamic multiobjective optimisation has gained increasing attention in recent years. Test problems are of great importance in order to facilitate the development of advanced algorithms that can handle dynamic environments well. However,…

Neural and Evolutionary Computing · Computer Science 2019-03-07 Shouyong Jiang , Marcus Kaiser , Shengxiang Yang , Stefanos Kollias , Natalio Krasnogor

Hyperparameter tuning is critical to the success of federated learning applications. Unfortunately, appropriately selecting hyperparameters is challenging in federated networks. Issues of scale, privacy, and heterogeneity introduce noise in…

Machine Learning · Computer Science 2023-05-16 Kevin Kuo , Pratiksha Thaker , Mikhail Khodak , John Nguyen , Daniel Jiang , Ameet Talwalkar , Virginia Smith

In this paper, we investigate accelerated first-order methods for smooth convex optimization problems under inexact information on the gradient of the objective. The noise in the gradient is considered to be additive with two possibilities:…

Optimization and Control · Mathematics 2023-01-10 Vasin Artem , Alexander Gasnikov , Pavel Dvurechensky , Vladimir Spokoiny

This paper presents a review of multi-objective deep learning methods that have been introduced in the literature for speech denoising. After stating an overview of conventional, single objective deep learning, and hybrid or combined…

Audio and Speech Processing · Electrical Eng. & Systems 2020-03-30 Arian Azarang , Nasser Kehtarnavaz