English
Related papers

Related papers: Approximation Guarantees for the Non-Dominated Sor…

200 papers

We show that, for finite-sum minimization problems, incorporating partial second-order information of the objective function can dramatically improve the robustness to mini-batch size of variance-reduced stochastic gradient methods, making…

Optimization and Control · Mathematics 2024-04-24 Sachin Garg , Albert S. Berahas , Michał Dereziński

The performance of multi-objective evolutionary algorithms deteriorates appreciably in solving many-objective optimization problems which encompass more than three objectives. One of the known rationales is the loss of selection pressure…

Neural and Evolutionary Computing · Computer Science 2018-02-27 Yanan Sun , Gary G. Yen , Zhang Yi

Semantics has become a key topic of research in Genetic Programming (GP). Semantics refers to the outputs (behaviour) of a GP individual when this is run on a data set. The majority of works that focus on semantic diversity in…

Neural and Evolutionary Computing · Computer Science 2021-12-22 Edgar Galván , Leonardo Trujillo , Fergal Stapleton

Although the population size is an important parameter in evolutionary multi-objective optimization (EMO), little is known about its influence on preference-based EMO (PBEMO). The effectiveness of an unbounded external archive (UA) in PBEMO…

Neural and Evolutionary Computing · Computer Science 2023-04-10 Ryoji Tanabe

This paper deals with discrete topology optimization and describes the modification of a single-objective algorithm into its multi-objective counterpart. The result is a significant increase in the optimization speed and quality of the…

Neural and Evolutionary Computing · Computer Science 2025-03-13 Petr Kadlec , Miloslav Capek

We consider the problem of computing a Gaussian approximation to the posterior distribution of a parameter given a large number N of observations and a Gaussian prior, when the dimension of the parameter d is also large. To address this…

Data Structures and Algorithms · Computer Science 2023-03-28 Marc Lambert , Silvère Bonnabel , Francis Bach

The optimal mixing evolutionary algorithms (OMEAs) have recently drawn much attention for their robustness, small size of required population, and efficiency in terms of number of function evaluations (NFE). In this paper, the performances…

Neural and Evolutionary Computing · Computer Science 2018-07-30 Yu-Fan Tung , Tian-Li Yu

Stochastic gradients have been widely integrated into Langevin-based methods to improve their scalability and efficiency in solving large-scale sampling problems. However, the proximal sampler, which exhibits much faster convergence than…

Machine Learning · Statistics 2024-05-28 Xunpeng Huang , Difan Zou , Yi-An Ma , Hanze Dong , Tong Zhang

The remarkable attention which fair clustering has received in the last few years has resulted in a significant number of different notions of fairness. Despite the fact that these notions are well-justified, they are often motivated and…

Machine Learning · Computer Science 2023-06-01 John Dickerson , Seyed A. Esmaeili , Jamie Morgenstern , Claire Jie Zhang

Designing fair algorithmic decision systems requires balancing model performance with fairness toward affected individuals: More fairness might require sacrificing some performance and vice versa, yet the space of possible trade-offs is…

Machine Learning · Computer Science 2026-05-12 Mieke Wilms , Christoph Heitz

Many problems in statistics and machine learning require the reconstruction of a rank-one signal matrix from noisy data. Enforcing additional prior information on the rank-one component is often key to guaranteeing good recovery…

Machine Learning · Statistics 2020-11-10 Jorio Cocola , Paul Hand , Vladislav Voroninski

Evolutionary algorithms (EAs) have been widely used to solve multi-objective optimization problems, and have become the most popular tool. However, the theoretical foundation of multi-objective EAs (MOEAs), especially the essential…

Neural and Evolutionary Computing · Computer Science 2022-03-23 Chao Bian , Chao Qian

Crowd counting is gaining societal relevance, particularly in domains of Urban Planning, Crowd Management, and Public Safety. This paper introduces Fourier-guided attention (FGA), a novel attention mechanism for crowd count estimation…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Yashwardhan Chaudhuri , Ankit Kumar , Arun Balaji Buduru , Adel Alshamrani

We develop a new randomized iterative algorithm---stochastic dual ascent (SDA)---for finding the projection of a given vector onto the solution space of a linear system. The method is dual in nature: with the dual being a non-strongly…

Numerical Analysis · Mathematics 2016-01-29 Robert Mansel Gower , Peter Richtarik

In this manuscript, we address continuous unconstrained multi-objective optimization problems and we discuss descent type methods for the reconstruction of the Pareto set. Specifically, we analyze the class of Front Descent methods, which…

Optimization and Control · Mathematics 2026-04-08 Matteo Lapucci , Pierluigi Mansueto , Davide Pucci

We propose a multi-swarm approach to approximate the Pareto front of general multi-objective optimization problems that is based on the Consensus-based Optimization method (CBO). The algorithm is motivated step by step beginning with a…

Optimization and Control · Mathematics 2022-11-30 Kathrin Klamroth , Michael Stiglmayr , Claudia Totzeck

Gaussian processes (GPs) provide a probabilistic nonparametric representation of functions in regression, classification, and other problems. Unfortunately, exact learning with GPs is intractable for large datasets. A variety of approximate…

Machine Learning · Computer Science 2010-02-23 Yuan Qi , Ahmed H. Abdel-Gawad , Thomas P. Minka

We introduce Pareto-NRPA, a new Monte-Carlo algorithm designed for multi-objective optimization problems over discrete search spaces. Extending the Nested Rollout Policy Adaptation (NRPA) algorithm originally formulated for single-objective…

Artificial Intelligence · Computer Science 2025-11-04 Noé Lallouet , Tristan Cazenave , Cyrille Enderli

We study the compatibility between the optimal statistical parity solutions and individual fairness. While individual fairness seeks to treat similar individuals similarly, optimal statistical parity aims to provide similar treatment to…

Statistics Theory · Mathematics 2024-01-17 Shizhou Xu , Thomas Strohmer

Let $\theta_0,\theta_1 \in \mathbb{R}^d$ be the population risk minimizers associated to some loss $\ell:\mathbb{R}^d\times \mathcal{Z}\to\mathbb{R}$ and two distributions $\mathbb{P}_0,\mathbb{P}_1$ on $\mathcal{Z}$. The models…

Statistics Theory · Mathematics 2021-07-13 Dmitrii M. Ostrovskii , Mohamed Ndaoud , Adel Javanmard , Meisam Razaviyayn