English
Related papers

Related papers: Pareto-optimal clustering with the primal determin…

200 papers

Efficient exact algorithms for Discrete Optimization (DO) rely heavily on strong primal and dual bounds. Relaxed Decision Diagrams (DDs) provide a versatile mechanism for deriving such dual bounds by compactly over-approximating the…

Artificial Intelligence · Computer Science 2025-12-18 Mohsen Nafar , Michael Römer , Lin Xie

Best subset selection is considered the `gold standard' for many sparse learning problems. A variety of optimization techniques have been proposed to attack this non-convex and NP-hard problem. In this paper, we investigate the dual forms…

Methodology · Statistics 2022-07-06 Shaogang Ren , Guanhua Fang , Ping Li

This paper deals with supervised classification and feature selection in high dimensional space. A classical approach is to project data on a low dimensional space and classify by minimizing an appropriate quadratic cost. A strict control…

Machine Learning · Computer Science 2019-12-02 Michel Barlaud , Antonin Chambolle , Jean-Baptiste Caillau

Deep clustering has the potential to learn a strong representation and hence better clustering performance compared to traditional clustering methods such as $k$-means and spectral clustering. However, this strong representation learning…

Machine Learning · Computer Science 2021-06-01 Hongjing Zhang , Ian Davidson

A recent line of research investigates how algorithms can be augmented with machine-learned predictions to overcome worst case lower bounds. This area has revealed interesting algorithmic insights into problems, with particular success in…

Machine Learning · Computer Science 2021-07-22 Michael Dinitz , Sungjin Im , Thomas Lavastida , Benjamin Moseley , Sergei Vassilvitskii

Multi-objective multi-armed bandit (MO-MAB) problems traditionally aim to achieve Pareto optimality. However, real-world scenarios often involve users with varying preferences across objectives, resulting in a Pareto-optimal arm that may…

Machine Learning · Computer Science 2025-11-18 Linfeng Cao , Ming Shi , Ness B. Shroff

The Information Bottleneck (IB) framework is a general characterization of optimal representations obtained using a principled approach for balancing accuracy and complexity. Here we present a new framework, the Dual Information Bottleneck…

Information Theory · Computer Science 2020-06-09 Zoe Piran , Ravid Shwartz-Ziv , Naftali Tishby

It has been shown that dimension reduction methods such as PCA may be inherently prone to unfairness and treat data from different sensitive groups such as race, color, sex, etc., unfairly. In pursuit of fairness-enhancing dimensionality…

Machine Learning · Computer Science 2020-03-10 Mohammad Mahdi Kamani , Farzin Haddadpour , Rana Forsati , Mehrdad Mahdavi

In this paper we consider a general, challenging distributed optimization set-up arising in several important network control applications. Agents of a network want to minimize the sum of local cost functions, each one depending on a local…

Systems and Control · Computer Science 2018-06-15 Ivano Notarnicola , Giuseppe Notarstefano

Selecting the optimal material for a part designed through topology optimization is a complex problem. The shape and properties of the Pareto front plays an important role in this selection. In this paper we show that the compliance-volume…

Optimization and Control · Mathematics 2022-11-29 Edouard Duriez , Miguel Charlotte , Catherine Azzaro-Pantel , Joseph Morlier

A challenging category of robotics problems arises when sensing incurs substantial costs. This paper examines settings in which a robot wishes to limit its observations of state, for instance, motivated by specific considerations of energy…

Robotics · Computer Science 2023-09-26 Patrick Zhong , Federico Rossi , Dylan A. Shell

Many systems require optimisation over multiple objectives, where objectives are characteristics of the system such as energy consumed or increase in time to perform the work. Optimisation is performed by selecting the `best' set of input…

Performance · Computer Science 2019-10-08 Alexander J. M. Kell , Matthew Forshaw , A. Stephen McGough

In general, a multi-objective optimization problem does not have a single optimal solution but a set of Pareto optimal solutions, which forms the Pareto front in the objective space. Various evolutionary algorithms have been proposed to…

Neural and Evolutionary Computing · Computer Science 2020-06-16 Hisao Ishibuchi , Lie Meng Pang , Ke Shang

Multiple-objective optimization (MOO) aims to simultaneously optimize multiple conflicting objectives and has found important applications in machine learning, such as minimizing classification loss and discrepancy in treating different…

Machine Learning · Computer Science 2022-09-16 Eric Enouen , Katja Mathesius , Sean Wang , Arielle Carr , Sihong Xie

Multi-objective combinatorial optimization seeks Pareto-optimal solutions over exponentially large discrete spaces, yet existing methods sacrifice generality, scalability, or theoretical guarantees. We reformulate it as an online learning…

Machine Learning · Computer Science 2026-02-13 Esha Singh , Dongxia Wu , Chien-Yi Yang , Tajana Rosing , Rose Yu , Yi-An Ma

Based on a preconditioned version of the randomized block-coordinate forward-backward algorithm recently proposed in [Combettes,Pesquet,2014], several variants of block-coordinate primal-dual algorithms are designed in order to solve a wide…

Optimization and Control · Mathematics 2014-10-28 Jean-Christophe Pesquet , Audrey Repetti

Cluster analysis relates to the task of assigning objects into groups which ideally present some desirable characteristics. When a cluster structure is confined to a subset of the feature space, traditional clustering techniques face…

Machine Learning · Statistics 2026-04-14 Efthymios Costa , Ioanna Papatsouma , Angelos Markos

Pareto optimization using evolutionary multi-objective algorithms has been widely applied to solve constrained submodular optimization problems. A crucial factor determining the runtime of the used evolutionary algorithms to obtain good…

Neural and Evolutionary Computing · Computer Science 2023-05-15 Frank Neumann , Carsten Witt

In this paper, we propose a primal-dual splitting algorithm for a broad class of structured composite monotone inclusions that involve finitely many set-valued operators, compositions of set-valued operators with bounded linear operators,…

Optimization and Control · Mathematics 2026-05-14 Minh N. Dao , Hung M. Phan , Matthew K. Tam , Thang D. Truong

This paper is concerned with the study of constrained statistical learning problems, the unconstrained version of which are at the core of virtually all of modern information processing. Accounting for constraints, however, is paramount to…

Machine Learning · Computer Science 2020-02-14 Luiz F. O. Chamon , Santiago Paternain , Miguel Calvo-Fullana , Alejandro Ribeiro