English
Related papers

Related papers: Tackling Prevalent Conditions in Unsupervised Comb…

200 papers

Bayesian optimization is a coherent, ubiquitous approach to decision-making under uncertainty, with applications including multi-arm bandits, active learning, and black-box optimization. Bayesian optimization selects decisions (i.e.…

Machine Learning · Computer Science 2023-12-13 Samuel Stanton , Wesley Maddox , Andrew Gordon Wilson

Several interesting problems in multi-robot systems can be cast in the framework of distributed optimization. Examples include multi-robot task allocation, vehicle routing, target protection, and surveillance. While the theoretical analysis…

Robotics · Computer Science 2025-04-03 Andrea Testa , Guido Carnevale , Giuseppe Notarstefano

Unsupervised learning of visual similarities is of paramount importance to computer vision, particularly due to lacking training data for fine-grained similarities. Deep learning of similarities is often based on relationships between pairs…

Computer Vision and Pattern Recognition · Computer Science 2017-04-12 Miguel A Bautista , Artsiom Sanakoyeu , Björn Ommer

A significant progress has been made in the past three decades over the study of combinatorial NP optimization problems and their associated optimization and approximate classes, such as NPO, PO, APX (or APXP), and PTAS. Unfortunately, a…

Computational Complexity · Computer Science 2016-01-07 Tomoyuki Yamakami

Combinatorial Optimization (CO) addresses many important problems, including the challenging Maximum Independent Set (MIS) problem. Alongside exact and heuristic solvers, differentiable approaches have emerged, often using continuous…

Discrete Mathematics · Computer Science 2025-06-10 Ismail Alkhouri , Cedric Le Denmat , Yingjie Li , Cunxi Yu , Jia Liu , Rongrong Wang , Alvaro Velasquez

In this paper, we propose new sequential randomized algorithms for convex optimization problems in the presence of uncertainty. A rigorous analysis of the theoretical properties of the solutions obtained by these algorithms, for full…

Systems and Control · Computer Science 2016-11-17 Mohammadreza Chamanbaz , Fabrizio Dabbene , Roberto Tempo , Venkatakrishnan Venkataramanan , Qing-Guo Wang

This paper provides a non-robust interpretation of the distributionally robust optimization (DRO) problem by relating the distributional uncertainties to the chance probabilities. Our analysis allows a decision-maker to interpret the size…

Optimization and Control · Mathematics 2020-09-22 Qi Wu , Shumin Ma , Cheuk Hang Leung , Wei Liu , Nanbo Peng

We present a fully probabilistic approach for solving binary optimization problems with black-box objective functions and with budget constraints. In the probabilistic approach, the optimization variable is viewed as a random variable and…

Optimization and Control · Mathematics 2024-06-11 Ahmed Attia

We study the problem of distributed mean estimation and optimization under communication constraints. We propose a correlated quantization protocol whose leading term in the error guarantee depends on the mean deviation of data points…

Machine Learning · Computer Science 2022-07-12 Ananda Theertha Suresh , Ziteng Sun , Jae Hun Ro , Felix Yu

Consensus-based optimization (CBO) is an agent-based derivative-free method for non-smooth global optimization that has been introduced in 2017, leveraging a surprising interplay between stochastic exploration and Laplace principle. In…

Analysis of PDEs · Mathematics 2024-10-01 Massimo Fornasier , Lukang Sun

Composite minimization is a powerful framework in large-scale convex optimization, based on decoupling of the objective function into terms with structurally different properties and allowing for more flexible algorithmic design. We…

Optimization and Control · Mathematics 2023-02-17 Jelena Diakonikolas , Cristóbal Guzmán

In combinatorics, the probabilistic method is a very powerful tool to prove the existence of combinatorial objects with interesting and useful properties. Explicit constructions of objects with such properties are often very difficult, or…

Computational Complexity · Computer Science 2007-05-23 Luca Trevisan

Creating impact in real-world settings requires artificial intelligence techniques to span the full pipeline from data, to predictive models, to decisions. These components are typically approached separately: a machine learning model is…

Machine Learning · Computer Science 2018-11-22 Bryan Wilder , Bistra Dilkina , Milind Tambe

In this paper, we explore the graph partitioning problem, a pivotal combina-torial optimization challenge with extensive applications in various fields such as science, technology, and business. Recognized as an NP-hard prob-lem, graph…

Machine Learning · Computer Science 2023-12-13 Vivek Chaudhary

Standard meta-learning for representation learning aims to find a common representation to be shared across multiple tasks. The effectiveness of these methods is often limited when the nuances of the tasks' distribution cannot be captured…

Machine Learning · Computer Science 2021-03-31 Giulia Denevi , Massimiliano Pontil , Carlo Ciliberto

Optimization problems involving complex variables, when solved, are typically transformed into real variables, often at the expense of convergence rate and interpretability. This paper introduces a novel formalism for a prominent problem in…

Optimization and Control · Mathematics 2025-04-07 Raneem Madani , Abdel Lisser

Submodular optimization has numerous applications such as crowdsourcing and viral marketing. In this paper, we study the fundamental problem of non-negative submodular function maximization subject to a $k$-system constraint, which…

Data Structures and Algorithms · Computer Science 2021-06-16 Kai Han , Shuang Cui , Tianshuai Zhu , Jing Tang , Benwei Wu , He Huang

Bayesian optimization is a powerful method for optimizing black-box functions with limited function evaluations. Recent works have shown that optimization in a latent space through deep generative models such as variational autoencoders…

Machine Learning · Computer Science 2023-11-21 Seunghun Lee , Jaewon Chu , Sihyeon Kim , Juyeon Ko , Hyunwoo J. Kim

This paper studies first-order algorithms for solving fully composite optimization problems over convex and compact sets. We leverage the structure of the objective by handling its differentiable and non-differentiable components…

Optimization and Control · Mathematics 2023-07-13 Maria-Luiza Vladarean , Nikita Doikov , Martin Jaggi , Nicolas Flammarion

We study the stochastic optimization of canonical correlation analysis (CCA), whose objective is nonconvex and does not decouple over training samples. Although several stochastic gradient based optimization algorithms have been recently…

Machine Learning · Computer Science 2016-11-15 Weiran Wang , Jialei Wang , Dan Garber , Nathan Srebro