English
Related papers

Related papers: Constraint Propagation as Information Maximization

200 papers

Diffusion on complex networks is often modeled as a stochastic process. Yet, recent work on strategic diffusion emphasizes the decision power of agents and treats diffusion as a strategic problem. Here we study the computational aspects of…

Computational Complexity · Computer Science 2020-01-31 Marcin Waniek , Khaled Elbassioni , Flavio L. Pinheiro , Cesar A. Hidalgo , Aamena Alshamsi

This thesis is concerned with the design of distributed algorithms for solving optimization problems. We consider networks where each node has exclusive access to a cost function, and design algorithms that make all nodes cooperate to find…

Optimization and Control · Mathematics 2013-12-03 João F. C. Mota

Until now, Computer Scientists have concerned themselves with identifying efficient algorithms for solving the general case of some problem -- that is finding one which performs well when the size of the input tends to infinity. In this…

Computational Complexity · Computer Science 2026-04-21 Mircea-Adrian Digulescu

The need of fast distributed solvers for optimization problems in networked systems has motivated the recent development of the Fast-Lipschitz optimization framework. In such an optimization, problems satisfying certain qualifying…

Optimization and Control · Mathematics 2016-11-17 Martin Jakobsson , Carlo Fischione , Pradeep Chathuranga Weeraddana

Cooperative constraint solving is an area of constraint programming that studies the interaction between constraint solvers with the aim of discovering the interaction patterns that amplify the positive qualities of individual solvers.…

Artificial Intelligence · Computer Science 2007-05-23 Evgueni Petrov , Eric Monfroy

Computational complexity is a core theory of computer science, which dictates the degree of difficulty of computation. There are many problems with high complexity that we have to deal, which is especially true for AI. This raises a big…

Computational Complexity · Computer Science 2023-01-10 Chuyu Xiong

This paper is concerned with the study of constrained statistical learning problems, the unconstrained version of which are at the core of virtually all of modern information processing. Accounting for constraints, however, is paramount to…

Machine Learning · Computer Science 2020-02-14 Luiz F. O. Chamon , Santiago Paternain , Miguel Calvo-Fullana , Alejandro Ribeiro

Iterative algorithms aimed at solving some problems are discussed. For certain problems, such as finding a common point in the intersection of a finite number of convex sets, there often exist iterative algorithms that impose very little…

Optimization and Control · Mathematics 2010-09-28 Y. Censor , R. Davidi , G. T. Herman

We study the phase diagram and the algorithmic hardness of the random `locked' constraint satisfaction problems, and compare them to the commonly studied 'non-locked' problems like satisfiability of boolean formulas or graph coloring. The…

Disordered Systems and Neural Networks · Physics 2008-12-09 Lenka Zdeborová , Marc Mézard

Stochastic optimisation algorithms are the de facto standard for machine learning with large amounts of data. Handling only a subset of available data in each optimisation step dramatically reduces the per-iteration computational costs,…

Numerical Analysis · Mathematics 2024-12-19 Matthias J. Ehrhardt , Zeljko Kereta , Jingwei Liang , Junqi Tang

We initiate a formal study of reproducibility in optimization. We define a quantitative measure of reproducibility of optimization procedures in the face of noisy or error-prone operations such as inexact or stochastic gradient computations…

Optimization and Control · Mathematics 2022-12-06 Kwangjun Ahn , Prateek Jain , Ziwei Ji , Satyen Kale , Praneeth Netrapalli , Gil I. Shamir

We study computational and statistical consequences of problem geometry in stochastic and online optimization. By focusing on constraint set and gradient geometry, we characterize the problem families for which stochastic- and…

Optimization and Control · Mathematics 2025-07-17 Chen Cheng , Daniel Levy , John C. Duchi

We study the approximation of general multiobjective optimization problems with the help of scalarizations. Existing results state that multiobjective minimization problems can be approximated well by norm-based scalarizations. However, for…

Optimization and Control · Mathematics 2023-05-25 Stephan Helfrich , Arne Herzel , Stefan Ruzika , Clemens Thielen

Preference queries are relational algebra or SQL queries that contain occurrences of the winnow operator ("find the most preferred tuples in a given relation"). Such queries are parameterized by specific preference relations. Semantic…

Databases · Computer Science 2007-05-23 Jan Chomicki

This paper extends algorithms that remove the fixed point bias of decentralized gradient descent to solve the more general problem of distributed optimization over subspace constraints. Leveraging the integral quadratic constraint…

Optimization and Control · Mathematics 2022-10-31 Dennis J. Marquis , Dany Abou Jaoude , Mazen Farhood , Craig A. Woolsey

Operations research practitioners frequently want to model complicated functions that are are difficult to encode in their underlying optimisation framework. A common approach is to solve an approximate model, and to use a simulation to…

Optimization and Control · Mathematics 2022-07-06 Michael Forbes , Mitchell Harris , Marijn Jansen , Femke van der Schoot , Thomas Taimre

Recent advances in convex optimization have leveraged computer-assisted proofs to develop optimized first-order methods that improve over classical algorithms. However, each optimized method is specially tailored for a particular problem…

Optimization and Control · Mathematics 2025-07-01 Jinho Bok , Jason M. Altschuler

Constraint programming uses enumeration and search tree pruning to solve combinatorial optimization problems. In order to speed up this solution process, we investigate the use of semidefinite relaxations within constraint programming. In…

Discrete Mathematics · Computer Science 2007-05-23 Willem Jan van Hoeve

It is increasingly common to solve combinatorial optimisation problems that are partially-specified. We survey the case where the objective function or the relations between variables are not known or are only partially specified. The…

Machine Learning · Computer Science 2022-05-23 Stefano Teso , Laurens Bliek , Andrea Borghesi , Michele Lombardi , Neil Yorke-Smith , Tias Guns , Andrea Passerini

In this thesis, we explore streaming algorithms for approximating constraint satisfaction problems (CSPs). The setup is roughly the following: A computer has limited memory space, sees a long "stream" of local constraints on a set of…

Data Structures and Algorithms · Computer Science 2023-04-14 Noah G. Singer