English
Related papers

Related papers: Decimation flows in constraint satisfaction proble…

200 papers

A strongly polynomial algorithm is given for the generalized flow maximization problem. It uses a new variant of the scaling technique, called continuous scaling. The main measure of progress is that within a strongly polynomial number of…

Data Structures and Algorithms · Computer Science 2016-03-01 László A. Végh

We introduce an efficient message passing scheme for solving Constraint Satisfaction Problems (CSPs), which uses stochastic perturbation of Belief Propagation (BP) and Survey Propagation (SP) messages to bypass decimation and directly…

Artificial Intelligence · Computer Science 2016-01-05 Siamak Ravanbakhsh , Russell Greiner

We analyse the performance of Belief Propagation Guided Decimation, a physics-inspired message passing algorithm, on the random $k$-XORSAT problem. Specifically, we derive an explicit threshold up to which the algorithm succeeds with a…

Combinatorics · Mathematics 2025-09-03 Arnab Chatterjee , Amin Coja-Oghlan , Mihyun Kang , Lena Krieg , Maurice Rolvien , Gregory B. Sorkin

In this article, we provide a new algorithm for solving constraint satisfaction problems over templates with few subpowers, by reducing the problem to the combination of solvability of a polynomial number of systems of linear equations over…

Logic · Mathematics 2017-11-07 Dejan Delic , Amir El-Aooiti

Recent advancements in quantum computing and quantum-inspired algorithms have sparked renewed interest in binary optimization. These hardware and software innovations promise to revolutionize solution times for complex problems. In this…

We introduce a new protocol for a lossy data compression algorithm which is based on constraint satisfaction gates. We show that the theoretical capacity of algorithms built from standard parity-check gates converges exponentially fast to…

Disordered Systems and Neural Networks · Physics 2009-11-11 S. Ciliberti , M. Mezard , R. Zecchina

Decentralized optimization is widely used in different fields of study such as distributed learning, signal processing, and various distributed control problems. In these types of problems, nodes of the network are connected to each other…

Optimization and Control · Mathematics 2025-12-10 Alexander Rogozin , Nhat Trung Nguyen , Hamed Azami Zenuzagh , Alexander Gasnikov

We study a version of the randomized Kaczmarz algorithm for solving systems of linear equations where the iterates are confined to the solution space of a selected subsystem. We show that the subspace constraint leads to an accelerated…

Numerical Analysis · Mathematics 2024-06-11 Jackie Lok , Elizaveta Rebrova

In an attempt to speed up the solution of the unit commitment (UC) problem, both machine-learning and optimization-based methods have been proposed to lighten the full UC formulation by removing as many superfluous line-flow constraints as…

Optimization and Control · Mathematics 2022-03-15 Álvaro Porras , Salvador Pineda , Juan M. Morales , Asunción Jiménez-Cordero

Over the past years, there has been significant interest in understanding the implicit bias of gradient descent optimization and its connection to the generalization properties of overparametrized neural networks. Several works observed…

Optimization and Control · Mathematics 2025-03-11 Hung-Hsu Chou , Johannes Maly , Claudio Mayrink Verdun , Bernardo Freitas Paulo da Costa , Heudson Mirandola

This paper draws on diverse areas of computer science to develop a unified view of computation: (1) Optimization in operations research, where a numerical objective function is maximized under constraints, is generalized from the numerical…

Artificial Intelligence · Computer Science 2013-02-11 A. Nait Abdallah , M. H. van Emden

The decode-forward achievable region is studied for general networks. The region is subject to a fundamental tension in which nodes individually benefit at the expense of others. The complexity of the region depends on all the ways of…

Information Theory · Computer Science 2022-08-29 Jonathan Ponniah , Liang-Liang Xie

The ability to differentiate through optimization problems has unlocked numerous applications, from optimization-based layers in machine learning models to complex design problems formulated as bilevel programs. It has been shown that…

Optimization and Control · Mathematics 2024-03-05 Lucas Fuentes Valenzuela , Robin Brown , Marco Pavone

This paper develops an analytical method of truncating inequality constrained Gaussian distributed variables where the constraints are themselves described by Gaussian distributions. Existing truncation methods either assume hard…

Systems and Control · Computer Science 2016-06-08 Andrew W. Palmer , Andrew J. Hill , Steven J. Scheding

We consider the problem of communication efficient distributed optimization where multiple nodes exchange important algorithm information in every iteration to solve large problems. In particular, we focus on the stochastic variance-reduced…

Machine Learning · Computer Science 2020-03-16 Hossein S. Ghadikolaei , Sindri Magnusson

Geometric modeling by constraints leads to large systems of algebraic equations. This paper studies bipartite graphs underlaid by systems of equations. It shows how these graphs make possible to polynomially decompose these systems into…

Discrete Mathematics · Computer Science 2014-05-26 Samy Ait-Aoudia , Roland Jegou , Dominique Michelucci

We present a first-order method for solving constrained optimization problems. The method is derived from our previous work, a modified search direction method inspired by singular value decomposition. In this work, we simplify its…

Optimization and Control · Mathematics 2023-02-24 Long Chen , Kai-Uwe Bletzinger , Nicolas R. Gauger , Yinyu Ye

A new field of research is rapidly expanding at the crossroad between statistical physics, information theory and combinatorial optimization. In particular, the use of cutting edge statistical physics concepts and methods allow one to solve…

Neurons and Cognition · Quantitative Biology 2008-03-28 Marc Mezard , Thierry Mora

This document introduces a strategy to solve linear optimization problems. The strategy is based on the bounding condition each constraint produces on each one of the problem's dimension. The solution of a linear optimization problem is…

Optimization and Control · Mathematics 2018-09-24 Gerardo L. Febres

Constraint problems can be trivially solved in parallel by exploring different branches of the search tree concurrently. Previous approaches have focused on implementing this functionality in the solver, more or less transparently to the…

Artificial Intelligence · Computer Science 2010-08-26 Lars Kotthoff , Neil C. A. Moore