English
Related papers

Related papers: A residual-based message passing algorithm for con…

200 papers

Solving combinatorial optimization problems involve satisfying a set of hard constraints while optimizing some objectives. In this context, exact or approximate methods can be used. While exact methods guarantee the optimal solution, they…

Artificial Intelligence · Computer Science 2024-09-13 Aymen Ben Said , Malek Mouhoub

In this paper, the problem of assigning channel slots to a number of contending stations is modeled as a Constraint Satisfaction Problem (CSP). A learning MAC protocol that uses deterministic backoffs after successful transmissions is used…

Networking and Internet Architecture · Computer Science 2012-10-15 Jaume Barcelo , Nuria Garcia , Azadeh Faridi , Simon Oechsner , Boris Bellalta

In a recent paper, the authors proposed a new class of low-complexity iterative thresholding algorithms for reconstructing sparse signals from a small set of linear measurements \cite{DMM}. The new algorithms are broadly referred to as AMP,…

Information Theory · Computer Science 2009-11-24 David L. Donoho , Arian Maleki , Andrea Montanari

In the era of big data, one of the key challenges is the development of novel optimization algorithms that can accommodate vast amounts of data while at the same time satisfying constraints and limitations of the problem under study. The…

Optimization and Control · Mathematics 2019-09-27 Nicolas Loizou

Network alignment generalizes and unifies several approaches for forming a matching or alignment between the vertices of two graphs. We study a mathematical programming framework for network alignment problem and a sparse variation of it…

Optimization and Control · Mathematics 2011-11-03 Mohsen Bayati , David F. Gleich , Amin Saberi , Ying Wang

Emerging applications of machine learning in numerous areas involve continuous gathering of and learning from streams of data. Real-time incorporation of streaming data into the learned models is essential for improved inference in these…

Machine Learning · Computer Science 2020-12-01 Matthew Nokleby , Haroon Raja , Waheed U. Bajwa

Load balancing plays a critical role in efficiently dispatching jobs in parallel-server systems such as cloud networks and data centers. A fundamental challenge in the design of load balancing algorithms is to achieve an optimal trade-off…

Performance · Computer Science 2020-12-16 Mark van der Boor , Sem Borst , Johan van Leeuwaarden

The fixed parameter tractable (FPT) approach is a powerful tool in tackling computationally hard problems. In this paper, we link FPT results to classic artificial intelligence (AI) techniques to show how they complement each other.…

Artificial Intelligence · Computer Science 2019-07-24 Daniel Karapetyan , Andrew J. Parkes , Gregory Gutin , Andrei Gagarin

Stochastic optimisation algorithms are the de facto standard for machine learning with large amounts of data. Handling only a subset of available data in each optimisation step dramatically reduces the per-iteration computational costs,…

Numerical Analysis · Mathematics 2024-12-19 Matthias J. Ehrhardt , Zeljko Kereta , Jingwei Liang , Junqi Tang

Belief propagation and its variants are popular methods for approximate inference, but their running time and even their convergence depend greatly on the schedule used to send the messages. Recently, dynamic update schedules have been…

Machine Learning · Computer Science 2012-06-26 Charles Sutton , Andrew McCallum

Randomized experiments are a powerful methodology for data-driven evaluation of decisions or interventions. Yet, their validity may be undermined by network interference. This occurs when the treatment of one unit impacts not only its…

Methodology · Statistics 2024-10-08 Sadegh Shirani , Mohsen Bayati

In this paper an innovative Radio Resource Management (RRM) algorithm is proposed with the purpose of increasing High Speed Packet Access (HSPA) performances, in terms of system capacity and service quality, when the Multimedia Broadcast…

Information Theory · Computer Science 2016-06-08 G. Araniti , V. Scordamaglia , A. Molinaro , A. Iera , G. Interdonato , F. Spanò

This work explores multi-modal inference in a high-dimensional simplified model, analytically quantifying the performance gain of multi-modal inference over that of analyzing modalities in isolation. We present the Bayes-optimal performance…

Machine Learning · Statistics 2025-09-30 Christian Keup , Lenka Zdeborová

Several recently proposed stochastic optimization methods that have been successfully used in training deep networks such as RMSProp, Adam, Adadelta, Nadam are based on using gradient updates scaled by square roots of exponential moving…

Machine Learning · Computer Science 2019-04-22 Sashank J. Reddi , Satyen Kale , Sanjiv Kumar

While Attention Residuals has shown some effectiveness in addressing the widespread issue of unbounded activation growth across deep residual layers, it inevitably incurs significant communication overhead. To circumvent this bottleneck, we…

Machine Learning · Computer Science 2026-05-25 Zhizhan Zheng , Feiyun Zhang , Shuchun Liu , Tian Xia , Xi Liu , Dasheng Hu , Hongquan Zhou

High-dimensional time series appear in many scientific setups, demanding a nuanced approach to model and analyze the underlying dependence structure. Theoretical advancements so far often rely on stringent assumptions regarding the sparsity…

Information Theory · Computer Science 2025-03-20 Daria Tieplova , Samriddha Lahiry , Jean Barbier

Sequential recommendation (SR) aims to predict a user's next action by learning from their historical interaction sequences. In real-world applications, these models require periodic updates to adapt to new interactions and evolving user…

Information Retrieval · Computer Science 2026-02-12 Xiaomeng Song , Xinru Wang , Hanbing Wang , Hongyu Lu , Yu Chen , Zhaochun Ren , Zhumin Chen

Regression problems with bounded continuous outcomes frequently arise in real-world statistical and machine learning applications, such as the analysis of rates and proportions. A central challenge in this setting is predicting a response…

Machine Learning · Statistics 2025-07-21 Zhanli Wu , Fabrizio Leisen , F. Javier Rubio

Approximations of optimization problems arise in computational procedures and sensitivity analysis. The resulting effect on solutions can be significant, with even small approximations of components of a problem translating into large…

Optimization and Control · Mathematics 2022-08-10 Johannes O. Royset

Many real world problems naturally appear as constraints satisfaction problems (CSP), for which very efficient algorithms are known. Most of these involve the combination of two techniques: some direct propagation of constraints between…

Artificial Intelligence · Computer Science 2013-04-12 Denis Berthier