English
Related papers

Related papers: Accelerating Message Passing for MAP with Benders …

200 papers

As a variant of the routing and wavelength assignment problem (RWAP), the RWAP with partial path protection (RWAP-PPP) designs a reliable optical-fiber network for telecommunications. It assigns paths and wavelengths to meet communication…

Optimization and Control · Mathematics 2025-06-17 Xianyan Yang , Junyan Liu , Fan Zhang , Fabo Sun , Feng Li , Zhou Xu

Autoencoders are a powerful and versatile tool often used for various problems such as anomaly detection, image processing and machine translation. However, their reconstructions are not always trivial to explain. Therefore, we propose a…

Machine Learning · Computer Science 2023-03-22 Kenyu Kobayashi , Renata Khasanova , Arno Schneuwly , Felix Schmidt , Matteo Casserini

Markov random fields (MRFs) are a powerful tool for modelling statistical dependencies for a set of random variables using a graphical representation. An important computational problem related to MRFs, called maximum a posteriori (MAP)…

Data Structures and Algorithms · Computer Science 2017-08-11 Alexander Bauer , Shinichi Nakajima , Nico Görnitz , Klaus-Robert Müller

Approximate-message passing (AMP) algorithms have become an important element of high-dimensional statistical inference, mostly due to their adaptability and concentration properties, the state evolution (SE) equations. This is demonstrated…

Information Theory · Computer Science 2022-04-20 Cédric Gerbelot , Raphaël Berthier

We introduce a new formulation of the Hidden Parameter Markov Decision Process (HiP-MDP), a framework for modeling families of related tasks using low-dimensional latent embeddings. Our new framework correctly models the joint uncertainty…

Machine Learning · Statistics 2017-11-01 Taylor Killian , Samuel Daulton , George Konidaris , Finale Doshi-Velez

Recurrent models for sequences have been recently successful at many tasks, especially for language modeling and machine translation. Nevertheless, it remains challenging to extract good representations from these models. For instance, even…

Machine Learning · Computer Science 2018-01-31 Łukasz Kaiser , Samy Bengio

There has been a lot of recent interest in designing neural network models to estimate a distribution from a set of examples. We introduce a simple modification for autoencoder neural networks that yields powerful generative models. Our…

Machine Learning · Computer Science 2015-06-08 Mathieu Germain , Karol Gregor , Iain Murray , Hugo Larochelle

Many problems in sequential decision making and stochastic control often have natural multiscale structure: sub-tasks are assembled together to accomplish complex goals. Systematically inferring and leveraging hierarchical structure,…

Artificial Intelligence · Computer Science 2012-12-06 Jake Bouvrie , Mauro Maggioni

In the context of the compressed sensing problem, we propose a new ensemble of sparse random matrices which allow one (i) to acquire and compress a {\rho}0-sparse signal of length N in a time linear in N and (ii) to perfectly recover the…

Information Theory · Computer Science 2013-04-15 Maria Chiara Angelini , Federico Ricci-Tersenghi , Yoshiyuki Kabashima

Tensor decomposition methods have proven effective in various applications, including compression and acceleration of neural networks. At the same time, the problem of determining optimal decomposition ranks, which present the crucial…

Machine Learning · Computer Science 2023-04-05 Maxim Kodryan , Dmitry Kropotov , Dmitry Vetrov

The article explores an encoding and structural information processing approach using sparse bit vectors and fixed-length linear vectors. The following are presented: a discrete method of speculative stochastic dimensionality reduction of…

Machine Learning · Computer Science 2025-08-05 Dmitriy Kashitsyn , Dmitriy Shabanov

Tensor decomposition is a mathematically supported technique for data compression. It consists of applying some kind of a Low Rank Decomposition technique on the tensors or matrices in order to reduce the redundancy of the data. However, it…

Machine Learning · Computer Science 2025-05-27 Habib Hajimolahoseini , Walid Ahmed , Austin Wen , Yang Liu

Approximate message passing (AMP) is an algorithmic framework for solving linear inverse problems from noisy measurements, with exciting applications such as reconstructing images, audio, hyper spectral images, and various other signals,…

Information Theory · Computer Science 2017-02-13 Junan Zhu , Ryan Pilgrim , Dror Baron

This paper addresses the problem of collaborative navigation in an unknown environment, where two robots, referred to in the sequel as the Seeker and the Supporter, traverse the space simultaneously. The Supporter assists the Seeker by…

Robotics · Computer Science 2025-06-26 Ali Reza Pedram , Evangelos Psomiadis , Dipankar Maity , Panagiotis Tsiotras

This paper explores the application of reinforcement learning techniques to enhance the performance of decoding of linear block codes based on flipping bits and finding optimal decisions. We describe the methodology for mapping the…

Information Theory · Computer Science 2025-07-29 Milad Taghipour , Bane Vasic

Linear encoding of sparse vectors is widely popular, but is commonly data-independent -- missing any possible extra (but a priori unknown) structure beyond sparsity. In this paper we present a new method to learn linear encoders that adapt…

As dynamical systems equipped with neural network controllers (neural feedback systems) become increasingly prevalent, it is critical to develop methods to ensure their safe operation. Verifying safety requires extending control theoretic…

Systems and Control · Electrical Eng. & Systems 2026-04-15 I. Samuel Akinwande , Chelsea Sidrane , Mykel J. Kochenderfer , Clark Barrett

Probabilistic inference in pairwise Markov Random Fields (MRFs), i.e. computing the partition function or computing a MAP estimate of the variables, is a foundational problem in probabilistic graphical models. Semidefinite programming…

Machine Learning · Computer Science 2021-05-04 Chirag Pabbaraju , Po-Wei Wang , J. Zico Kolter

We propose a novel approach to iterated sparse matrix dense matrix multiplication, a fundamental computational kernel in scientific computing and graph neural network training. In cases where matrix sizes exceed the memory of a single…

We study a distributed learning problem in which $n$ agents, each with potentially heterogeneous local data, collaboratively minimize the sum of their local cost functions via peer-to-peer communication. We propose a novel algorithm,…

Optimization and Control · Mathematics 2025-07-29 Runze You , Shi Pu