English
Related papers

Related papers: Message Passing Least Squares Framework and its Ap…

200 papers

For three decades, carrier-phase observations have been used to obtain the most accurate location estimates using global navigation satellite systems (GNSS). These estimates are computed by minimizing a nonlinear mixed-integer least-squares…

Signal Processing · Electrical Eng. & Systems 2026-01-01 Ophir Uziel , Efi Fogel , Dan Halperin , Sivan Toledo

Group zero-attracting LMS and its reweighted form have been proposed for addressing system identification problems with structural group sparsity in the parameters to estimate. Both algorithms however suffer from a trade-off between…

Signal Processing · Electrical Eng. & Systems 2018-04-02 Danqi Jin , Jie Chen , Cedric Richard , Jingdong Chen

Message-passing (MP) is a powerful tool for finding an approximate solution in optimization. We generalize it to nonlinear product-sum form, and numerically show the fast convergence for the minimum feedback vertex set and the minimum…

Physics and Society · Physics 2024-04-03 Yukio Hayashi

We address the problem of recovering a signal (up to global phase) from its short-time Fourier transform (STFT) magnitude measurements. This problem arises in several applications, including optical imaging and speech processing. In this…

Information Theory · Computer Science 2015-10-06 Tamir Bendory , Yonina C. Eldar

Estimating unknown rotations from noisy measurements is an important step in SfM and other 3D vision tasks. Typically, local optimization methods susceptible to returning suboptimal local minima are used to solve the rotation averaging…

Computer Vision and Pattern Recognition · Computer Science 2019-06-17 Matthew Giamou , Filip Maric , Valentin Peretroukhin , Jonathan Kelly

We propose, theoretically investigate, and numerically validate an algorithm for the Monte Carlo solution of least-squares polynomial approximation problems in a collocation frame- work. Our method is motivated by generalized Polynomial…

Numerical Analysis · Mathematics 2021-05-04 Akil Narayan , John D. Jakeman , Tao Zhou

We propose a recursive least-squares method with multiple forgetting schemes to track time-varying model parameters which change with different rates. Our approach hinges on the reformulation of the classic recursive least-squares with…

Optimization and Control · Mathematics 2015-03-26 Francesco Fraccaroli , Andrea Peruffo , Mattia Zorzi

This paper tackles the problem of jointly estimating the noise covariance matrix alongside states (parameters such as poses and points) from measurements corrupted by Gaussian noise and, if available, prior information. In such settings,…

Robotics · Computer Science 2025-08-13 Kasra Khosoussi , Iman Shames

Message passing algorithms, whose iterative nature captures well complicated interactions among interconnected variables in complex systems and extracts information from the fixed point of iterated messages, provide a powerful toolkit in…

Disordered Systems and Neural Networks · Physics 2022-02-28 Chun-Yan Zhao , Yan-Rong Fu , Jin-Hua Zhao

Randomized matrix compression techniques, such as the Johnson-Lindenstrauss transform, have emerged as an effective and practical way for solving large-scale problems efficiently. With a focus on computational efficiency, however, forsaking…

Machine Learning · Statistics 2015-10-19 Stephen Becker , Ban Kawas , Marek Petrik , Karthikeyan N. Ramamurthy

In a recent paper, the authors proposed a new class of low-complexity iterative thresholding algorithms for reconstructing sparse signals from a small set of linear measurements \cite{DMM}. The new algorithms are broadly referred to as AMP,…

Information Theory · Computer Science 2009-11-24 David L. Donoho , Arian Maleki , Andrea Montanari

Since numbers in the computer are represented with a fixed number of bits, loss of accuracy during calculation is unavoidable. At high precision where more bits (e.g. 64) are allocated to each number, round-off errors are typically small.…

Numerical Analysis · Mathematics 2022-10-11 Yizhou Chen , Xiaoyun Gong , Xiang Ji

This paper introduces an innovative error feedback framework designed to mitigate quantization noise in distributed graph filtering, where communications are constrained to quantized messages. It comes from error spectrum shaping techniques…

Machine Learning · Computer Science 2026-05-12 Xue Xian Zheng , Weihang Liu , Xin Lou , Stefan Vlaski , Tareq Al-Naffouri

In today's era of big data, robust least-squares regression becomes a more challenging problem when considering the adversarial corruption along with explosive growth of datasets. Traditional robust methods can handle the noise but suffer…

Data Structures and Algorithms · Computer Science 2017-10-04 Xuchao Zhang , Liang Zhao , Arnold P. Boedihardjo , Chang-Tien Lu

The paper addresses the model reduction problem for linear and nonlinear systems using the notion of least squares moment matching. For linear systems, the main idea is to approximate a transfer function by ensuring that the interpolation…

Optimization and Control · Mathematics 2021-10-13 Alberto Padoan

Reaching consensus among states of a multi-agent system is a key requirement for many distributed control/optimization problems. Such a consensus is often achieved using the standard Laplacian matrix (for continuous system) or Perron matrix…

Systems and Control · Computer Science 2017-07-25 Zheming Wang , Chong Jin Ong

We investigate the minimal number of failures that can partition a system where processes communicate both through shared memory and by message passing. We prove that this number precisely captures the resilience that can be achieved by…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-12-22 Hagit Attiya , Sweta Kumari , Noa Schiller

This paper proposes and analyzes a communication-efficient distributed optimization framework for general nonconvex nonsmooth signal processing and machine learning problems under an asynchronous protocol. At each iteration, worker machines…

Optimization and Control · Mathematics 2020-07-15 Jineng Ren , Jarvis Haupt

With a unified belief propagation (BP) and mean field (MF) framework, we propose an iterative message passing receiver, which performs joint channel state and noise precision (the reciprocal of noise variance) estimation and decoding for…

Information Theory · Computer Science 2017-11-13 Zhengdao Yuan , Chuanzong Zhang , Zhongyong Wang , Qinghua Guo , Sheng Wu , and Xingye Wang

This paper introduces a novel adaptive framework for processing dynamic flow signals over simplicial complexes, extending classical least-mean-squares (LMS) methods to high-order topological domains. Building on discrete Hodge theory, we…

Signal Processing · Electrical Eng. & Systems 2025-05-30 Lorenzo Marinucci , Claudio Battiloro , Paolo Di Lorenzo