English
Related papers

Related papers: Distributed Least-Squares Iterative Methods in Net…

200 papers

This paper studies an unsupervised deep learning-based numerical approach for solving partial differential equations (PDEs). The approach makes use of the deep neural network to approximate solutions of PDEs through the compositional…

Machine Learning · Computer Science 2020-08-26 Zhiqiang Cai , Jingshuang Chen , Min Liu , Xinyu Liu

Distributed computing is fundamental to multi-agent systems, with solving distributed linear equations as a typical example. In this paper, we study distributed solvers for network linear equations over a network with node-to-node…

Systems and Control · Electrical Eng. & Systems 2024-11-18 Lei Wang , Zihao Ren , Deming Yuan , Guodong Shi

There is a recent surge of interest in developing algorithms for finding sparse solutions of underdetermined systems of linear equations $y = \Phi x$. In many applications, extremely large problem sizes are envisioned, with at least tens of…

Information Theory · Computer Science 2009-04-08 Arian Maleki

Matrix sketching is a powerful tool for reducing the size of large data matrices. Yet there are fundamental limitations to this size reduction when we want to recover an accurate estimator for a task such as least square regression. We show…

Data Structures and Algorithms · Computer Science 2024-05-10 Sachin Garg , Kevin Tan , Michał Dereziński

The problem of connectivity assessment in an asymmetric network represented by a weighted directed graph is investigated in this article. A power iteration algorithm in a centralized implementation is developed first to compute the…

Systems and Control · Electrical Eng. & Systems 2023-08-10 M. Mehdi Asadi , Mohammad Khosravi , Hesam Mosalli , Stephane Blouin , Amir G. Aghdam

This paper studies the distributed adaptiveestimation problems for stochastic large regression modelswith an infinite number of parameters. By constructing a re-cursive local cost function, we propose a novel distributedrecursive least…

Systems and Control · Electrical Eng. & Systems 2026-04-29 Die Gan , Siyu Xie , Zhixin Liu , Xuebo Zhang

The so-called constrained least mean-square algorithm is one of the most commonly used linear-equality-constrained adaptive filtering algorithms. Its main advantages are adaptability and relative simplicity. In order to gain analytical…

Systems and Control · Computer Science 2015-02-26 Reza Arablouei , Kutluyıl Doğançay , Stefan Werner

We propose two distributed iterative algorithms that can be used to solve, in finite time, the distributed optimization problem over quadratic local cost functions in large-scale networks. The first algorithm exhibits synchronous operation…

It is shown that the computational efficiency of the discrete least-squares (DLS) approximation of solutions of stochastic elliptic PDEs is improved by incorporating a reduced-basis method into the DLS framework. The goal is to recover the…

Numerical Analysis · Mathematics 2017-11-09 Max Gunzburger , Michael Schneier , Clayton Webster , Guannan Zhang

We address the problem of sparse recovery in an online setting, where random linear measurements of a sparse signal are revealed sequentially and the objective is to recover the underlying signal. We propose a reweighted least squares (RLS)…

Machine Learning · Computer Science 2017-06-30 Subhadip Mukherjee , Deepak R. , Huaijin Chen , Ashok Veeraraghavan , Chandra Sekhar Seelamantula

We develop a Recursive $\mathcal{L}_1$-Regularized Least Squares (SPARLS) algorithm for the estimation of a sparse tap-weight vector in the adaptive filtering setting. The SPARLS algorithm exploits noisy observations of the tap-weight…

Information Theory · Computer Science 2009-01-08 Behtash Babadi , Nicholas Kalouptsidis , Vahid Tarokh

This paper pertains to the analysis and design of decentralized estimation schemes that make use of limited communication. Briefly, these schemes equip the sensors with scalar states that iteratively merge the measurements and the state of…

Systems and Control · Computer Science 2018-01-19 Andreea B. Alexandru , Sergio Pequito , Ali Jadbabaie , George J. Pappas

Quantization can be used to form new vectors/matrices with shared values close to the original. In recent years, the popularity of scalar quantization for value-sharing applications has been soaring as it has been found huge utilities in…

Machine Learning · Computer Science 2019-12-11 Chen Wang , Xiaomei Yang , Shaomin Fei , Kai Zhou , Xiaofeng Gong , Miao Du , Ruisen Luo

The partial least squares procedure was originally developed to estimate the slope parameter in multivariate parametric models. More recently it has gained popularity in the functional data literature. There, the partial least squares…

Statistics Theory · Mathematics 2012-05-30 Aurore Delaigle , Peter Hall

Non-linear least squares solvers are used across a broad range of offline and real-time model fitting problems. Most improvements of the basic Gauss-Newton algorithm tackle convergence guarantees or leverage the sparsity of the underlying…

Computer Vision and Pattern Recognition · Computer Science 2020-10-22 Huu Le , Christopher Zach , Edward Rosten , Oliver J. Woodford

Randomized matrix compression techniques, such as the Johnson-Lindenstrauss transform, have emerged as an effective and practical way for solving large-scale problems efficiently. With a focus on computational efficiency, however, forsaking…

Machine Learning · Statistics 2015-10-19 Stephen Becker , Ban Kawas , Marek Petrik , Karthikeyan N. Ramamurthy

Partitioning a graph into blocks of roughly equal weight while cutting only few edges is a fundamental problem in computer science with numerous practical applications. While shared-memory parallel partitioners have recently matured to…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-06-06 Peter Sanders , Daniel Seemaier

For three decades, carrier-phase observations have been used to obtain the most accurate location estimates using global navigation satellite systems (GNSS). These estimates are computed by minimizing a nonlinear mixed-integer least-squares…

Signal Processing · Electrical Eng. & Systems 2026-01-01 Ophir Uziel , Efi Fogel , Dan Halperin , Sivan Toledo

Finding sparse cuts is an important tool in analyzing large-scale distributed networks such as the Internet and Peer-to-Peer networks, as well as large-scale graphs such as the web graph, online social communities, and VLSI circuits. In…

Distributed, Parallel, and Cluster Computing · Computer Science 2013-10-22 Atish Das Sarma , Anisur Rahaman Molla , Gopal Pandurangan

This paper considers the multi-agent distributed linear least-squares problem. The system comprises multiple agents, each agent with a locally observed set of data points, and a common server with whom the agents can interact. The agents'…

Optimization and Control · Mathematics 2020-12-01 Kushal Chakrabarti , Nirupam Gupta , Nikhil Chopra