English
Related papers

Related papers: Towards Practical Large-scale Randomized Iterative…

200 papers

Iteratively reweighted least squares (IRLS) is a widely-used method in machine learning to estimate the parameters in the generalised linear models. In particular, IRLS for L1 minimisation under the linear model provides a closed-form…

Cryptography and Security · Computer Science 2016-05-25 Mijung Park , Max Welling

We address the problem of recovering a signal (up to global phase) from its short-time Fourier transform (STFT) magnitude measurements. This problem arises in several applications, including optical imaging and speech processing. In this…

Information Theory · Computer Science 2015-10-06 Tamir Bendory , Yonina C. Eldar

Discovering a concise schema from given XML documents is an important problem in XML applications. In this paper, we focus on the problem of learning an unordered schema from a given set of XML examples, which is actually a problem of…

Databases · Computer Science 2015-04-02 Feifei Peng , Haiming Chen

In this paper we address the problem of uncertainty management for robust design, and verification of large dynamic networks whose performance is affected by an equally large number of uncertain parameters. Many such networks (e.g. power,…

Computation · Statistics 2011-10-12 Amit Surana , Tuhin Sahai , Andrzej Banaszuk

In this paper, we present a framework for online parameter estimation and uncertainty quantification in the context of adaptive safety-critical control. The key insight enabling our approach is that the parameter estimate generated by the…

Systems and Control · Electrical Eng. & Systems 2024-03-14 Max H. Cohen , Makai Mann , Kevin Leahy , Calin Belta

Quantum approximate optimization is one of the promising candidates for useful quantum computation, particularly in the context of finding approximate solutions to Quadratic Unconstrained Binary Optimization (QUBO) problems. However, the…

In this paper, we propose an improved numerical algorithm for solving minimax problems based on nonsmooth optimization, quadratic programming and iterative process. We also provide a rigorous proof of convergence for our algorithm under…

Artificial Intelligence · Computer Science 2025-07-02 Qing Xu , Xiaohua Xuan

We have recently presented a method to solve an overdetermined linear system of equations with multiple right hand side vectors, where the unknown matrix is to be symmetric and positive definite. The coefficient and the right hand side…

Optimization and Control · Mathematics 2014-09-19 Negin Bagherpour , Nezam Mahdavi-Amiri

We develop a recursive total least-squares (RTLS) algorithm for errors-in-variables system identification utilizing the inverse power method and the dichotomous coordinate-descent (DCD) iterations. The proposed algorithm, called DCD-RTLS,…

Systems and Control · Computer Science 2015-06-22 Reza Arablouei , Kutluyıl Doğançay , Stefan Werner

Linear regression is fundamental to statistical analysis and machine learning, but its application to large-scale datasets necessitates distributed computing. The problem also arises in quantum computing, where handling extensive data…

Quantum Physics · Physics 2026-05-26 Sayaki Matsushita

We present a variational algorithm for solving the classical inverse Sturm-Liouville problem in one dimension when two spectra are given. All critical points of the least squares functional are at global minima, which which suggests…

Numerical Analysis · Mathematics 2009-11-11 Norbert Roehrl

In this paper, we propose a novel adaptive stochastic extended iterative method, which can be viewed as an improved extension of the randomized extended Kaczmarz (REK) method, for finding the unique minimum Euclidean norm least-squares…

Numerical Analysis · Mathematics 2025-09-23 Yun Zeng , Deren Han , Yansheng Su , Jiaxin Xie

Rational approximation appears in many contexts throughout science and engineering, playing a central role in linear systems theory, special function approximation, and many others. There are many existing methods for solving the rational…

Numerical Analysis · Mathematics 2018-12-03 Jeffrey M. Hokanson , Caleb C. Magruder

Presented is a new algorithm for estimating the frequency of a single-tone noisy signal using linear least squares (LLS). Frequency estimation is a nonlinear problem, and typically, methods such as Nonlinear Least Squares (NLS) (batch) or a…

Signal Processing · Electrical Eng. & Systems 2019-04-17 Solomon Davis , Izhak Bucher

Real-time identification of electrical equivalent circuit models is a critical requirement in many practical systems, such as batteries and electric motors. Significant work has been done in the past developing different types of algorithms…

Systems and Control · Electrical Eng. & Systems 2021-01-15 Balakumar Balasingam , Krishna Pattipati

This paper aims at distributed algorithms for solving a system of linear algebraic equations. Different from most existing formulations for this problem, we assume that the local data at each node is not accurately measured but subject to…

Optimization and Control · Mathematics 2023-05-10 Yutao Tang , Yicheng Zhang , Ruonan Li , Xinghu Wang

We study problems with stochastic uncertainty information on intervals for which the precise value can be queried by paying a cost. The goal is to devise an adaptive decision tree to find a correct solution to the problem in consideration…

Data Structures and Algorithms · Computer Science 2021-09-27 Steven Chaplick , Magnús M. Halldórsson , Murilo S. de Lima , Tigran Tonoyan

In inverse problems we aim to reconstruct some underlying signal of interest from potentially corrupted and often ill-posed measurements. Classical optimization-based techniques proceed by optimizing a data consistency metric together with…

Image and Video Processing · Electrical Eng. & Systems 2022-10-17 Peimeng Guan , Jihui Jin , Justin Romberg , Mark A. Davenport

We provide a framework for the numerical approximation of distributed optimal control problems, based on least-squares finite element methods. Our proposed method simultaneously solves the state and adjoint equations and is $\inf$--$\sup$…

Numerical Analysis · Mathematics 2023-08-03 Thomas Führer , Michael Karkulik

With the recent emergence of mixed precision hardware, there has been a renewed interest in its use for solving numerical linear algebra problems fast and accurately. The solution of total least squares problems, i.e., solving $\min_{E,r}…

Numerical Analysis · Mathematics 2023-09-14 Eda Oktay , Erin Carson