English
Related papers

Related papers: BiLQ: An Iterative Method for Nonsymmetric Linear …

200 papers

This study compares sequential image classification methods based on recurrent neural networks. We describe methods based on recurrent neural networks such as Long-Short-Term memory(LSTM), bidirectional Long-Short-Term memory(BiLSTM)…

Image and Video Processing · Electrical Eng. & Systems 2022-09-26 Gajraj Kuldeep

Pretrained large language models (LLMs) exhibit exceptional general language processing capabilities but come with significant demands on memory and computational resources. As a powerful compression technology, binarization can extremely…

Machine Learning · Computer Science 2024-06-19 Wei Huang , Yangdong Liu , Haotong Qin , Ying Li , Shiming Zhang , Xianglong Liu , Michele Magno , Xiaojuan Qi

We study the law of the iterated logarithm (LIL) for the maximum likelihood estimation of the parameters (as a convex optimization problem) in the generalized linear models with independent or weakly dependent ($\rho$-mixing, $m$-dependent)…

Statistics Theory · Mathematics 2020-04-28 Xiaowei Yang , Shuang Song , Huiming Zhang

We describe a parallel iterative least squares solver named \texttt{LSRN} that is based on random normal projection. \texttt{LSRN} computes the min-length solution to $\min_{x \in \mathbb{R}^n} \|A x - b\|_2$, where $A \in \mathbb{R}^{m…

Data Structures and Algorithms · Computer Science 2012-02-21 Xiangrui Meng , Michael A. Saunders , Michael W. Mahoney

We present new iterative algorithms for solving a square linear system $Ax=b$ in dimension $n$ by employing the {\it Triangle Algorithm} \cite{kal12}, a fully polynomial-time approximation scheme for testing if the convex hull of a finite…

Numerical Analysis · Computer Science 2012-10-31 Bahman Kalantari

Recent advancements in quantum computing and quantum-inspired algorithms have sparked renewed interest in binary optimization. These hardware and software innovations promise to revolutionize solution times for complex problems. In this…

A generalized skew-symmetric Lanczos bidiagonalization (GSSLBD) method is proposed to compute several extreme eigenpairs of a large matrix pair $(A,B)$, where $A$ is skew-symmetric and $B$ is symmetric positive definite. The underlying…

Numerical Analysis · Mathematics 2026-03-24 Jinzhi Huang

NISQ (Noisy, Intermediate-Scale Quantum) computing requires error mitigation to achieve meaningful computation. Our compilation tool development focuses on the fact that the error rates of individual qubits are not equal, with a goal of…

Quantum Physics · Physics 2020-06-04 Shin Nishio , Yulu Pan , Takahiko Satoh , Hideharu Amano , Rodney Van Meter

We present randUBV, a randomized algorithm for matrix sketching based on the block Lanzcos bidiagonalization process. Given a matrix $\bf{A}$, it produces a low-rank approximation of the form ${\bf UBV}^T$, where $\bf{U}$ and $\bf{V}$ have…

Numerical Analysis · Mathematics 2021-02-09 Eric Hallman

Complementary-label learning (CLL) is a weakly supervised paradigm where instances are labeled with classes they do not belong to. Despite a decade of research, CLL methods remain competitive mainly on 10-class classification, with scaling…

Machine Learning · Computer Science 2026-05-19 Tan-Ha Mai , Chao-Kai Chiang , Han-Hwa Shih , Gang Niu , Masashi Sugiyama , Hsuan-Tien Lin

A wide variety of (fixed-point) iterative methods for the solution of nonlinear equations (in Hilbert spaces) exists. In many cases, such schemes can be interpreted as iterative local linearization methods, which, as will be shown, can be…

Numerical Analysis · Mathematics 2019-10-16 Pascal Heid , Thomas P. Wihler

We introduce the lookahead-bounded Q-learning (LBQL) algorithm, a new, provably convergent variant of Q-learning that seeks to improve the performance of standard Q-learning in stochastic environments through the use of ``lookahead'' upper…

Machine Learning · Computer Science 2020-06-30 Ibrahim El Shar , Daniel R. Jiang

Cyclic reduction is a method for the solution of (block-)tridiagonal linear systems. In this note we review the method tailored to hermitian positive definite banded linear systems. The reviewed method has the following advantages: It is…

Numerical Analysis · Mathematics 2018-07-03 Martin Neuenhofen

This paper focuses on the discrete-time backward stochastic linear quadratic (BSLQ) optimal control problem with nonhomogeneous system terms and cost function cross terms. The terminal constraint of such systems distinguishes it from…

Optimization and Control · Mathematics 2026-04-14 Hu Ligui , Meng Qingxin , Tang Maoning

Addressing large-scale indefinite least squares (ILS) problem poses notable computational bottlenecks in the field of numerical linear algebra. State-of-the-art iterative schemes for such problems are predominantly constructed upon the…

Numerical Analysis · Mathematics 2026-05-08 Jun Li , Lingsheng Meng

A promising method for constructing a data-driven output-feedback control law involves the construction of a model-free observer. The Linear Quadratic Regulator (LQR) optimal control policy can then be obtained by both policy-iteration (PI)…

Optimization and Control · Mathematics 2025-09-24 Liquan Lin , Haoyan Lin , Jie Huang

A classical approach for solving discrete time nonlinear control on a finite horizon consists in repeatedly minimizing linear quadratic approximations of the original problem around current candidate solutions. While widely popular in many…

Optimization and Control · Mathematics 2025-07-08 Vincent Roulet , Siddhartha Srinivasa , Maryam Fazel , Zaid Harchaoui

Motion planning under uncertainty is of significant importance for safety-critical systems such as autonomous vehicles. Such systems have to satisfy necessary constraints (e.g., collision avoidance) with potential uncertainties coming from…

Robotics · Computer Science 2021-08-24 Jianyu Chen , Yutaka Shimizu , Liting Sun , Masayoshi Tomizuka , Wei Zhan

We consider iterative methods for solving linear ill-posed problems with compact operator and right-hand side only available via noise-polluted measurements. Conjugate gradients (CG) applied to the normal equations with an appropriate…

Numerical Analysis · Mathematics 2026-02-19 Daniel Gerth , Kirk M. Soodhalter

It is well known that for singular inconsistent range-symmetric linear systems, the generalized minimal residual (GMRES) method determines a least squares solution without breakdown. The reached least squares solution may be or not be the…

Numerical Analysis · Mathematics 2024-01-24 Kui Du , Jia-Jun Fan , Fang Wang