English
Related papers

Related papers: Local Feature Filtering for Scalable and Well-Cond…

200 papers

We consider the solution of full column-rank least squares problems by means of normal equations that are preconditioned, symmetrically or non-symmetrically, with a randomized preconditioner. With an effective preconditioner, the solutions…

Numerical Analysis · Mathematics 2025-12-29 Ilse C. F. Ipsen

An observed $K$-dimensional series $\left\{ y_{n}\right\} _{n=1}^{N}$ is expressed in terms of a lower $p$-dimensional latent series called factors $f_{n}$ and random noise $\varepsilon_{n}$. The equation, $y_{n}=Qf_{n}+\varepsilon_{n}$ is…

Computation · Statistics 2018-11-29 Immanuel Manohar

Least squares method is one of the simplest and most popular techniques applied in data fitting, imaging processing and high dimension data analysis. The classic methods like QR and SVD decomposition for solving least squares problems has a…

Numerical Analysis · Mathematics 2018-06-11 Long Chen , Huiwen Wu

Motivated by a growing list of nontraditional statistical estimation problems of the piecewise kind, this paper provides a survey of known results supplemented with new results for the class of piecewise linear-quadratic programs. These are…

Optimization and Control · Mathematics 2018-08-16 Ying Cui , Tsung-Hui Chang , Mingyi Hong , Jong-Shi Pang

Geometry-aware optimizers such as Newton and natural gradient can improve conditioning in deep learning, but scalable variants such as K-FAC, Shampoo, and related preconditioners usually impose structural approximations early, often…

Machine Learning · Computer Science 2026-05-07 Simon Dufort-Labbé , Pierre-Luc Bacon , Razvan Pascanu , Simon Lacoste-Julien , Aristide Baratin

There is currently a huge effort to understand the potential and limitations of variational quantum machine learning (QML) based on the optimization of parameterized quantum circuits. Recent proposals toward dequantizing variational QML…

Quantum Physics · Physics 2025-04-01 Ryan Sweke , Seongwook Shin , Elies Gil-Fuster

Machine learning has been successfully applied to various fields of scientific computing in recent years. In this work, we propose a sparse radial basis function neural network method to solve elliptic partial differential equations (PDEs)…

Numerical Analysis · Mathematics 2023-09-07 Zhiwen Wang , Minxin Chen , Jingrun Chen

We investigate iterative methods with randomized preconditioners for solving overdetermined least-squares problems, where the preconditioners are based on a random embedding of the data matrix. We consider two distinct approaches: the…

Numerical Analysis · Mathematics 2021-04-15 Jonathan Lacotte , Mert Pilanci

Non-uniform message quantization techniques such as reconstruction-computation-quantization (RCQ) improve error-correction performance and decrease hardware complexity of low-density parity-check (LDPC) decoders that use a flooding…

Signal Processing · Electrical Eng. & Systems 2021-04-20 Caleb Terrill , Linfang Wang , Sean Chen , Chester Hulse , Calvin Kuo , Richard Wesel , Dariush Divsalar

Partial differential equations (PDEs) with near singular solutions pose significant challenges for traditional numerical methods, particularly in complex geometries where mesh generation and adaptive refinement become computationally…

Numerical Analysis · Mathematics 2025-07-24 Yangtao Deng , Qiaolin He , Xiaoping Wang

Quantization Error Reconstruction (QER) reduces accuracy loss in Post-Training Quantization (PTQ) by approximating weights as $\mathbf{W} \approx \mathbf{Q} + \mathbf{L}\mathbf{R}$, using a rank-$r$ correction to reconstruct quantization…

Machine Learning · Computer Science 2026-05-14 Yoonjun Cho , Dongjae Jeon , Soeun Kim , Moongyu Jeon , Albert No

We consider the use of extreme learning machines (ELM) for computational partial differential equations (PDE). In ELM the hidden-layer coefficients in the neural network are assigned to random values generated on $[-R_m,R_m]$ and fixed,…

Computational Physics · Physics 2022-06-01 Suchuan Dong , Jielin Yang

Partial differential equations (PDEs) are widely used for modeling various physical phenomena. These equations often depend on certain parameters, necessitating either the identification of optimal parameters or the solution of the…

Numerical Analysis · Mathematics 2025-10-17 Martina Bukač , Iva Manojlović , Boris Muha , Domagoj Vlah

The relaxed physical factorization (RPF) preconditioner is a recent algorithm allowing for the efficient and robust solution to the block linear systems arising from the three-field displacement-velocity-pressure formulation of coupled…

Numerical Analysis · Mathematics 2021-08-10 Matteo Frigo , Nicola Castelletto , Massimiliano Ferronato

Kernel Ridge Regression (KRR) is a simple yet powerful technique for non-parametric regression whose computation amounts to solving a linear system. This system is usually dense and highly ill-conditioned. In addition, the dimensions of the…

Numerical Analysis · Computer Science 2017-07-18 Haim Avron , Kenneth L. Clarkson , David P. Woodruff

Operator learning is a data-driven approximation of mappings between infinite-dimensional function spaces, such as the solution operators of partial differential equations. Kernel-based operator learning can offer accurate, theoretically…

Machine Learning · Computer Science 2025-12-22 Xinyue Yu , Hayden Schaeffer

The onerous task of repeatedly resolving certain parametrized partial differential equations (pPDEs) in, e.g. the optimization context, makes it imperative to design vastly more efficient numerical solvers without sacrificing any accuracy.…

Numerical Analysis · Mathematics 2019-06-19 Yanlai Chen , Sigal Gottlieb , Lijie Ji , Yvon Maday , Zhenli Xu

Partial Differential Equation (PDE) problems often exhibit strong local spatial structures, and effectively capturing these structures is critical for approximating their solutions. Recently, the Fourier Neural Operator (FNO) has emerged as…

Machine Learning · Computer Science 2025-06-05 Chaoyu Liu , Davide Murari , Lihao Liu , Yangming Li , Chris Budd , Carola-Bibiane Schönlieb

In this paper, we consider approximating the parameter-to-solution maps of parametric partial differential equations (PPDEs) using deep neural networks (DNNs). We propose an efficient approach combining reduced collocation methods (RCMs)…

Numerical Analysis · Mathematics 2025-08-18 Guanhang Lei , Zhen Lei , Lei Shi , Chenyu Zeng

This work introduces a novel method for embedding continuous variables into quantum circuits via piecewise polynomial features, utilizing low-rank tensor networks. Our approach, termed Piecewise Polynomial Tensor Network Quantum Feature…

Quantum Physics · Physics 2025-01-06 Mazen Ali , Matthias Kabel