English
Related papers

Related papers: Parametric PDEs: Sparse or Low-Rank Approximations…

200 papers

Incorporating a non-Euclidean variable metric to first-order algorithms is known to bring enhancement. However, due to the lack of an optimal choice, such an enhancement appears significantly underestimated. In this work, we establish a…

Optimization and Control · Mathematics 2023-11-21 Yifan Ran

(Rephrased) Non-conformance decision-making processes in high-precision manufacturing of engineering structures are often delayed due to numerical simulations that are needed for analyzing the defective parts and assemblies. Interfaces…

Numerical Analysis · Mathematics 2024-05-31 Kiran Sagar Kollepara

This work aims at making a comprehensive contribution in the general area of parametric inference for discretely observed diffusion processes. Established approaches for likelihood-based estimation invoke a time-discretisation scheme for…

Methodology · Statistics 2024-01-30 Yuga Iguchi , Alexandros Beskos , Matthew M. Graham

We propose a novel approximation hierarchy for cardinality-constrained, convex quadratic programs that exploits the rank-dominating eigenvectors of the quadratic matrix. Each level of approximation admits a min-max characterization whose…

Optimization and Control · Mathematics 2021-05-26 Robbie Vreugdenhil , Viet Anh Nguyen , Armin Eftekhari , Peyman Mohajerin Esfahani

Parameter estimation in logistic regression is a well-studied problem with the Newton-Raphson method being one of the most prominent optimization techniques used in practice. A number of monotone optimization methods including…

Computation · Statistics 2023-04-11 Nicholas C. Henderson , Zhongzhe Ouyang

This paper proposes a novel low-rank approximation to the multivariate State-Space Model. The Stochastic Partial Differential Equation (SPDE) approach is applied component-wise to the independent-in-time Mat\'ern Gaussian innovation term in…

Matrices are typically considered over fields or rings. Motivated by applications in parametric differential equations and data-driven modeling, we suggest to study matrices with entries from a Hilbert space and present an elementary theory…

Numerical Analysis · Mathematics 2025-05-09 Stanislav Budzinskiy

Augmenting a smooth cost function with an $\ell_1$ penalty allows analysts to efficiently conduct estimation and variable selection simultaneously in sophisticated models and can be efficiently implemented using proximal gradient methods.…

Machine Learning · Statistics 2024-12-10 Nathan Wycoff , Lisa O. Singh , Ali Arab , Katharine M. Donato

We consider the Low Rank Approximation problem, where the input consists of a matrix $A \in \mathbb{R}^{n_R \times n_C}$ and an integer $k$, and the goal is to find a matrix $B$ of rank at most $k$ that minimizes $\| A - B \|_0$, which is…

Data Structures and Algorithms · Computer Science 2023-11-03 Vincent Cohen-Addad , Chenglin Fan , Suprovat Ghoshal , Euiwoong Lee , Arnaud de Mesmay , Alantha Newman , Tony Chang Wang

Parameterized max-affine (PMA) and parameterized log-sum-exp (PLSE) networks are proposed for general decision-making problems. The proposed approximators generalize existing convex approximators, namely, max-affine (MA) and log-sum-exp…

Machine Learning · Computer Science 2022-07-14 Jinrae Kim , Youdan Kim

In this chapter, we discuss recent work on learning sparse approximations to high-dimensional functions on data, where the target functions may be scalar-, vector- or even Hilbert space-valued. Our main objective is to study how the…

Numerical Analysis · Mathematics 2022-02-08 Ben Adcock , Juan M. Cardenas , Nick Dexter , Sebastian Moraga

Given a matrix $A$, the goal of the entrywise low-rank approximation problem is to find $\operatorname{argmin} \|A-B\|_p$ over all rank-$k$ matrices $B$, where $\| \cdot \|_p$ is the entrywise $\ell_p$ norm. When $p = 2$ this well-studied…

Data Structures and Algorithms · Computer Science 2026-04-28 Prashanti Anderson , Ainesh Bakshi , Samuel B. Hopkins

We introduce a simple, rigorous, and unified framework for solving nonlinear partial differential equations (PDEs), and for solving inverse problems (IPs) involving the identification of parameters in PDEs, using the framework of Gaussian…

Numerical Analysis · Mathematics 2021-08-12 Yifan Chen , Bamdad Hosseini , Houman Owhadi , Andrew M Stuart

Estimating linear, mean-square continuous functionals is a pivotal challenge in statistics. In high-dimensional contexts, this estimation is often performed under the assumption of exact model sparsity, meaning that only a small number of…

Statistics Theory · Mathematics 2025-08-04 Jelena Bradic , Victor Chernozhukov , Whitney K. Newey , Yinchu Zhu

Precision matrix is of significant importance in a wide range of applications in multivariate analysis. This paper considers adaptive minimax estimation of sparse precision matrices in the high dimensional setting. Optimal rates of…

Statistics Theory · Mathematics 2012-12-13 T. Tony Cai , Weidong Liu , Harrison H. Zhou

Real-time path tracing increasingly operates under extremely low sampling budgets, often below one sample per pixel, as rendering complexity, resolution, and frame-rate requirements continue to rise. While super-resolution is widely used in…

Graphics · Computer Science 2026-02-10 Martin Bálint , Corentin Salaün , Hans-Peter Seidel , Karol Myszkowski

We develop a general framework for data-driven approximation of input-output maps between infinite-dimensional spaces. The proposed approach is motivated by the recent successes of neural networks and deep learning, in combination with…

Numerical Analysis · Mathematics 2021-06-21 Kaushik Bhattacharya , Bamdad Hosseini , Nikola B. Kovachki , Andrew M. Stuart

We introduce Neural Parameter Regression (NPR), a novel framework specifically developed for learning solution operators in Partial Differential Equations (PDEs). Tailored for operator learning, this approach surpasses traditional DeepONets…

Machine Learning · Computer Science 2024-03-20 Konrad Mundinger , Max Zimmer , Sebastian Pokutta

Recovering nonlinearly degraded signal in the presence of noise is a challenging problem. In this work, this problem is tackled by minimizing the sum of a non convex least-squares fit criterion and a penalty term. We assume that the…

Signal Processing · Electrical Eng. & Systems 2019-02-27 Marc Castella , Jean-Christophe Pesquet , Arthur Marmin

Numerical solutions to high-dimensional partial differential equations (PDEs) based on neural networks have seen exciting developments. This paper derives complexity estimates of the solutions of $d$-dimensional second-order elliptic PDEs…

Numerical Analysis · Mathematics 2021-11-09 Ziang Chen , Jianfeng Lu , Yulong Lu