English
Related papers

Related papers: Parametric Analytical Preconditioning and its Appl…

200 papers

We propose the nonlinear restricted additive Schwarz (RAS) preconditioning strategy to improve the convergence speed of limited memory quasi-Newton (QN) methods. We consider both "left-preconditioning" and "right-preconditioning"…

Numerical Analysis · Mathematics 2024-02-07 Hardik Kothari

In this work, we unify several existing decoding strategies for punctuation prediction in one framework and introduce a novel strategy which utilises multiple predictions at each word across different windows. We show that significant…

Computation and Language · Computer Science 2021-12-20 Christoph Minixhofer , Ondřej Klejch , Peter Bell

Standard meta-learning for representation learning aims to find a common representation to be shared across multiple tasks. The effectiveness of these methods is often limited when the nuances of the tasks' distribution cannot be captured…

Machine Learning · Computer Science 2021-03-31 Giulia Denevi , Massimiliano Pontil , Carlo Ciliberto

We consider an adversarially-trained version of the nonnegative matrix factorization, a popular latent dimensionality reduction technique. In our formulation, an attacker adds an arbitrary matrix of bounded norm to the given data matrix. We…

Machine Learning · Computer Science 2021-08-11 Ting Cai , Vincent Y. F. Tan , Cédric Févotte

This work aims to accelerate the convergence of proximal gradient methods used to solve regularized linear inverse problems. This is achieved by designing a polynomial-based preconditioner that targets the eigenvalue spectrum of the normal…

Exponential growth in the scale of modern foundation models has led to the widespread adoption of Low-Rank Adaptation (LoRA) as a parameter-efficient fine-tuning technique. However, standard LoRA implementations disregard the varying…

Artificial Intelligence · Computer Science 2026-05-01 Vishnuprasadh Kumaravelu , Sunil Gupta , P. K. Srijith

In this paper we propose to use model reduction techniques for speeding up the diagonalization-based parallel-in-time (ParaDIAG) preconditioner, for iteratively solving all-at-once systems from evolutionary PDEs. In particular, we use the…

Numerical Analysis · Mathematics 2020-12-17 Jun Liu , Zhu Wang

A new domain decomposition preconditioner is introduced for efficiently solving linear systems Ax = b with a symmetric positive definite matrix A. The particularity of the new preconditioner is that it is not necessary to have access to the…

Numerical Analysis · Mathematics 2021-06-23 Nicole Spillane

We consider generalized linear regression analysis with left-censored covariate due to the lower limit of detection. Complete case analysis by eliminating observations with values below limit of detection yields valid estimates for…

Methodology · Statistics 2014-12-09 Shengchun Kong , Bin Nan

Static analyses overwhelmingly trade precision for soundness and automation. For this reason, their use-cases are restricted to situations where imprecision isn't prohibitive. In this paper, we propose and specify a static analysis that…

Programming Languages · Computer Science 2026-02-10 Abdullah H. Rasheed

We show that a combination of two simple preprocessing steps would generally improve the conditioning of a homogeneous system of linear inequalities. Our approach is based on a comparison among three different but related notions of…

Optimization and Control · Mathematics 2013-06-25 Javier Pena , Vera Roshchina , Negar Soheili

In the context of training neural network-based approximations of solutions of parameter-dependent PDEs, we investigate the effect of preconditioning via well-conditioned frame representations of operators and demonstrate a significant…

Numerical Analysis · Mathematics 2026-02-02 Markus Bachmayr , Wolfgang Dahmen , Chenguang Duan , Mathias Oster

The novel contribution of this paper relies in the proposal of a fully implicit numerical method designed for nonlinear degenerate parabolic equations, in its convergence/stability analysis, and in the study of the related computational…

Numerical Analysis · Mathematics 2010-01-20 Matteo Semplice , Marco Donatelli , Stefano Serra-Capizzano

Based on the needs of convergence proofs of preconditioned proximal point methods, we introduce notions of partial strong submonotonicity and partial (metric) subregularity of set-valued maps. We study relationships between these two…

Optimization and Control · Mathematics 2020-03-02 Tuomo Valkonen

In this paper, we present a unified framework for reduced basis approximations of parametrized partial differential equations defined on parameter-dependent domains. Our approach combines unfitted finite element methods with both classical…

Numerical Analysis · Mathematics 2025-11-24 Nicholas Mueller , Santiago Badia , Yiran Zhao

Variational models for image deblurring problems typically consist of a smooth term and a potentially non-smooth convex term. A common approach to solving these problems is using proximal gradient methods. To accelerate the convergence of…

Numerical Analysis · Mathematics 2025-05-22 Stefano Aleotti , Marco Donatelli , Rolf Krause , Giuseppe Scarlato

Reduced order models, in particular the reduced basis method, rely on empirically built and problem dependent basis functions that are constructed during an off-line stage. In the on-line stage, the precomputed problem-dependent solution…

Numerical Analysis · Mathematics 2012-12-07 Yvon Maday , Benjamin Stamm

Dynamical systems are pervasive in almost all engineering and scientific applications. Simulating such systems is computationally very intensive. Hence, Model Order Reduction (MOR) is used to reduce them to a lower dimension. Most of the…

Numerical Analysis · Mathematics 2020-03-31 Navneet Pratap Singh , Kapil Ahuja

We propose nonparametric identification and semiparametric estimation of joint potential outcome distributions in the presence of confounding. First, in settings with observed confounding, we derive tighter, covariate-informed bounds on the…

Methodology · Statistics 2026-02-19 Jianle Sun , Kun Zhang

For parameterized mixed-binary optimization problems, we construct local decision rules that prescribe near-optimal courses of action across a set of parameter values. The decision rules stem from solving risk-adaptive training problems…

Optimization and Control · Mathematics 2024-04-24 Johannes O. Royset , Miguel A. Lejeune