中文
相关论文

相关论文: Approximate Linearization of Fixed Point Iteration…

200 篇论文

Singular perturbation theory plays a central role in the approximate solution of nonlinear differential equations. However, applying these methods is a subtle art owing to the lack of globally applicable algorithms. Inspired by the fact…

数学物理 · 物理学 2025-09-16 Alexander J. Dear , L. Mahadevan

We introduce a weighted particle representation for the solution of the filtering problem based on a suitably chosen variation of the classical de Finetti theorem. This representation has important theoretical and numerical applications. In…

概率论 · 数学 2021-04-13 Dan Crisan , Thomas G. Kurtz , Salvador Ortiz-Latorre

This paper investigates the iterates $\hbb^1,\dots,\hbb^T$ obtained from iterative algorithms in high-dimensional linear regression problems, in the regime where the feature dimension $p$ is comparable with the sample size $n$, i.e., $p…

机器学习 · 统计学 2024-04-30 Pierre C. Bellec , Kai Tan

Partial differential equations (PDEs) are widely used across the physical and computational sciences. Decades of research and engineering went into designing fast iterative solution methods. Existing solvers are general purpose, but may be…

数值分析 · 数学 2024-09-23 Jun-Ting Hsieh , Shengjia Zhao , Stephan Eismann , Lucia Mirabella , Stefano Ermon

We consider a general linear parabolic problem with extended time boundary conditions (including initial value problems and periodic ones), and approximate it by the implicit Euler scheme in time and the Gradient Discretisation method in…

数值分析 · 数学 2023-08-22 J Droniou , R Eymard , T Gallouët , C Guichard , R Herbin

This paper provides the first proof that Anderson acceleration (AA) improves the convergence rate of general fixed point iterations. AA has been used for decades to speed up nonlinear solvers in many applications, however a rigorous…

数值分析 · 数学 2019-02-22 Claire Evans , Sara Pollock , Leo G. Rebholz , Mengying Xiao

We present a trust-region-based adaptive finite-element algorithm for numerically solving a class of nonsmooth PDE-constrained optimization problems that includes problems with sparsifying regularizers and convex constraints. In particular,…

最优化与控制 · 数学 2026-04-28 Harbir Antil , Robert J. Baraldi , Rohit Khandelwal , Drew P. Kouri

The proximal gradient algorithm for minimizing the sum of a smooth and a nonsmooth convex function often converges linearly even without strong convexity. One common reason is that a multiple of the step length at each iteration may…

最优化与控制 · 数学 2016-06-29 Dmitriy Drusvyatskiy , Adrian S. Lewis

PDE-constrained optimal control problems require regularisation to ensure well-posedness, introducing small perturbations that make the solutions challenging to approximate accurately. We propose a finite element approach that couples both…

数值分析 · 数学 2025-03-17 Jenny Power , Tristan Pryer

In this paper, we analyze the convergence and optimality of a standard adaptive nonconforming linear element method for the Stokes problem. After establishing a special quasi--orthogonality property for both the velocity and the pressure in…

数值分析 · 数学 2013-09-17 Jun Hu , Jinchao Xu

Adaptive Precision Training: Quantify Back Propagation in Neural Networks with Fixed-point Numbers. Recent emerged quantization technique has been applied to inference of deep neural networks for fast and efficient execution. However,…

机器学习 · 计算机科学 2020-03-06 Xishan Zhang , Shaoli Liu , Rui Zhang , Chang Liu , Di Huang , Shiyi Zhou , Jiaming Guo , Yu Kang , Qi Guo , Zidong Du , Yunji Chen

In this paper we consider interpolation problem connected with series by integer shifts of Gaussians. Known approaches for these problems met numerical difficulties. Due to it another method is considered based on finite-rank approximations…

经典分析与常微分方程 · 数学 2020-07-07 S. M. Sitnik , A. S. Timashov , S. N. Ushakov

In backward error analysis, an approximate solution to an equation is compared to the exact solution to a nearby modified equation. In numerical ordinary differential equations, the two agree up to any power of the step size. If the…

数值分析 · 数学 2022-07-21 Robert I McLachlan , Christian Offen

Recent machine learning algorithms dedicated to solving semi-linear PDEs are improved by using different neural network architectures and different parameterizations. These algorithms are compared to a new one that solves a fixed point…

机器学习 · 计算机科学 2018-12-11 Quentin Chan-Wai-Nam , Joseph Mikael , Xavier Warin

Estimation of the degree of stability and the bounds of solutions to non-autonomous nonlinear systems present major concerns in numerous applied problems. Yet, current techniques are frequently yield overconservative conditions which are…

动力系统 · 数学 2020-12-29 Mark A. Pinsky

We consider the problem of optimizing the sum of a smooth convex function and a non-smooth convex function using proximal-gradient methods, where an error is present in the calculation of the gradient of the smooth term or in the proximity…

机器学习 · 计算机科学 2011-12-02 Mark Schmidt , Nicolas Le Roux , Francis Bach

Reduced numerical precision is a common technique to reduce computational cost in many Deep Neural Networks (DNNs). While it has been observed that DNNs are resilient to small errors and noise, no general result exists that is capable of…

机器学习 · 统计学 2018-05-04 Zhaoqi Li , Yu Ma , Catalina Vajiac , Yunkai Zhang

This paper investigates the optimal ergodic sublinear convergence rate of the relaxed proximal point algorithm for solving monotone variational inequality problems. The exact worst case convergence rate is computed using the performance…

最优化与控制 · 数学 2019-07-15 Guoyong Gu , Junfeng Yang

We present recent finite element numerical results on a model convection-diffusion problem in the singular perturbed case when the convection term dominates the problem. We compare the standard Galerkin discretization using the linear…

数值分析 · 数学 2023-02-16 Constantin Bacuta , Daniel Hayes , Tyler O'Grady

This paper is concerned with the problem of representing and learning a linear transformation using a linear neural network. In recent years, there has been a growing interest in the study of such networks in part due to the successes of…

最优化与控制 · 数学 2017-09-28 Amirhossein Taghvaei , Jin W. Kim , Prashant G. Mehta