中文
相关论文

相关论文: Convergence analysis of adaptive DIIS algorithms w…

200 篇论文

Parallel training methods are increasingly relevant in machine learning (ML) due to the continuing growth in model and dataset sizes. We propose a variant of the Additively Preconditioned Trust-Region Strategy (APTS) for training deep…

机器学习 · 计算机科学 2025-02-10 Samuel A. Cruz Alegría , Ken Trotti , Alena Kopaničáková , Rolf Krause

We propose a spectral method for the 1D-1V Vlasov-Poisson system where the discretization in velocity space is based on asymmetrically-weighted Hermite functions, dynamically adapted via a scaling $\alpha$ and shifting $u$ of the velocity…

数值分析 · 数学 2023-06-02 Cecilia Pagliantini , Gian Luca Delzanno , Stefano Markidis

Primal-dual hybrid gradient method (PDHG, a.k.a. Chambolle and Pock method) is a well-studied algorithm for minimax optimization problems with a bilinear interaction term. Recently, PDHG is used as the base algorithm for a new LP solver…

最优化与控制 · 数学 2023-03-14 Haihao Lu , Jinwen Yang

In this paper, we study the local linear convergence properties of a versatile class of Primal-Dual splitting methods for minimizing composite non-smooth convex optimization problems. Under the assumption that the non-smooth components of…

最优化与控制 · 数学 2018-01-10 Jingwei Liang , Jalal Fadili , Gabriel Peyré

Hardware trends have motivated the development of mixed precision algo-rithms in numerical linear algebra, which aim to decrease runtime while maintaining acceptable accuracy. One recent development is the development of an adaptive…

数值分析 · 数学 2023-07-11 Noaman Khan , Erin Carson

The unfolding of molecular complexes or biomolecules under the influence of external mechanical forces can routinely be simulated with atomistic resolution. To obtain a match of the characteristic time scales with those of experimental…

软凝聚态物质 · 物理学 2024-07-17 Marco Oestereich , Jürgen Gauss , Gregor Diezemann

The rigorous convergence analysis of adaptive finite element methods for regularized variational models of quasi-static brittle fracture in strain-limiting elastic solids is presented. This work introduces two novel adaptive mesh refinement…

数值分析 · 数学 2025-11-19 Ram Manohar , S. M. Mallikarjunaiah

In this work, we introduce a novel class of adaptive Monte Carlo methods, called adaptive independent sticky MCMC algorithms, for efficient sampling from a generic target probability density function (pdf). The new class of algorithms…

统计计算 · 统计学 2025-04-09 L. Martino , R. Casarin , F. Leisen , D. Luengo

The recently developed Particle-based Variational Inference (ParVI) methods drive the empirical distribution of a set of \emph{fixed-weight} particles towards a given target distribution $\pi$ by iteratively updating particles' positions.…

机器学习 · 计算机科学 2021-12-03 Chao Zhang , Zhijian Li , Hui Qian , Xin Du

Feasibility problem aims to find a common point of two or more closed (convex) sets whose intersection is nonempty. In the literature, projection based algorithms are widely adopted to solve the problem, such as the method of alternating…

最优化与控制 · 数学 2025-04-16 Yuting Shen , Jingwei Liang

By extending the classical analysis techniques due to Samokish, Faddeev and Faddeeva, and Longsine and McCormick among others, we prove the convergence of preconditioned steepest descent with implicit deflation (PSD-id) method for solving…

数值分析 · 数学 2016-05-31 Yunfeng Cai , Zhaojun Bai , John E. Pask , N. Sukumar

Reliability updating refers to a problem that integrates Bayesian updating technique with structural reliability analysis and cannot be directly solved by structural reliability methods (SRMs) when it involves equality information. The…

机器学习 · 计算机科学 2023-04-19 Xiong Xiao , Zeyu Wang , Quanwang Li

Approximate computing is known for enhancing deep neural network accelerators' energy efficiency by introducing inexactness with a tolerable accuracy loss. However, small accuracy variations may increase the sensitivity of these…

硬件体系结构 · 计算机科学 2023-02-23 Ayesha Siddique , Khaza Anuarul Hoque

We present a novel two-level sketching extension of the Alternating Anderson-Picard (AAP) method for accelerating fixed-point iterations in challenging single- and multi-physics simulations governed by discretized partial differential…

数值分析 · 数学 2026-05-20 Nicolás A. Barnafi , Massimiliano Lupo Pasini

Algebraically stabilized finite element discretizations of scalar steady-state convection-diffusion-reaction equations often provide accurate approximate solutions satisfying the discrete maximum principle (DMP). However, it was observed…

数值分析 · 数学 2022-08-17 Petr Knobloch

In this paper we introduce a novel abstract descent scheme suited for the minimization of proper and lower semicontinuous functions. The proposed abstract scheme generalizes a set of properties that are crucial for the convergence of…

数值分析 · 数学 2023-02-16 Silvia Bonettini , Peter Ochs , Marco Prato , Simone Rebegoldi

This paper deals with speeding up the convergence of a class of two-step iterative methods for solving linear systems of equations. To implement the acceleration technique, the residual norm associated with computed approximations for each…

数值分析 · 数学 2024-04-24 Fatemeh P. A. Beik , Michele Benzi , Mehdi Najafi-Kalyani

We introduce the Energy Dissipation Rate guided Adaptive Sampling (EDRAS) strategy, a novel method that substantially enhances the performance of Physics-Informed Neural Networks (PINNs) in solving thermodynamically consistent partial…

数值分析 · 数学 2025-07-15 Chunyan Li , Wenkai Yu , Qi Wang

First-order operator splitting methods are ubiquitous among many fields through science and engineering, such as inverse problems, signal/image processing, statistics, data science and machine learning, to name a few. In this paper, we…

最优化与控制 · 数学 2020-09-10 Clarice Poon , Jingwei Liang

In this paper the $h$-adaptive partition-of-unity method and the $h$- and $hp$-adaptive finite element method are applied to partial differential equations arising in quantum mechanics, namely, the Schr\"odinger equation with Coulomb and…

计算物理 · 物理学 2016-12-08 Denis Davydov , Tymofiy Gerasimov , Jean-Paul Pelteret , Paul Steinmann