English
Related papers

Related papers: An Adaptive Mixed Precision and Dynamically Scaled…

200 papers

Adaptive atomistic/continuum (a/c) coupling method is an important method for the simulation of material and atomistic systems with defects to achieve the balance of accuracy and efficiency. Residual based a posteriori error estimator is…

Numerical Analysis · Mathematics 2022-11-28 Yangshuai Wang , Hao Wang

Quantization is essential for Neural Network (NN) compression, reducing model size and computational demands by using lower bit-width data types, though aggressive reduction often hampers accuracy. Mixed Precision (MP) mitigates this…

Machine Learning · Computer Science 2025-05-20 Shmulik Markovich-Golan , Daniel Ohayon , Itay Niv , Yair Hanani

We study the Weighted Min Cut problem in the Adaptive Massively Parallel Computation (AMPC) model. In 2019, Behnezhad et al. [3] introduced the AMPC model as an extension of the Massively Parallel Computation (MPC) model. In the past…

Data Structures and Algorithms · Computer Science 2022-05-30 MohammadTaghi Hajiaghayi , Marina Knittel , Jan Olkowski , Hamed Saleh

We propose and analyze an approximate message passing (AMP) algorithm for the matrix tensor product model, which is a generalization of the standard spiked matrix models that allows for multiple types of pairwise observations over a…

Machine Learning · Statistics 2023-06-28 Riccardo Rossetti , Galen Reeves

Precision matrix is of significant importance in a wide range of applications in multivariate analysis. This paper considers adaptive minimax estimation of sparse precision matrices in the high dimensional setting. Optimal rates of…

Statistics Theory · Mathematics 2012-12-13 T. Tony Cai , Weidong Liu , Harrison H. Zhou

In this paper, we focus on solving a sequence of linear systems with an identical (or similar) coefficient matrix. For this type of problems, we investigate the subspace correction and deflation methods, which use an auxiliary matrix…

Numerical Analysis · Mathematics 2022-03-17 Takeshi Iwashita , Kota Ikehara , Takeshi Fukaya , Takeshi Mifune

This paper presents an accelerated composite gradient (ACG) variant, referred to as the AC-ACG method, for solving nonconvex smooth composite minimization problems. As opposed to well-known ACG variants that are either based on a known…

Optimization and Control · Mathematics 2020-10-30 Jiaming Liang , Renato D. C. Monteiro

Estimation and counterfactual experiments in dynamic discrete choice models with large state spaces pose computational difficulties. This paper proposes a model-adaptive approach, based on the conjugate gradient (CG) method, to solve the…

Econometrics · Economics 2026-03-18 Ertian Chen

We develop an Accelerated Back Pressure (ABP) algorithm using Accelerated Dual Descent (ADD), a distributed approximate Newton-like algorithm that only uses local information. Our construction is based on writing the backpressure algorithm…

Optimization and Control · Mathematics 2013-02-07 Michael Zargham , Alejandro Ribeiro , Ali Jadbabaie

A stable added-mass partitioned (AMP) algorithm is developed for fluid-structure interaction (FSI) problems involving viscous incompressible flow and compressible elastic-solids. The AMP scheme remains stable and second-order accurate even…

Numerical Analysis · Mathematics 2018-12-11 Daniel A. Serino , Jeffrey W. Banks , William D. Henshaw , Donald W. Schwendeman

We describe main issues and design principles of an efficient implementation, tailored to recent generations of Nvidia Graphics Processing Units (GPUs), of an Algebraic Multigrid (AMG) preconditioner previously proposed by one of the…

Numerical Analysis · Mathematics 2018-10-11 Massimo Bernaschi , Pasqua D'Ambra , Dario Pasquini

Recovery type a posteriori error estimators are popular, particularly in the engineering community, for their computationally inexpensive, easy to implement, and generally asymptotically exactness. Unlike the residual type error estimators,…

Numerical Analysis · Mathematics 2025-03-26 Ying Liu , Jingjing Xiao , Nianyu Yi , Huihui Cao

Model Predictive Control (MPC) is a versatile approach capable of accommodating diverse control requirements that holds significant promise for a broad spectrum of industrial applications. Noteworthy challenges associated with MPC include…

Systems and Control · Electrical Eng. & Systems 2025-04-28 Ryuta Moriyasu , Sho Kawaguchi , Kenji Kashima

Many problems encountered in science and engineering can be formulated as estimating a low-rank object (e.g., matrices and tensors) from incomplete, and possibly corrupted, linear measurements. Through the lens of matrix and tensor…

Machine Learning · Computer Science 2023-10-11 Cong Ma , Xingyu Xu , Tian Tong , Yuejie Chi

Properties of Superiorized Preconditioned Conjugate Gradient (SupPCG) algorithms in image reconstruction from projections are examined. Least squares (LS) is usually chosen for measuring data-inconsistency in these inverse problems.…

Numerical Analysis · Mathematics 2018-07-27 Elias S. Helou , Gabor T. Herman , Chuan Lin , Marcelo V. W. Zibetti

We introduce a novel algorithm that leverages stochastic sampling techniques to compute the perturbative triples correction in the coupled-cluster (CC) framework. By combining elements of randomness and determinism, our algorithm achieves a…

Chemical Physics · Physics 2024-05-29 Yann Damour , Alejandro Gallo , Anthony Scemama

We study algorithmic approaches for recovering from the failure of several compute nodes in the parallel preconditioned conjugate gradient (PCG) solver on large-scale parallel computers. In particular, we analyze and extend an exact state…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-08-21 Carlos Pachajoa , Markus Levonyak , Wilfried N. Gansterer , Jesper Larsson Träff

We consider adaptive finite element methods (AFEMs) with inexact algebraic solvers for second-order symmetric linear elliptic diffusion problems. Optimal complexity of AFEM, i.e., optimal convergence rates with respect to the overall…

Numerical Analysis · Mathematics 2026-04-10 Paula Hilbert , Ani Miraçi , Dirk Praetorius

The Pairwise Conditional Gradients (PCG) algorithm is a powerful extension of the Frank-Wolfe algorithm leading to particularly sparse solutions, which makes PCG very appealing for problems such as sparse signal recovery, sparse regression,…

Optimization and Control · Mathematics 2022-02-09 Kazuma Tsuji , Ken'ichiro Tanaka , Sebastian Pokutta

We introduce a novel algorithm for gradient-based optimization of stochastic objective functions. The method may be seen as a variant of SGD with momentum equipped with an adaptive learning rate automatically adjusted by an 'energy'…

Optimization and Control · Mathematics 2022-03-24 Hailiang Liu , Xuping Tian