English
Related papers

Related papers: Enhanced Error Estimates for Augmented Subspace Me…

200 papers

The goal of 2D human pose estimation (HPE) is to localize anatomical landmarks, given an image of a person in a pose. SOTA techniques make use of thousands of labeled figures (finetuning transformers or training deep CNNs), acquired using…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Nobline Yoo , Olga Russakovsky

In this paper, we focus on solving a sequence of linear systems with an identical (or similar) coefficient matrix. For this type of problems, we investigate the subspace correction and deflation methods, which use an auxiliary matrix…

Numerical Analysis · Mathematics 2022-03-17 Takeshi Iwashita , Kota Ikehara , Takeshi Fukaya , Takeshi Mifune

We propose randomized subspace gradient methods for high-dimensional constrained optimization. While there have been similarly purposed studies on unconstrained optimization problems, there have been few on constrained optimization problems…

Optimization and Control · Mathematics 2023-07-10 Ryota Nozawa , Pierre-Louis Poirion , Akiko Takeda

Large-scale optimization problems that seek sparse solutions have become ubiquitous. They are routinely solved with various specialized first-order methods. Although such methods are often fast, they usually struggle with not-so-well…

Optimization and Control · Mathematics 2021-11-29 Valentina De Simone , Daniela di Serafino , Jacek Gondzio , Spyridon Pougkakiotis , Marco Viola

Recent advances in the field of artificial intelligence have been made possible by deep neural networks. In applications where data are scarce, transfer learning and data augmentation techniques are commonly used to improve the…

Computer Vision and Pattern Recognition · Computer Science 2020-02-13 Mohammad Saeed Abrishami , Amir Erfan Eshratifar , David Eigen , Yanzhi Wang , Shahin Nazarian , Massoud Pedram

We present an acceleration method for sequences of large-scale linear systems, such as the ones arising from the numerical solution of time-dependent partial differential equations coupled with algebraic constraints. We discuss different…

Numerical Analysis · Mathematics 2024-03-29 Margherita Guido , Daniel Kressner , Paolo Ricci

Stochastic inverse problems are generally solved by some form of finite sampling of a space of uncertain parameters. For computationally expensive models, surrogate response surfaces are often employed to increase the number of samples used…

Numerical Analysis · Mathematics 2018-07-04 Steven Mattis , Barbara Wohlmuth

The a posteriori error analysis of the classical Argyris finite element methods dates back to 1996, while the optimal convergence rates of associated adaptive finite element schemes are established only very recently in 2021. It took a long…

Numerical Analysis · Mathematics 2024-03-20 Carsten Carstensen , Benedikt Gräßle

This paper addresses problems of second-order cone programming important in optimization theory and applications. The main attention is paid to the augmented Lagrangian method (ALM) for such problems considered in both exact and inexact…

Optimization and Control · Mathematics 2021-07-07 Nguyen T. V. Hang , Boris S. Mordukhovich , M. Ebrahim Sarabi

Subspace clustering methods have been widely studied recently. When the inputs are 2-dimensional (2D) data, existing subspace clustering methods usually convert them into vectors, which severely damages inherent structures and relationships…

Computer Vision and Pattern Recognition · Computer Science 2020-11-04 Chong Peng , Qian Zhang , Zhao Kang , Chenglizhao Chen , Qiang Cheng

In this paper, we investigate a new extragradient algorithm for solving pseudomonotone equilibrium problems on Hadamard manifolds. The algorithm uses a variable stepsize which is updated at each iteration and based on some previous…

Optimization and Control · Mathematics 2021-07-27 Jingjing Fan , Bing Tan , Songxiao Li

We present here an efficient method which systematically reduces the rank of the augmented space and thereby helps to implement augmented space recursion for any real calculation. Our method is based on the symmetry of the Hamiltonian in…

Materials Science · Physics 2009-11-10 Kamal Krishna Saha , Tanusri Saha-Dasgupta , Abhijit Mookerjee , Indra Dusgupta

We introduce a proximal version of the stochastic dual coordinate ascent method and show how to accelerate the method using an inner-outer iteration procedure. We analyze the runtime of the framework and obtain rates that improve…

Machine Learning · Statistics 2013-10-09 Shai Shalev-Shwartz , Tong Zhang

We present a new accelerated stochastic second-order method that is robust to both gradient and Hessian inexactness, which occurs typically in machine learning. We establish theoretical lower bounds and prove that our algorithm achieves…

Optimization and Control · Mathematics 2024-05-28 Artem Agafonov , Dmitry Kamzolov , Alexander Gasnikov , Ali Kavis , Kimon Antonakopoulos , Volkan Cevher , Martin Takáč

In this paper, we study a generalized finite element method for solving second-order elliptic partial differential equations with rough coefficients. The method uses local approximation spaces computed by solving eigenvalue problems on…

Numerical Analysis · Mathematics 2025-07-17 Christian Alber , Peter Bastian , Moritz Hauck , Robert Scheichl

Efforts to achieve better accuracy in numerical relativity have so far focused either on implementing second order accurate adaptive mesh refinement or on defining higher order accurate differences and update schemes. Here, we argue for the…

General Relativity and Quantum Cosmology · Physics 2009-11-11 Luis Lehner , Steven L. Liebling , Oscar Reula

Laplace approximations are commonly used to approximate high-dimensional integrals in statistical applications, but the quality of such approximations as the dimension of the integral grows is not well understood. In this paper, we prove a…

Statistics Theory · Mathematics 2018-08-21 Helen Ogden

We present an a posteriori error analysis for the mixed virtual element method (mixed VEM) applied to second order elliptic equations in divergence form with mixed boundary conditions. The resulting error estimator is of residual-type. It…

Numerical Analysis · Mathematics 2019-04-24 Andrea Cangiani , Mauricio Munar

We study a version of the randomized Kaczmarz algorithm for solving systems of linear equations where the iterates are confined to the solution space of a selected subsystem. We show that the subspace constraint leads to an accelerated…

Numerical Analysis · Mathematics 2024-06-11 Jackie Lok , Elizaveta Rebrova

Deep learning has shown successful application in visual recognition and certain artificial intelligence tasks. Deep learning is also considered as a powerful tool with high flexibility to approximate functions. In the present work,…

Machine Learning · Computer Science 2021-12-23 Ayan Chakraborty , Thomas Wick , Xiaoying Zhuang , Timon Rabczuk