English
Related papers

Related papers: A Nonnested Augmented Subspace Method for Eigenval…

200 papers

We consider an incremental approximation method for solving variational problems in infinite-dimensional Hilbert spaces, where in each step a randomly and independently selected subproblem from an infinite collection of subproblems is…

Numerical Analysis · Mathematics 2018-03-06 Michael Griebel , Peter Oswald

Multilevel optimization has gained renewed interest in machine learning due to its promise in applications such as hyperparameter tuning and continual learning. However, existing methods struggle with the inherent difficulty of efficiently…

Machine Learning · Computer Science 2024-10-16 Yuntian Gu , Xuzheng Chen

Bilevel optimization is a central tool in machine learning for high-dimensional hyperparameter tuning. Its applications are vast; for instance, in imaging it can be used for learning data-adaptive regularizers and optimizing forward…

Optimization and Control · Mathematics 2025-11-11 Mohammad Sadegh Salehi , Subhadip Mukherjee , Lindon Roberts , Matthias J. Ehrhardt

We introduce a nonconforming virtual element method for the Poisson equation on domains with curved boundary and internal interfaces. We prove arbitrary order optimal convergence in the energy and $L^2$ norms, and validate the theoretical…

Numerical Analysis · Mathematics 2023-03-28 Lourenco Beirão Da Veiga , Yi Liu , Lorenzo Mascotto , Alessandro Russo

Quantum algorithms for estimating the eigenvalues of matrices, including the phase estimation algorithm, serve as core subroutines in a wide range of quantum algorithms, including those in quantum chemistry and quantum machine learning. The…

Quantum Physics · Physics 2025-09-03 Abhijeet Alase , Salini Karuvade

In this paper, we develop an efficient preconditioned unfitted finite element method for the elliptic interface problem, based on the reconstructed discontinuous approximation. The approximation method for interface problems is originally…

Numerical Analysis · Mathematics 2026-05-28 Ruo Li , Qicheng Liu , Fanyi Yang , Shuhai Zhao

This paper investigates a class of stochastic bilevel optimization problems where the upper-level function is nonconvex with potentially unbounded smoothness and the lower-level problem is strongly convex. These problems have significant…

Machine Learning · Computer Science 2025-01-16 Xiaochuan Gong , Jie Hao , Mingrui Liu

Recent observations have advanced our understanding of the neural network optimization landscape, revealing the existence of (1) paths of high accuracy containing diverse solutions and (2) wider minima offering improved performance.…

Machine Learning · Computer Science 2021-09-14 Mitchell Wortsman , Maxwell Horton , Carlos Guestrin , Ali Farhadi , Mohammad Rastegari

It is well-known that accelerated gradient first order methods possess optimal complexity estimates for the class of convex smooth minimization problems. In many practical situations, it makes sense to work with inexact gradients. However,…

Optimization and Control · Mathematics 2024-07-02 Ilya Kuruzov , Fedor Stonyakin

With the growing interest and applications in machine learning and data science, finding an efficient method to sparse analysis the high-dimensional data and optimizing a dimension reduction model to extract lower dimensional features has…

Optimization and Control · Mathematics 2024-06-05 Jiawei Wang , Rencang Li , Richard Yi Da Xu

A multilevel adaptive refinement strategy for solving linear elliptic partial differential equations with random data is recalled in this work. The strategy extends the a posteriori error estimation framework introduced by Guignard and…

Numerical Analysis · Mathematics 2022-02-21 Alex Bespalov , David J. Silvester

This paper proposes a novel deep subspace clustering approach which uses convolutional autoencoders to transform input images into new representations lying on a union of linear subspaces. The first contribution of our work is to insert…

Computer Vision and Pattern Recognition · Computer Science 2020-01-24 Mohsen Kheirandishfard , Fariba Zohrizadeh , Farhad Kamangar

Finite element methods typically require a high resolution to satisfactorily approximate micro and even macro patterns of an underlying physical model. This issue can be circumvented by appropriate multiscale strategies that are able to…

Numerical Analysis · Mathematics 2025-12-24 Zhi-Song Liu , Roland Maier , Andreas Rupp

The invariant subspace method is refined to present more unity and more diversity of exact solutions to evolution equations. The key idea is to take subspaces of solutions to linear ordinary differential equations as invariant subspaces…

Exactly Solvable and Integrable Systems · Physics 2015-06-04 Wen-Xiu Ma

A neural network architecture is presented that exploits the multilevel properties of high-dimensional parameter-dependent partial differential equations, enabling an efficient approximation of parameter-to-solution maps, rivaling…

Machine Learning · Computer Science 2024-08-21 Janina Enrica Schütte , Martin Eigel

In this paper, we propose a novel mesh-free numerical method for solving the elliptic interface problems based on deep learning. We approximate the solution by the neural networks and, since the solution may change dramatically across the…

Numerical Analysis · Mathematics 2020-05-12 Cuiyu He , Xiaozhe Hu , Lin Mu

In this paper, we consider the nonsmooth convex optimization problems over the fixed point constraint sets of firmly nonexpansive operators. To find an optimal solution of the problem, we present an iterative method based on the hybrid…

Optimization and Control · Mathematics 2026-03-23 Ontima Pankoon , Nimit Nimana , Yeol Je Cho

We describe a strategy for solving nonlinear eigenproblems numerically. Our approach is based on the approximation of a vector-valued function, defined as solution of a non-homogeneous version of the eigenproblem. This approximation step is…

Numerical Analysis · Mathematics 2023-12-06 Davide Pradovera

We propose a new, harmonically enriched multiscale coarse space (HEM) for domain decomposition methods. For a coercive high contrast model problem, we show how to enrich the coarse space so that the method is robust against any variations…

Numerical Analysis · Mathematics 2015-12-17 Martin J. Gander , Atle Loneland , Talal Rahman

An inexact accelerated stochastic Alternating Direction Method of Multipliers (AS-ADMM) scheme is developed for solving structured separable convex optimization problems with linear constraints. The objective function is the sum of a…

Optimization and Control · Mathematics 2020-10-27 Jianchao Bai , William W. Hager , Hongchao Zhang