English
Related papers

Related papers: Active Subspaces in Infinite Dimension

200 papers

Researchers commonly believe that neural networks model a high-dimensional space but cannot give a clear definition of this space. What is this space? What is its dimension? And does it has finite dimensions? In this paper, we develop a…

Machine Learning · Computer Science 2023-05-10 John Chiang

We investigate the techniques and ideas used in the convergence analysis of two proximal ADMM algorithms for solving convex optimization problems involving compositions with linear operators. Besides this, we formulate a variant of the ADMM…

Optimization and Control · Mathematics 2019-12-20 Sebastian Banert , Radu Ioan Bot , Ernö Robert Csetnek

In this article a unified approach to iterative soft-thresholding algorithms for the solution of linear operator equations in infinite dimensional Hilbert spaces is presented. We formulate the algorithm in the framework of generalized…

Functional Analysis · Mathematics 2010-10-26 Kristian Bredies , Dirk A. Lorenz

This work is concerned with the convex analysis of functions defined on (not necessarily finite-dimensional) Hilbert spaces whose values depend solely on a certain ``spectrum'' of the arguments, a class we term ``spectral functions.'' We…

Optimization and Control · Mathematics 2026-03-11 Hòa T. Bùi , Minh N. Bùi , Christian Clason

Monte Carlo methods, such as Markov chain Monte Carlo (MCMC), remain the most regularly-used approach for implementing Bayesian inference. However, the computational cost of these approaches usually scales worse than linearly with the…

Computation · Statistics 2024-11-12 Leonardo Ripoli , Richard G. Everitt

Some concepts, such as non-compactness measure and condensing operators, defined on metric spaces are extended to uniform spaces. Such extensions allow us to locate, in the context of uniform spaces, some classical results existing in…

General Topology · Mathematics 2015-11-25 Raúl Fierro

The type IIB matrix model is conjectured to be a nonperturbative definition of type IIB superstring theory. In this model, spacetime is a dynamical quantity and compactification of extra dimensions can be realized via spontaneous symmetry…

High Energy Physics - Theory · Physics 2019-06-06 Konstantinos N. Anagnostopoulos , Takehiro Azuma , Yuta Ito , Jun Nishimura , Stratos Kovalkov Papadoudis

This paper develops expansive gradient dynamics in deep neural network-induced mapping spaces. Specifically, we generate tools and concepts for minimizing a class of energy functionals in an abstract Hilbert space setting covering a wide…

Optimization and Control · Mathematics 2025-07-21 Wolfgang Dahmen , Wuchen Li , Yuankai Teng , Zhu Wang

Bayesian inverse problems highly rely on efficient and effective inference methods for uncertainty quantification (UQ). Infinite-dimensional MCMC algorithms, directly defined on function spaces, are robust under refinement of physical…

Computation · Statistics 2019-05-22 Shiwei Lan

We introduce the notion of a pseudomultiplier of a Hilbert space $\mathcal H$ of functions on a set $\Omega$. Roughly, a pseudomultiplier of $\mathcal H$ is a function which multiplies a finite-codimensional subspace of $\mathcal H$ into…

Functional Analysis · Mathematics 2022-12-21 Jim Agler , Zinaida Lykova , N. J. Young

By employing Husimi quasiprobability distributions, we show that a bounded portion of an unbounded phase space induces a finite effective dimension in an infinite dimensional Hilbert space. We compare our general expressions with numerical…

We consider a class of operator-induced norms, acting as finite-dimensional surrogates to the L2 norm, and study their approximation properties over Hilbert subspaces of L2 . The class includes, as a special case, the usual empirical norm…

Statistics Theory · Mathematics 2011-06-01 Arash A. Amini , Martin J. Wainwright

In this article, we present a cost-benefit analysis of the approximation in tensor products of Hilbert spaces of Sobolev-analytic type. The Sobolev part is defined on a finite dimensional domain, whereas the analytical space is defined on…

Numerical Analysis · Mathematics 2017-03-02 Dinh Dũng , Michael Griebel , Vu Nhat Huy , Christian Rieger

We consider filtered subspace iteration for approximating a cluster of eigenvalues (and its associated eigenspace) of a (possibly unbounded) selfadjoint operator in a Hilbert space. The algorithm is motivated by a quadrature approximation…

Numerical Analysis · Mathematics 2019-02-05 Jay Gopalakrishnan , Luka Grubišić , Jeffrey Ovall

In 1953, Blumenthal showed that every semi-metric space that is isometrically embeddable in a Hilbert space has the n-point property; we have previously called such spaces supermetric spaces. Although this is a strictly stronger property…

Information Retrieval · Computer Science 2017-07-27 Richard Connor , Lucia Vadicamo , Fausto Rabitti

In this paper, we propose a random gradient-free method for optimization in infinite dimensional Hilbert spaces, applicable to functional optimization in diverse settings. Though such problems are often solved through finite-dimensional…

Optimization and Control · Mathematics 2025-12-25 Caio Lins Peixoto , Daniel Csillag , Bernardo F. P. da Costa , Yuri F. Saporito

Multivariate functions encountered in high-dimensional uncertainty quantification problems often vary most strongly along a few dominant directions in the input parameter space. We propose a gradient-based method for detecting these…

Analysis of PDEs · Mathematics 2019-11-11 Olivier Zahm , Paul Constantine , Clémentine Prieur , Youssef Marzouk

This paper is concerned with the numerical minimization of energy functionals in Hilbert spaces involving convex constraints coinciding with a semi-norm for a subspace. The optimization is realized by alternating minimizations of the…

Numerical Analysis · Mathematics 2007-12-17 Massimo Fornasier , Carola-Bibiane Schönlieb

While monotone operator theory is often studied on Hilbert spaces, many interesting problems in machine learning and optimization arise naturally in finite-dimensional vector spaces endowed with non-Euclidean norms, such as…

Optimization and Control · Mathematics 2025-08-26 Alexander Davydov , Saber Jafarpour , Anton V. Proskurnikov , Francesco Bullo

The quasi-Monte Carlo method is widely used in computational finance, whose efficiency strongly depends on the smoothness and effective dimension of the integrand. In this work, we investigate the combination of importance sampling and the…

Numerical Analysis · Mathematics 2026-03-05 Jiaxin Yu , Xiaoqun Wang