English
Related papers

Related papers: Fourier analysis perspective for sufficient dimens…

200 papers

Dimension reduction (DR) methods provide systematic approaches for analyzing high-dimensional data. A key requirement for DR is to incorporate global dependencies among original and embedded samples while preserving clusters in the…

Machine Learning · Statistics 2023-03-10 Antoine Collas , Titouan Vayer , Rémi Flamary , Arnaud Breloy

Sufficient dimension reduction methods often require stringent conditions on the joint distribution of the predictor, or, when such conditions are not satisfied, rely on marginal transformation or reweighting to fulfill them approximately.…

Statistics Theory · Mathematics 2009-04-27 Bing Li , Yuexiao Dong

We consider the problem of simultaneously finding lower-dimensional subspace structures in a given $m$-tuple of possibly corrupted, high-dimensional data sets all of the same size. We refer to this problem as simultaneous robust subspace…

Representation Theory · Mathematics 2022-02-22 Calin Chindris , Daniel Kline

Addressing the simultaneous identification of contributory variables while controlling the false discovery rate (FDR) in high-dimensional data is a crucial statistical challenge. In this paper, we propose a novel model-free variable…

Methodology · Statistics 2024-04-23 Yixin Han , Xu Guo , Changliang Zou

Unsupervised learning aims to capture the underlying structure of potentially large and high-dimensional datasets. Traditionally, this involves using dimensionality reduction (DR) methods to project data onto lower-dimensional spaces or…

Machine Learning · Computer Science 2025-06-30 Hugues Van Assel , Cédric Vincent-Cuaz , Nicolas Courty , Rémi Flamary , Pascal Frossard , Titouan Vayer

We consider model-based derivative-free optimization (DFO) for large-scale problems, based on iterative minimization in random subspaces. We provide the first worst-case complexity bound for such methods for convergence to approximate…

Optimization and Control · Mathematics 2024-12-20 Coralia Cartis , Lindon Roberts

We provide the foundations of a Hilbert space theory for the short-time Fourier transform (STFT) where the flat tori \begin{equation*} \mathbb{T}_{N}^2=\mathbb{R}^2/(\mathbb{Z}\times N\mathbb{Z})=[0,1]\times \lbrack 0,N] \end{equation*} act…

Functional Analysis · Mathematics 2023-10-24 Luis Daniel Abreu , Peter Balazs , Nicki Holighaus , Franz Luef , Michael Speckbacher

We first construct a space $\mathcal{W}\left( \mathbb{R}_{\text{c}} ^{n}\right) $ whose elements are test functions defined in $\mathbb{R} _{\text{c}}^{n}=\mathbb{R}^{n}\cup\left\{ \mathbf{\infty}\right\} ,$ the one point compactification…

Functional Analysis · Mathematics 2021-08-19 Ricardo Estrada , Jasson Vindas , Yunyun Yang

Submodular functions have applications throughout machine learning, but in many settings, we do not have direct access to the underlying function $f$. We focus on stochastic functions that are given as an expectation of functions over a…

Machine Learning · Computer Science 2018-06-07 Matthew Staib , Bryan Wilder , Stefanie Jegelka

Despite many applications, dimensionality reduction in the $\ell_1$-norm is much less understood than in the Euclidean norm. We give two new oblivious dimensionality reduction techniques for the $\ell_1$-norm which improve exponentially…

Data Structures and Algorithms · Computer Science 2021-08-09 Yi Li , David P. Woodruff , Taisuke Yasuda

We investigate analytic properties of the double Fourier sphere (DFS) method, which transforms a function defined on the two-dimensional sphere to a function defined on the two-dimensional torus. Then the resulting function can be written…

Numerical Analysis · Mathematics 2022-03-23 Sophie Mildenberger , Michael Quellmalz

Single image super-resolution (SISR) aims to reconstruct high-resolution (HR) images from the given low-resolution (LR) ones, which is an ill-posed problem because one LR image corresponds to multiple HR images. Recently, learning-based…

Computer Vision and Pattern Recognition · Computer Science 2021-05-19 Haoying Li , Yifan Yang , Meng Chang , Huajun Feng , Zhihai Xu , Qi Li , Yueting Chen

The Johnson-Lindenstrauss (JL) Lemma introduced the concept of dimension reduction via a random linear map, which has become a fundamental technique in many computational settings. For a set of $n$ points in $\mathbb{R}^d$ and any fixed…

Data Structures and Algorithms · Computer Science 2026-02-23 Shaofeng H. -C. Jiang , Robert Krauthgamer , Shay Sapir

This paper presents a novel approach that combines the Deep Ritz Method (DRM) with Fourier feature mapping to solve minimization problems comprised of multi-well, non-convex energy potentials. These problems present computational challenges…

Machine Learning · Computer Science 2025-02-12 Ensela Mema , Ting Wang , Jaroslaw Knap

In this paper modified variants of the sparse Fourier transform algorithms from [14] are presented which improve on the approximation error bounds of the original algorithms. In addition, simple methods for extending the improved sparse…

Numerical Analysis · Mathematics 2010-10-04 M. A. Iwen

We compare the long-time error bounds and spatial resolution of finite difference methods with different spatial discretizations for the Dirac equation with small electromagnetic potentials characterized by $\varepsilon \in (0, 1]$ a…

Numerical Analysis · Mathematics 2021-05-24 Yue Feng , Jia Yin

We prove sharp inequalities for the symmetric-decreasing rearrangement in Fourier space of functions in $\mathbb{R}^d$. Our main result can be applied to a general class of (pseudo-)differential operators in $\mathbb{R}^d$ of arbitrary…

Analysis of PDEs · Mathematics 2019-03-06 Enno Lenzmann , Jérémy Sok

The real-life data have a complex and non-linear structure due to their nature. These non-linearities and the large number of features can usually cause problems such as the empty-space phenomenon and the well-known curse of dimensionality.…

Machine Learning · Computer Science 2025-03-13 Kadir Özçoban , Murat Manguoğlu , Emrullah Fatih Yetkin

Geometric model fitting is a fundamental research topic in computer vision and it aims to fit and segment multiple-structure data. In this paper, we propose a novel superpixel-guided two-view geometric model fitting method (called SDF),…

Computer Vision and Pattern Recognition · Computer Science 2018-05-04 Guobao Xiao , Hanzi Wang , Yan Yan , David Suter

Let $\RR$ be a real closed field (e.g. the field of real numbers) and $\mathscr{S} \subset \RR^n$ be a semi-algebraic set defined as the set of points in $\RR^n$ satisfying a system of $s$ equalities and inequalities of multivariate…

Symbolic Computation · Computer Science 2013-09-20 Mohab Safey El Din , Elias Tsigaridas