English
Related papers

Related papers: A Constructive Approach to the Estimation of Dimen…

200 papers

We present a new dimension reduction method called the global active subspace method. The method uses expected values of finite differences of the underlying function to identify the important directions, and builds a surrogate model using…

General Mathematics · Mathematics 2024-10-22 Ruilong Yue , Giray Ökten

Conventional compressive sensing (CS) reconstruction is very slow for its characteristic of solving an optimization problem. Convolu- tional neural network can realize fast processing while achieving compa- rable results. While CS image…

Computer Vision and Pattern Recognition · Computer Science 2017-10-04 Xuemei Xie , Yuxiang Wang , Guangming Shi , Chenye Wang , Jiang Du , Zhifu Zhao

Recently, Su and Cook proposed a dimension reduction technique called the inner envelope which can be substantially more efficient than the original envelope or existing dimension reduction techniques for multivariate regression. However,…

Methodology · Statistics 2022-05-25 Linquan Ma , Hyunseung Kang , Lan Liu

In the regression setting, dimension reduction allows for complicated regression structures to be detected via visualization in a low-dimension framework. However, some popular dimension reduction methodologies fail to achieve this aim when…

Methodology · Statistics 2014-03-26 Luke A. Prendergast , Alexandra L. Garnham

Modes and ridges of the probability density function behind observed data are useful geometric features. Mode-seeking clustering assigns cluster labels by associating data samples with the nearest modes, and estimation of density ridges…

Machine Learning · Statistics 2018-04-03 Hiroaki Sasaki , Takafumi Kanamori , Aapo Hyvärinen , Gang Niu , Masashi Sugiyama

Sliced inverse regression is one of the most popular sufficient dimension reduction methods. Originally, it was designed for independent and identically distributed data and recently extend to the case of serially and spatially dependent…

Methodology · Statistics 2021-07-07 Christoph Muehlmann , Hannu Oja , Klaus Nordhausen

Dimension Estimation (DE) and Dimension Reduction (DR) are two closely related topics, but with quite different goals. In DE, one attempts to estimate the intrinsic dimensionality or number of latent variables in a set of measurements of a…

Machine Learning · Computer Science 2019-09-25 Nitish Bahadur , Randy Paffenroth

Compressive Sensing (CS) theory asserts that sparse signal reconstruction is possible from a small number of linear measurements. Although CS enables low-cost linear sampling, it requires non-linear and costly reconstruction. Recent…

Machine Learning · Computer Science 2018-10-16 Aysen Degerli , Sinem Aslan , Mehmet Yamac , Bulent Sankur , Moncef Gabbouj

A major family of sufficient dimension reduction (SDR) methods, called inverse regression, commonly require the distribution of the predictor $X$ to have a linear $E(X|\beta^\mathsf{T}X)$ and a degenerate $\mathrm{var}(X|\beta^\mathsf{T}X)$…

Methodology · Statistics 2023-08-30 Wei Luo , Yan Guo

We consider the task of estimating the 3D orientation of an object of known category given an image of the object and a bounding box around it. Recently, CNN-based regression and classification methods have shown significant performance…

Computer Vision and Pattern Recognition · Computer Science 2018-07-20 Siddharth Mahendran , Ming Yang Lu , Haider Ali , René Vidal

Compressed sensing (CS) is an innovative technique allowing to represent signals through a small number of their linear projections. Hence, CS can be thought of as a natural candidate for acquisition of multidimensional signals, as the…

Information Theory · Computer Science 2014-03-06 Giulio Coluccia , Simeon Kamden-Kuiteng , Andrea Abrardo , Mauro Barni , Enrico Magli

Dimensionality reduction is a crucial technique in data analysis, as it allows for the efficient visualization and understanding of high-dimensional datasets. The circular coordinate is one of the topological data analysis techniques…

Algebraic Topology · Mathematics 2023-01-31 Taejin Paik , Jaemin Park

Most dimensionality reduction methods employ frequency domain representations obtained from matrix diagonalization and may not be efficient for large datasets with relatively high intrinsic dimensions. To address this challenge, Correlated…

Machine Learning · Statistics 2022-06-10 Yuta Hozumi , Rui Wang , Guo-Wei Wei

The ``curse of dimensionality'' has remained a challenge for high-dimensional data analysis in statistics. The sliced inverse regression (SIR) and canonical correlation (CANCOR) methods aim to reduce the dimensionality of data by replacing…

Statistics Theory · Mathematics 2008-08-08 Jianhui Zhou , Xuming He

This paper investigates the comparative performance of two fundamental approaches to solving linear regression problems: the closed-form Moore-Penrose pseudoinverse and the iterative gradient descent method. Linear regression is a…

Machine Learning · Computer Science 2025-05-30 Alex Adams

This manuscript is superseded by Constantine, Dow, and Wang's "Active Subspaces in Theory and Practice: Applications to Kriging Surfaces" [SIAM J. of Sci. Comput., 36 (2014), pp. A1500-A1524]. Many multivariate functions encountered in…

Numerical Analysis · Mathematics 2014-08-26 Paul G. Constantine , Qiqi Wang

Compressed sensing (CS) is a powerful method routinely employed to accelerate image acquisition. It is particularly suited to situations when the image under consideration is sparse but can be sampled in a basis where it is non-sparse. Here…

Image and Video Processing · Electrical Eng. & Systems 2022-07-18 Xudong Lv , Ashok Ajoy

Modeling data as being sampled from a union of independent subspaces has been widely applied to a number of real world applications. However, dimensionality reduction approaches that theoretically preserve this independence assumption have…

Machine Learning · Computer Science 2016-04-08 Devansh Arpit , Ifeoma Nwogu , Venu Govindaraju

This article concerns the dimension reduction in regression for large data set. We introduce a new method based on the sliced inverse regression approach, called cluster-based regularized sliced inverse regression. Our method not only keeps…

Applications · Statistics 2013-12-03 Yue Yu , Zhihong Chen , Jie Yang

Effective cross-modal retrieval requires robust alignment of heterogeneous data types. Most existing methods focus on bi-modal retrieval tasks and rely on distributional alignment techniques such as Kullback-Leibler divergence, Maximum Mean…

Information Retrieval · Computer Science 2025-09-29 Jiahao Zhang , Wenzhe Yin , Shujian Yu