English
Related papers

Related papers: Robust Sufficient Dimension Reduction via $\alpha$…

200 papers

Dimensional reduction~(DR) maps high-dimensional data into a lower dimensions latent space with minimized defined optimization objectives. The DR method usually falls into feature selection~(FS) and feature projection~(FP). FS focuses on…

Machine Learning · Computer Science 2022-11-24 Zelin Zang , Yongjie Xu , Linyan Lu , Yulan Geng , Senqiao Yang , Stan Z. Li

For multiple index models, it has recently been shown that the sliced inverse regression (SIR) is consistent for estimating the sufficient dimension reduction (SDR) space if and only if $\rho=\lim\frac{p}{n}=0$, where $p$ is the dimension…

Statistics Theory · Mathematics 2018-06-19 Qian Lin , Zhigen Zhao , Jun S. Liu

Differential dynamic programming (DDP) is a popular technique for solving nonlinear optimal control problems with locally quadratic approximations. However, existing DDP methods are not designed for stochastic systems with unknown…

Systems and Control · Electrical Eng. & Systems 2023-05-18 Astghik Hakobyan , Insoon Yang

High dimension low sample size statistical analysis is important in a wide range of applications. In such situations, the highly appealing discrimination method, support vector machine, can be improved to alleviate data piling at the…

Optimization and Control · Mathematics 2017-08-18 Xin Yee Lam , J. S. Marron , Defeng Sun , Kim-Chuan Toh

In recent years, large high-dimensional data sets have become commonplace in a wide range of applications in science and commerce. Techniques for dimension reduction are of primary concern in statistical analysis. Projection methods play an…

Computation · Statistics 2008-01-24 Peter Clifford , Ioana A. Cosma

Distributionally robust optimization (DRO) problems are increasingly seen as a viable method to train machine learning models for improved model generalization. These min-max formulations, however, are more difficult to solve. We therefore…

Machine Learning · Statistics 2020-11-03 Soumyadip Ghosh , Mark Squillante , Ebisa Wollega

Classical pixel-based Visual Servoing (VS) approaches offer high accuracy but suffer from a limited convergence area due to optimization nonlinearity. Modern deep learning-based VS methods overcome traditional vision issues but lack…

Robotics · Computer Science 2023-10-03 Salar Asayesh , Hossein Sheikhi Darani , Mo chen , Mehran Mehrandezh , Kamal Gupta

Multi-dimensional scaling (MDS) plays a central role in data-exploration, dimensionality reduction and visualization. State-of-the-art MDS algorithms are not robust to outliers, yielding significant errors in the embedding even when only a…

Computer Vision and Pattern Recognition · Computer Science 2018-02-08 Leonid Blouvshtein , Daniel Cohen-Or

Modeling data as being sampled from a union of independent subspaces has been widely applied to a number of real world applications. However, dimensionality reduction approaches that theoretically preserve this independence assumption have…

Machine Learning · Computer Science 2016-04-08 Devansh Arpit , Ifeoma Nwogu , Venu Govindaraju

In this paper we introduce a general theory for nonlinear sufficient dimension reduction, and explore its ramifications and scope. This theory subsumes recent work employing reproducing kernel Hilbert spaces, and reveals many parallels…

Statistics Theory · Mathematics 2013-04-03 Kuang-Yao Lee , Bing Li , Francesca Chiaromonte

This paper presents preliminary work on a novel connection between certified robustness in machine learning and the modeling of 3D objects. We highlight an intriguing link between the Maximal Certified Radius (MCR) of a classifier…

Computer Vision and Pattern Recognition · Computer Science 2024-08-26 Gabriel Pérez S , Juan C. Pérez , Motasem Alfarra , Jesús Zarzar , Sara Rojas , Bernard Ghanem , Pablo Arbeláez

Applying dimensionality reduction (DR) to large, high-dimensional data sets can be challenging when distinguishing the underlying high-dimensional data clusters in a 2D projection for exploratory analysis. We address this problem by first…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Youngjoo Kim , Alexandru C. Telea , Scott C. Trager , Jos B. T. M. Roerdink

Single Image Super-Resolution (SISR) is one of the low-level computer vision problems that has received increased attention in the last few years. Current approaches are primarily based on harnessing the power of deep learning models and…

Computer Vision and Pattern Recognition · Computer Science 2021-05-19 Santiago López-Tapia , Nicolás Pérez de la Blanca

Sufficient dimension reduction [J. Amer. Statist. Assoc. 86 (1991) 316-342] has long been a prominent issue in multivariate nonparametric regression analysis. To uncover the central dimension reduction space, we propose in this paper an…

Statistics Theory · Mathematics 2014-08-15 Efang Kong , Yingcun Xia

Cellwise Robust Twoblock (CRTB) is introduced, the first cellwise robust method for simultaneous dimension reduction of multivariate predictor and response blocks, in both a dense and a sparse variable-selecting variant. Classical robust…

Methodology · Statistics 2026-04-17 Sven Serneels

We revisit the problem of estimating the mean of a high-dimensional distribution in the presence of an $\varepsilon$-fraction of adversarial outliers. When $\varepsilon$ is at most some sufficiently small constant, previous works can…

Data Structures and Algorithms · Computer Science 2024-11-22 Hongjie Chen , Deepak Narayanan Sridharan , David Steurer

Distributionally robust optimization (DRO) has shown lot of promise in providing robustness in learning as well as sample based optimization problems. We endeavor to provide DRO solutions for a class of sum of fractionals, non-convex…

Machine Learning · Computer Science 2022-06-01 Avinandan Bose , Arunesh Sinha , Tien Mai

Distributionally robust supervised learning (DRSL) is emerging as a key paradigm for building reliable machine learning systems for real-world applications -- reflecting the need for classifiers and predictive models that are robust to the…

Machine Learning · Computer Science 2022-01-26 Yaodong Yu , Tianyi Lin , Eric Mazumdar , Michael I. Jordan

The development and use of dimension reduction methods is prevalent in modern statistical literature. This paper reviews a class of dimension reduction techniques which aim to simultaneously select relevant predictors and find clusters…

Methodology · Statistics 2022-02-18 Suchit Mehrotra

This paper introduces a robust estimation strategy for the spatial functional linear regression model using dimension reduction methods, specifically functional principal component analysis (FPCA) and functional partial least squares…

Methodology · Statistics 2024-10-28 Ufuk Beyaztas , Abhijit Mandal , Han Lin Shang