English
Related papers

Related papers: Robust Sufficient Dimension Reduction via $\alpha$…

200 papers

We present a new numerical scheme which combines the Spectral Difference (SD) method up to arbitrary high order with \emph{a-posteriori} limiting using the classical MUSCL-Hancock scheme as fallback scheme. It delivers very accurate…

Instrumentation and Methods for Astrophysics · Physics 2023-03-29 David Velasco-Romero , Maria Han Veiga , Romain Teyssier

In this paper, we propose a novel approach for outlier detection, called local projections, which is based on concepts of Local Outlier Factor (LOF) (Breunig et al., 2000) and RobPCA (Hubert et al., 2005). By using aspects of both methods,…

We present a Distributionally Robust Optimization (DRO) approach to estimate a robustified regression plane in a linear regression setting, when the observed samples are potentially contaminated with adversarially corrupted outliers. Our…

Machine Learning · Statistics 2018-05-14 Ruidi Chen , Ioannis Ch. Paschalidis

Derivative-free Riemannian optimization (DFRO) aims to minimize an objective function using only function evaluations, under the constraint that the decision variables lie on a Riemannian manifold. The rapid increase in problem dimensions…

Optimization and Control · Mathematics 2026-01-14 Timothé Taminiau , Estelle Massart , Geovani Nunes Grapiglia

Distributionally robust optimization (DRO) is a widely used framework for optimizing objective functionals in the presence of both randomness and model-form uncertainty. A key step in the practical solution of many DRO problems is a…

Optimization and Control · Mathematics 2021-04-22 Jeremiah Birrell

Spectral deferred corrections (SDC) is an iterative approach for constructing higher- order accurate numerical approximations of ordinary differential equations. SDC starts with an initial approximation of the solution defined at a set of…

Computational Engineering, Finance, and Science · Computer Science 2017-06-14 R. W. Grout , H. Kolla , M. L. Minion , J. B. Bell

Machine learning models deployed in the wild can be challenged by out-of-distribution (OOD) data from unknown classes. Recent advances in OOD detection rely on distance measures to distinguish samples that are relatively far away from the…

Machine Learning · Computer Science 2023-12-25 Soumya Suvra Ghosal , Yiyou Sun , Yixuan Li

Ensemble Conditional Variance Estimation (ECVE) is a novel sufficient dimension reduction (SDR) method in regressions with continuous response and predictors. ECVE applies to general non-additive error regression models. It operates under…

Methodology · Statistics 2021-03-01 Lukas Fertl , Efstathia Bura

We present a framework for supervised subspace tracking, when there are two time series $x_t$ and $y_t$, one being the high-dimensional predictors and the other being the response variables and the subspace tracking needs to take into…

Machine Learning · Computer Science 2015-09-02 Yao Xie , Ruiyang Song , Hanjun Dai , Qingbin Li , Le Song

Many machine learning applications deal with high dimensional data. To make computations feasible and learning more efficient, it is often desirable to reduce the dimensionality of the input variables by finding linear combinations of the…

Machine Learning · Computer Science 2025-01-30 Wenjing Yang , Yuhong Yang

Approximate joint diagonalization of a set of matrices provides a powerful framework for numerous statistical signal processing applications. For non-unitary joint diagonalization (NUJD) based on the least-squares (LS) criterion, outliers,…

Signal Processing · Electrical Eng. & Systems 2021-07-14 Wenjuan Liu , Dazheng Feng , Bingnan Pei , Mengdao Xing , Xinhong Meng , Qianru Wei

Fast and cheaper next generation sequencing technologies will generate unprecedentedly massive and highly-dimensional genomic and epigenomic variation data. In the near future, a routine part of medical record will include the sequenced…

Genomics · Quantitative Biology 2013-01-17 Momiao Xiong , Long Ma

Mirror descent (MD) is a powerful first-order optimization technique that subsumes several optimization algorithms including gradient descent (GD). In this work, we develop a semi-definite programming (SDP) framework to analyze the…

Optimization and Control · Mathematics 2022-01-19 Youbang Sun , Mahyar Fazlyab , Shahin Shahrampour

Empirical regression discontinuity (RD) studies often include covariates in their specifications to increase the precision of their estimates. In this paper, we propose a novel class of estimators that use such covariate information more…

Econometrics · Economics 2025-04-28 Claudia Noack , Tomasz Olma , Christoph Rothe

In this paper, we consider regression models with a Hilbert-space-valued predictor and a scalar response, where the response depends on the predictor only through a finite number of projections. The linear subspace spanned by these…

Statistics Theory · Mathematics 2010-11-12 Yehua Li , Tailen Hsing

High-dimensional data are commonly seen in modern statistical applications, variable selection methods play indispensable roles in identifying the critical features for scientific discoveries. Traditional best subset selection methods are…

Methodology · Statistics 2022-12-29 Tianzhou Ma , Hongjie Ke , Zhao Ren

We give the first polynomial-time algorithm for performing linear or polynomial regression resilient to adversarial corruptions in both examples and labels. Given a sufficiently large (polynomial-size) training set drawn i.i.d. from…

Machine Learning · Computer Science 2020-06-05 Adam Klivans , Pravesh K. Kothari , Raghu Meka

Continuous DR-submodular functions are a class of functions that satisfy the Diminishing Returns (DR) property, which implies that they are concave along non-negative directions. Existing works have studied monotone continuous DR-submodular…

Machine Learning · Computer Science 2022-05-31 Omid Sadeghi , Maryam Fazel

In this paper, we present a dimension reduction method to reduce the dimension of parameter space and state space and efficiently solve inverse problems. To this end, proper orthogonal decomposition (POD) and radial basis function (RBF) are…

Numerical Analysis · Mathematics 2016-10-18 Fuchen Chen , Lijian Jiang , Guanghui Zheng

In this paper, we consider a distributed stochastic non-convex optimization problem, which is about minimizing a sum of $n$ local cost functions over a network with only zeroth-order information. A novel single-loop Decentralized…

Optimization and Control · Mathematics 2023-10-31 Hongxu Chen , Jinchi Chen , Ke Wei