English
Related papers

Related papers: A Support Detection and Root Finding Approach for …

200 papers

Outlier detection has gained increasing interest in recent years, due to newly emerging technologies and the huge amount of high-dimensional data that are now available. Outlier detection can help practitioners to identify unwanted noise…

Statistics Theory · Mathematics 2021-05-20 Mads Lindskou , Torben Tvedebrink , Poul Svante Eriksen , Niels Morling

We propose a Generalized Dantzig Selector (GDS) for linear models, in which any norm encoding the parameter structure can be leveraged for estimation. We investigate both computational and statistical aspects of the GDS. Based on conjugate…

Machine Learning · Statistics 2015-02-03 Soumyadeep Chatterjee , Sheng Chen , Arindam Banerjee

A current strand of research in high-dimensional statistics deals with robustifying the available methodology with respect to deviations from the pervasive light-tail assumptions. In this paper we consider a linear mean regression model…

Statistics Theory · Mathematics 2025-02-06 Philipp Hermann , Hajo Holzmann

The focus of modern biomedical studies has gradually shifted to explanation and estimation of joint effects of high dimensional predictors on disease risks. Quantifying uncertainty in these estimates may provide valuable insight into…

Methodology · Statistics 2021-03-09 Zhe Fei , Yi Li

We present unsupervised parameter learning in a Gaussian variational inference setting that combines classic trajectory estimation for mobile robots with deep learning for rich sensor data, all under a single learning objective. The…

Robotics · Computer Science 2021-02-23 David J. Yoon , Haowei Zhang , Mona Gridseth , Hugues Thomas , Timothy D. Barfoot

The ability to efficiently and accurately detect objects plays a very crucial role for many computer vision tasks. Recently, offline object detectors have shown a tremendous success. However, one major drawback of offline techniques is that…

Computer Vision and Pattern Recognition · Computer Science 2010-09-01 Sakrapee Paisitkriangkrai , Chunhua Shen , Jian Zhang

This paper analyzes a new regularized learning scheme for high dimensional partially linear support vector machine. The proposed approach consists of an empirical risk and the Lasso-type penalty for linear part, as well as the standard…

Statistics Theory · Mathematics 2020-06-08 Yifan Xia , Yongchao Hou , Shaogao Lv

We propose a compressive classification framework for settings where the data dimensionality is significantly higher than the sample size. The proposed method, referred to as compressive regularized discriminant analysis (CRDA) is based on…

Machine Learning · Statistics 2020-11-13 Muhammad Naveed Tabassum , Esa Ollila

This paper considers the design of tunable decision schemes capable of rejecting with high probability mismatched signals embedded in Gaussian interference with unknown covariance matrix. To this end, a sparse recovery technique is…

Signal Processing · Electrical Eng. & Systems 2020-04-29 Sudan Han , Luca Pallotta , Xiaotao Huang , Gaetano Giunta , Danilo Orlando

This paper provides a statistical analysis of high-dimensional batch Reinforcement Learning (RL) using sparse linear function approximation. When there is a large number of candidate features, our result sheds light on the fact that…

Machine Learning · Computer Science 2020-11-10 Botao Hao , Yaqi Duan , Tor Lattimore , Csaba Szepesvári , Mengdi Wang

Linear discriminant analysis (LDA) is a classical method for dimensionality reduction, where discriminant vectors are sought to project data to a lower dimensional space for optimal separability of classes. Several recent papers have…

Computation · Statistics 2022-03-04 Summer Atkins , Gudmundur Einarsson , Brendan Ames , Line Clemmensen

We present a new method for estimating multivariate, second-order stationary Gaussian Random Field (GRF) models based on the Sparse Precision matrix Selection (SPS) algorithm, proposed by Davanloo et al. (2015) for estimating scalar GRF…

Machine Learning · Statistics 2021-01-12 Sam Davanloo Tajbakhsh , Necdet Serhat Aybat , Enrique del Castillo

Ordinary differential equations (ODE) have been widely used for modeling dynamical complex systems. For high-dimensional ODE models where the number of differential equations is large, it remains challenging to estimate the ODE parameters…

Methodology · Statistics 2022-06-20 Muye Nanshan , Nan Zhang , Xiaolei Xun , Jiguo Cao

Estimation of the precision matrix (or inverse covariance matrix) is of great importance in statistical data analysis and machine learning. However, as the number of parameters scales quadratically with the dimension $p$, computation…

Computation · Statistics 2022-11-02 Qian LI , Binyan Jiang , Defeng Sun

We consider the problem of learning a graph modeling the statistical relations of the $d$ variables from a dataset with $n$ samples $X \in \mathbb{R}^{n \times d}$. Standard approaches amount to searching for a precision matrix $\Theta$…

Machine Learning · Statistics 2023-12-13 Titouan Vayer , Etienne Lasalle , Rémi Gribonval , Paulo Gonçalves

We provide efficient algorithms for the problem of distribution learning from high-dimensional Gaussian data where in each sample, some of the variable values are missing. We suppose that the variables are missing not at random (MNAR). The…

Machine Learning · Computer Science 2025-04-29 Arnab Bhattacharyya , Constantinos Daskalakis , Themis Gouleakis , Yuhao Wang

The generalised linear model (GLM) is a very important tool for analysing real data in biology, sociology, agriculture, engineering and many other application domain where the relationship between the response and explanatory variables may…

Methodology · Statistics 2016-07-04 Abhik Ghosh , Ayanendranath Basu

In this paper we discuss an application of Stochastic Approximation to statistical estimation of high-dimensional sparse parameters. The proposed solution reduces to resolving a penalized stochastic optimization problem on each stage of a…

Machine Learning · Statistics 2022-10-25 Sasila Ilandarideva , Yannis Bekri , Anatoli Juditsky , Vianney Perchet

In this paper we investigate the generalization error of gradient descent (GD) applied to an $\ell_2$-regularized OLS objective function in the linear model. Based on our analysis we develop new methodology for computationally tractable and…

Statistics Theory · Mathematics 2026-01-27 Thomas Stark , Lukas Steinberger

We propose a robust inferential procedure for assessing uncertainties of parameter estimation in high-dimensional linear models, where the dimension $p$ can grow exponentially fast with the sample size $n$. Our method combines the…

Machine Learning · Statistics 2015-03-19 Tianqi Zhao , Mladen Kolar , Han Liu