English
Related papers

Related papers: Sparse semiparametric discriminant analysis for hi…

200 papers

Parametric and non-parametric classifiers often have to deal with real-world data, where corruptions like noise, occlusions, and blur are unavoidable - posing significant challenges. We present a probabilistic approach to classify strongly…

Machine Learning · Computer Science 2023-04-24 Philipp Joppich , Sebastian Dorn , Oliver De Candido , Wolfgang Utschick , Jakob Knollmüller

In this paper, we study the problem of high-dimensional sparse quadratic discriminant analysis (QDA). We propose a novel classification method, termed SSQDA, which is constructed via constrained convex optimization based on the sample…

Methodology · Statistics 2025-04-16 Anqing Shen , Long Feng

In this paper, we apply shrinkage strategies to estimate regression coefficients efficiently for the high-dimensional multiple regression model, where the number of samples is smaller than the number of predictors. We assume in the sparse…

Methodology · Statistics 2017-04-19 B. Yuzbasi , M. Arashi , S. E. Ahmed

This paper introduces a novel framework for dynamic classification in high dimensional spaces, addressing the evolving nature of class distributions over time or other index variables. Traditional discriminant analysis techniques are…

Methodology · Statistics 2025-02-18 Wenbo Ouyang , Ruiyang Wu , Ning Hao , Hao Helen Zhang

This paper deals with Gibbs samplers that include high dimensional conditional Gaussian distributions. It proposes an efficient algorithm that avoids the high dimensional Gaussian sampling and relies on a random excursion along a small set…

Computation · Statistics 2016-04-20 Olivier Féron , François Orieux , Jean-François Giovannelli

We consider the classification problem of a high-dimensional mixture of two Gaussians with general covariance matrices. Using the replica method from statistical physics, we investigate the asymptotic behavior of a general class of…

Machine Learning · Statistics 2024-10-29 Hanwen Huang , Peng Zeng

Spatial frequency estimation from a mixture of noisy sinusoids finds applications in various fields. While subspace-based methods offer cost-effective super-resolution parameter estimation, they demand precise array calibration, posing…

Signal Processing · Electrical Eng. & Systems 2024-10-23 Tianyi Liu , Sai Pavan Deram , Khaled Ardah , Martin Haardt , Marc E. Pfetsch , Marius Pesavento

A new framework based on the theory of copulas is proposed to address semi- supervised domain adaptation problems. The presented method factorizes any multivariate density into a product of marginal distributions and bivariate cop- ula…

Machine Learning · Statistics 2013-01-03 David Lopez-Paz , José Miguel Hernández-Lobato , Bernhard Schölkopf

With the development of next generation sequencing technology, researchers have now been able to study the microbiome composition using direct sequencing, whose output are bacterial taxa counts for each microbiome sample. One goal of…

Applications · Statistics 2013-05-24 Jun Chen , Hongzhe Li

This paper considers sparse linear discriminant analysis of high-dimensional data. In contrast to the existing methods which are based on separate estimation of the precision matrix $\O$ and the difference $\de$ of the mean vectors, we…

Methodology · Statistics 2011-07-19 Tony Cai , Weidong Liu

Compressive sensing has been successfully used for optimized operations in wireless sensor networks. However, raw data collected by sensors may be neither originally sparse nor easily transformed into a sparse data representation. This…

Networking and Internet Architecture · Computer Science 2016-08-16 Mohammad Abu Alsheikh , Shaowei Lin , Hwee-Pink Tan , Dusit Niyato

Classification with a sparsity constraint on the solution plays a central role in many high dimensional machine learning applications. In some cases, the features can be grouped together so that entire subsets of features can be selected or…

Machine Learning · Computer Science 2014-09-05 Nikhil Rao , Robert Nowak , Christopher Cox , Timothy Rogers

Learning over sparse, high-dimensional data frequently necessitates the use of specialized methods such as the hashing trick. In this work, we design a highly scalable alternative approach that leverages the low degree of feature…

Machine Learning · Statistics 2020-06-09 Vladimir Feinberg , Peter Bailis

Sparse principal component analysis (SPCA) methods have proven to efficiently analyze high-dimensional data. Among them, threshold-based SPCA (TSPCA) is computationally more cost-effective than regularized SPCA, based on L1 penalties. We…

Methodology · Statistics 2023-05-29 Kazuyoshi Yata , Makoto Aoshima

Sparsity is a fundamental modeling principle in statistics, signal processing, and data science. However, optimization with sparsity constraints is notoriously difficult. We introduce a new convex relaxation framework for {sparse…

Optimization and Control · Mathematics 2026-03-20 Diego Cifuentes , Zhuorui Li

This paper is devoted to the problem of sampling Gaussian fields in high dimension. Solutions exist for two specific structures of inverse covariance : sparse and circulant. The proposed approach is valid in a more general case and…

Computation · Statistics 2011-05-31 F. Orieux , O. Féron , J. -F. Giovannelli

High dimensional data has introduced challenges that are difficult to address when attempting to implement classical approaches of statistical process control. This has made it a topic of interest for research due in recent years. However,…

Applications · Statistics 2019-04-23 Mohammad Nabhan , Yajun Mei , Jianjun Shi

Researchers are often interested in predicting outcomes, conducting clustering analysis to detect distinct subgroups of their data, or computing causal treatment effects. Pathological data distributions that exhibit skewness and…

Methodology · Statistics 2020-08-24 Arman Oganisian , Nandita Mitra , Jason Roy

Sparse principal component analysis (sparse PCA) is a widely used technique for dimensionality reduction in multivariate analysis, addressing two key limitations of standard PCA. First, sparse PCA can be implemented in high-dimensional low…

Methodology · Statistics 2025-10-07 Jan O. Bauer

We propose a novel distributional regression model for a multivariate response vector based on a copula process over the covariate space. It uses the implicit copula of a Gaussian multivariate regression, which we call a ``regression…

Methodology · Statistics 2024-03-06 Nadja Klein , Michael Stanley Smith , David Nott , Ryan Chisholm