English
Related papers

Related papers: Group-Orthogonal Subsampling for Hierarchical Data…

200 papers

This paper studies the subspace segmentation problem which aims to segment data drawn from a union of multiple linear subspaces. Recent works by using sparse representation, low rank representation and their extensions attract much…

Computer Vision and Pattern Recognition · Computer Science 2014-04-29 Can-Yi Lu , Hai Min , Zhong-Qiu Zhao , Lin Zhu , De-Shuang Huang , Shuicheng Yan

Gaussian mixtures are commonly used for modeling heavy-tailed error distributions in robust linear regression. Combining the likelihood of a multivariate robust linear regression model with a standard improper prior distribution yields an…

Statistics Theory · Mathematics 2023-01-05 Haoxiang Li , Qian Qin , Galin L. Jones

Compressive Sensing (CS) has been applied successfully in a wide variety of applications in recent years, including photography, shortwave infrared cameras, optical system research, facial recognition, MRI, etc. In wireless sensor networks…

Networking and Internet Architecture · Computer Science 2013-11-20 Xi Xu , Rashid Ansari , Ashfaq Khokhar

This article proposes a graphical model that handles mixed-type, multi-group data. The motivation for such a model originates from real-world observational data, which often contain groups of samples obtained under heterogeneous conditions…

Methodology · Statistics 2023-01-02 Sjoerd Hermes , Joost van Heerwaarden , Pariya Behrouzi

In supervised learning, it is quite frequent to be confronted with real imbalanced datasets. This situation leads to a learning difficulty for standard algorithms. Research and solutions in imbalanced learning have mainly focused on…

Machine Learning · Statistics 2023-08-08 Samuel Stocksieker , Denys Pommeret , Arthur Charpentier

The design of sampling set (DoS) for bandlimited graph signals (GS) has been extensively studied in recent years, but few of them exploit the benefits of the stochastic prior of GS. In this work, we introduce the optimization framework for…

Signal Processing · Electrical Eng. & Systems 2019-09-10 Xuan Xie , Junhao Yu , Hui Feng , Bo Hu

Learning graphical conditional independence structures is an important machine learning problem and a cornerstone of causal discovery. However, the accuracy and execution time of learning algorithms generally struggle to scale to problems…

Machine Learning · Computer Science 2023-10-30 Bryan Andrews , Joseph Ramsey , Ruben Sanchez-Romero , Jazmin Camchong , Erich Kummerfeld

In regression problems where covariates can be naturally grouped, the group Lasso is an attractive method for variable selection since it respects the grouping structure in the data. We study the selection and estimation properties of the…

Statistics Theory · Mathematics 2010-11-30 Fengrong Wei , Jian Huang

Collected data, which is used for analysis or prediction tasks, often have a hierarchical structure, for example, data from various people performing the same task. Modeling the data's structure can improve the reliability of the derived…

Applications · Statistics 2018-11-12 Dennis Becker

This paper introduces and analyzes a framework that accommodates general heterogeneity in regression modeling. It demonstrates that regression models with fixed or time-varying parameters can be estimated using the OLS and time-varying OLS…

Econometrics · Economics 2025-11-11 Liudas Giraitis , George Kapetanios , Yufei Li , Alexia Ventouri

High-dimensional compositional data are commonplace in the modern omics sciences amongst others. Analysis of compositional data requires a proper choice of orthonormal coordinate representation as their relative nature is not compatible…

Deep neural networks (DNNs) have the potential to power many biomedical workflows, but training them on truly representative, IID datasets is often infeasible. Most models instead rely on biased or incomplete data, making them prone to…

Machine Learning · Computer Science 2025-10-16 Yasith Jayawardana , Dineth Jayakody , Sampath Jayarathna , Dushan N. Wadduwage

Subsampling methods aim to select a subsample as a surrogate for the observed sample. As a powerful technique for large-scale data analysis, various subsampling methods are developed for more effective coefficient estimation and model…

Methodology · Statistics 2021-05-05 Tao Li , Cheng Meng

A new method for analyzing high-dimensional categorical data, Linear Latent Structure (LLS) analysis, is presented. LLS models belong to the family of latent structure models, which are mixture distribution models constrained to satisfy the…

Probability · Mathematics 2007-06-13 Mikhail Kovtun , Igor Akushevich , Kenneth G. Manton , H. Dennis Tolley

High-dimensional classification has become an increasingly important problem. In this paper we propose a "Multivariate Adaptive Stochastic Search" (MASS) approach which first reduces the dimension of the data space and then applies a…

Applications · Statistics 2010-10-08 Tian Siva Tian , Gareth M. James , Rand R. Wilcox

We propose a data segmentation methodology for the high-dimensional linear regression problem where regression parameters are allowed to undergo multiple changes. The proposed methodology, MOSEG, proceeds in two stages: first, the data are…

Methodology · Statistics 2023-11-02 Haeran Cho , Dom Owens

The estimation problem in a high regression model with structured sparsity is investigated. An algorithm using a two steps block thresholding procedure called GR-LOL is provided. Convergence rates are produced: they depend on simple…

Statistics Theory · Mathematics 2012-07-10 Mathilde Mougeot , Dominique Picard , Karine Tribouley

In text classification, the problem of overfitting arises due to the high dimensionality, making regularization essential. Although classic regularizers provide sparsity, they fail to return highly accurate models. On the contrary,…

Machine Learning · Computer Science 2018-10-10 Konstantinos Skianis , Nikolaos Tziortziotis , Michalis Vazirgiannis

In this work we introduce a mixture of GPs to address the data association problem, i.e. to label a group of observations according to the sources that generated them. Unlike several previously proposed GP mixtures, the novel mixture has…

Machine Learning · Statistics 2011-08-18 Miguel Lázaro-Gredilla , Steven Van Vaerenbergh , Neil Lawrence

The analysis of spatial data from biological imaging technology, such as imaging mass spectrometry (IMS) or imaging mass cytometry (IMC), is challenging because of a competitive sampling process which convolves signals from molecules in a…

Machine Learning · Statistics 2025-09-26 Joaquim Valerio Teixeira , Ed Reznik , Sudpito Banerjee , Wesley Tansey