English
Related papers

Related papers: A sequential stepwise screening procedure for spar…

200 papers

Screening is the problem of finding a superset of the set of non-zero entries in an unknown p-dimensional vector \beta* given n noisy observations. Naturally, we want this superset to be as small as possible. We propose a novel framework…

Machine Learning · Statistics 2016-11-18 Divyanshu Vats

We propose a general, modular method for significance testing of groups (or clusters) of variables in a high-dimensional linear model. In presence of high correlations among the covariables, due to serious problems of identifiability, it is…

Statistics Theory · Mathematics 2015-02-12 Jacopo Mandozzi , Peter Bühlmann

Corrupted data sets containing noisy or missing observations are prevalent in various contemporary applications such as economics, finance and bioinformatics. Despite the recent methodological and algorithmic advances in high-dimensional…

Methodology · Statistics 2020-05-12 J. Wu , Z. Zheng , Y. Li , Y. Zhang

The group lasso is a penalized regression method, used in regression problems where the covariates are partitioned into groups to promote sparsity at the group level. Existing methods for finding the group lasso estimator either use…

Machine Learning · Statistics 2010-11-12 Rina Foygel , Mathias Drton

Finding patient subgroups with similar characteristics is crucial for personalized decision-making in various disciplines such as healthcare and policy evaluation. While most existing approaches rely on unsupervised clustering methods,…

Machine Learning · Statistics 2026-03-06 Luwei Wang , Nazir Lone , Sohan Seth

This paper begins with considering the identification of sparse linear time-invariant networks described by multivariable ARX models. Such models possess relatively simple structure thus used as a benchmark to promote further research. With…

Systems and Control · Computer Science 2016-10-03 J. Jin , Y. Yuan , W. Pan , D. L. T. Pham , C. J. Tomlin , A. Webb , J. Goncalves

As we aim at alleviating the curse of high-dimensionality, subspace learning is becoming more popular. Existing approaches use either information about global or local structure of the data, and few studies simultaneously focus on global…

Machine Learning · Computer Science 2015-10-20 Nan Zhou , Yangyang Xu , Hong Cheng , Jun Fang , Witold Pedrycz

We propose a general algorithmic framework for Bayesian model selection. A spike-and-slab Laplacian prior is introduced to model the underlying structural assumption. Using the notion of effective resistance, we derive an EM-type algorithm…

Methodology · Statistics 2020-06-19 Youngseok Kim , Chao Gao

I consider unsupervised extensions of the fast stepwise linear regression algorithm \cite{efroymson1960multiple}. These extensions allow one to efficiently identify highly-representative feature variable subsets within a given set of…

Machine Learning · Computer Science 2017-06-13 Jonathan Landy

We propose a method to reconstruct and cluster incomplete high-dimensional data lying in a union of low-dimensional subspaces. Exploring the sparse representation model, we jointly estimate the missing data while imposing the intrinsic…

Computer Vision and Pattern Recognition · Computer Science 2017-09-06 João Carvalho , Manuel Marques , João P. Costeira

Time series segmentation, a.k.a. multiple change-point detection, is a well-established problem. However, few solutions are designed specifically for high-dimensional situations. In this paper, our interest is in segmenting the second-order…

Methodology · Statistics 2016-11-29 Haeran Cho , Piotr Fryzlewicz

Stochastic Optimization is a cornerstone of operations research, providing a framework to solve optimization problems under uncertainty. Despite the development of numerous algorithms to tackle these problems, several persistent challenges…

Optimization and Control · Mathematics 2025-03-28 Di Zhang , Suvrajeet Sen

We consider the problem of learning a sparse rule model, a prediction model in the form of a sparse linear combination of rules, where a rule is an indicator function defined over a hyper-rectangle in the input space. Since the number of…

Machine Learning · Statistics 2025-03-13 Hiroki Kato , Hiroyuki Hanada , Ichiro Takeuchi

We propose an effective subspace selection scheme as a post-processing step to improve results obtained by sparse subspace clustering (SSC). Our method starts by the computation of stable subspaces using a novel random sampling scheme. Thus…

Computer Vision and Pattern Recognition · Computer Science 2016-05-30 Duc-Son Pham , Ognjen Arandjelovic , Svetha Venkatesh

Model selection is an indispensable part of data analysis dealing very frequently with fitting and prediction purposes. In this paper, we tackle the problem of model selection in a general linear regression where the parameter matrix…

Signal Processing · Electrical Eng. & Systems 2022-09-19 Prakash B. Gohain , Magnus Jansson

A key question in causal inference analyses is how to find subgroups with elevated treatment effects. This paper takes a machine learning approach and introduces a generative model, Causal Rule Sets (CRS), for interpretable subgroup…

Artificial Intelligence · Computer Science 2021-05-21 Tong Wang , Cynthia Rudin

We consider the problem of recovering block-sparse signals whose structures are unknown \emph{a priori}. Block-sparse signals with nonzero coefficients occurring in clusters arise naturally in many practical scenarios. However, the…

Information Theory · Computer Science 2013-11-12 Jun Fang , Yanning Shen , Hongbin Li , Pu Wang

Motivation: Recent advances in technology for brain imaging and high-throughput genotyping have motivated studies examining the influence of genetic variation on brain structure. Wang et al. (Bioinformatics, 2012) have developed an approach…

Methodology · Statistics 2016-10-18 Keelin Greenlaw , Elena Szefer , Jinko Graham , Mary Lesperance , Farouk S. Nathoo

Simultaneous feature selection and non-linear function estimation is challenging in modeling, especially in high-dimensional settings where the number of variables exceeds the available sample size. In this article, we investigate the…

Machine Learning · Statistics 2026-01-05 Bin Luo , Susan Halabi

This study proposes a new framework to evolve efficacious yet parsimonious neural architectures for the movement prediction of stock market indices using technical indicators as inputs. In the light of a sparse signal-to-noise ratio under…

Neural and Evolutionary Computing · Computer Science 2021-11-17 Faizal Hafiz , Jan Broekaert , Davide La Torre , Akshya Swain