English
Related papers

Related papers: KOO Method-based Consistent Clustering for Group-w…

200 papers

In this paper, we introduce Adaptive Cluster Lasso(ACL) method for variable selection in high dimensional sparse regression models with strongly correlated variables. To handle correlated variables, the concept of clustering or grouping…

Machine Learning · Statistics 2016-03-14 Niharika Gauraha , Swapan K. Parui

Leave-one-out (LOO) prediction provides a principled, data-dependent measure of generalization, yet guarantees in fully transductive settings remain poorly understood beyond specialized models. We introduce Median of Level-Set Aggregation…

Machine Learning · Computer Science 2026-03-03 Jian Qian , Jiachen Xu

We extend the knockoffs method for selecting predictors to clustered data (cross-sectional or repeated measures). In the setting of clustered data, variable selection is complex because some predictors are measured at the observation level…

Methodology · Statistics 2026-02-24 Silvia Bacci , Leonardo Grilli , Carla Rampichini

This paper explores the problem of clustering ensemble, which aims to combine multiple base clusterings to produce better performance than that of the individual one. The existing clustering ensemble methods generally construct a…

Machine Learning · Computer Science 2020-12-17 Yuheng Jia , Hui Liu , Junhui Hou , Qingfu Zhang

Model inference, such as model comparison, model checking, and model selection, is an important part of model development. Leave-one-out cross-validation (LOO) is a general approach for assessing the generalizability of a model, but…

Machine Learning · Statistics 2020-08-12 Måns Magnusson , Michael Riis Andersen , Johan Jonasson , Aki Vehtari

The goal of co-clustering is to simultaneously identify a clustering of rows as well as columns of a two dimensional data matrix. A number of co-clustering techniques have been proposed including information-theoretic co-clustering and the…

Machine Learning · Computer Science 2020-04-27 Joyce Jiyoung Whang , Inderjit S. Dhillon

The LASSO is an attractive regularisation method for linear regression that combines variable selection with an efficient computation procedure. This paper is concerned with enhancing the performance of LASSO for square-free hierarchical…

Methodology · Statistics 2023-05-10 Shaoxiong Hu , Hugo Maruri-Aguliar , Zixiang Ma

Four-variable-independent-regression localization losses, such as Smooth-$\ell_1$ Loss, are used by default in modern detectors. Nevertheless, this kind of loss is oversimplified so that it is inconsistent with the final evaluation metric,…

Computer Vision and Pattern Recognition · Computer Science 2021-12-06 Hanyang Peng , Shiqi Yu

We consider the problem of learning a high-dimensional multi-task regression model, under sparsity constraints induced by presence of grouping structures on the input covariates and on the output predictors. This problem is primarily…

Machine Learning · Statistics 2012-05-10 Seunghak Lee , Eric P. Xing

Aggregated hold-out (Agghoo) is a method which averages learning rules selected by hold-out (that is, cross-validation with a single split). We provide the first theoretical guarantees on Agghoo, ensuring that it can be used safely: Agghoo…

Statistics Theory · Mathematics 2020-01-22 Guillaume Maillard , Sylvain Arlot , Matthieu Lerasle

Lasso is a popular and efficient approach to simultaneous estimation and variable selection in high-dimensional regression models. In this paper, a robust LAD-lasso method for multiple outcomes is presented that addresses the challenges of…

Methodology · Statistics 2022-12-02 Jyrki Möttönen , Tero Lähderanta , Janne Salonen , Mikko J. Sillanpää

In this article, we propose a novel strategy for conducting variable selection without prior model topology knowledge using the knockoff method with boosted tree models. Our method is inspired by the original knockoff method, where the…

Methodology · Statistics 2020-02-24 Tao Jiang , Yuanyuan Li , Alison A. Motsinger-Reif

An ensemble technique is characterized by the mechanism that generates the components and by the mechanism that combines them. A common way to achieve the consensus is to enable each component to equally participate in the aggregation…

Machine Learning · Computer Science 2018-04-18 Hamed Sarvari , Carlotta Domeniconi , Giovanni Stilo

The estimation problem in a high regression model with structured sparsity is investigated. An algorithm using a two steps block thresholding procedure called GR-LOL is provided. Convergence rates are produced: they depend on simple…

Statistics Theory · Mathematics 2012-07-10 Mathilde Mougeot , Dominique Picard , Karine Tribouley

This paper introduces a novel approach of clustering, which is based on group consensus of dynamic linear high-order multi-agent systems. The graph topology is associated with a selected multi-agent system, with each agent corresponding to…

Systems and Control · Computer Science 2017-06-13 Ning Cai , Chen Diao , M. Junaid Khan

We consider the problem of estimating a sparse multi-response regression function, with an application to expression quantitative trait locus (eQTL) mapping, where the goal is to discover genetic variations that influence gene-expression…

Machine Learning · Statistics 2012-10-01 Seyoung Kim , Eric P. Xing

The paper tackles the problem of clustering multiple networks, directed or not, that do not share the same set of vertices, into groups of networks with similar topology. A statistical model-based approach based on a finite mixture of…

Statistics Theory · Mathematics 2023-11-07 Tabea Rebafka

In the leader-follower approach, one or more agents are selected as leaders who do not change their states or have autonomous dynamics and can influence other agents, while the other agents, called followers, perform a simple protocol based…

Optimization and Control · Mathematics 2019-12-03 Natalia Basimova , Pavel Chebotarev

In real-world application scenarios, the identification of groups poses a significant challenge due to possibly occurring outliers and existing noise variables. Therefore, there is a need for a clustering method which is capable of…

Selecting compact and informative gene subsets from single-cell transcriptomic data is essential for biomarker discovery, improving interpretability, and cost-effective profiling. However, most existing feature selection approaches either…

Machine Learning · Computer Science 2025-12-22 Daphné Chopard , Jorge da Silva Gonçalves , Irene Cannistraci , Thomas M. Sutter , Julia E. Vogt