中文
相关论文

相关论文: Sparse K-Means with $\ell_{\infty}/\ell_0$ Penalty…

200 篇论文

Clustering is one of the most fundamental tools in data science and machine learning, and k-means clustering is one of the most common such methods. There is a variety of approximate algorithms for the k-means problem, but computing the…

最优化与控制 · 数学 2024-02-22 Martin Ryner , Jan Kronqvist , Johan Karlsson

This work addresses the robust reconstruction problem of a sparse signal from compressed measurements. We propose a robust formulation for sparse reconstruction which employs the $\ell_1$-norm as the loss function for the residual error and…

信息论 · 计算机科学 2017-03-30 Fei Wen , Yuan Yang , Ling Pei , Wenxian Yu , Peilin Liu

We consider a discrete optimization formulation for learning sparse classifiers, where the outcome depends upon a linear combination of a small subset of features. Recent work has shown that mixed integer programming (MIP) can be used to…

机器学习 · 统计学 2021-06-08 Antoine Dedieu , Hussein Hazimeh , Rahul Mazumder

We consider a general class of constrained optimization problems with an additional $\ell_0$- sparsity term in the objective function. Based on a recent reformulation of this difficult $\ell_0$-term, we consider a nonsmooth penalty approach…

最优化与控制 · 数学 2025-09-04 Christian Kanzow , Felix Weiß

Sparse manifold learning algorithms combine techniques in manifold learning and sparse optimization to learn features that could be utilized for downstream tasks. The standard setting of compressive sensing can not be immediately applied to…

信号处理 · 电气工程与系统科学 2024-08-05 Abiy Tasissa , Pranay Tankala , Demba Ba

The main contribution of the paper is a new approach to subspace clustering that is significantly more computationally efficient and scalable than existing state-of-the-art methods. The central idea is to modify the regression technique in…

机器学习 · 统计学 2018-07-11 Urvashi Oswal , Robert Nowak

The fairness of clustering algorithms has gained widespread attention across various areas, including machine learning, In this paper, we study fair $k$-means clustering in Euclidean space. Given a dataset comprising several groups, the…

机器学习 · 计算机科学 2024-12-10 Shihong Song , Guanlin Mo , Qingyuan Yang , Hu Ding

This paper considers $k$-means clustering in the presence of noise. It is known that $k$-means clustering is highly sensitive to noise, and thus noise should be removed to obtain a quality solution. A popular formulation of this problem is…

数据结构与算法 · 计算机科学 2020-04-14 Sungjin Im , Mahshid Montazer Qaem , Benjamin Moseley , Xiaorui Sun , Rudy Zhou

Understanding treatment effect heterogeneity is vital for scientific and policy research. However, identifying and evaluating heterogeneous treatment effects pose significant challenges due to the typically unknown subgroup structure.…

统计方法学 · 统计学 2024-11-05 Kwangho Kim , Jisu Kim , Larry A. Wasserman , Edward H. Kennedy

Performing signal processing tasks on compressive measurements of data has received great attention in recent years. In this paper, we extend previous work on compressive dictionary learning by showing that more general random projections…

机器学习 · 统计学 2015-04-07 Farhad Pourkamali-Anaraki , Stephen Becker , Shannon M. Hughes

Density peaks clustering has become a nova of clustering algorithm because of its simplicity and practicality. However, there is one main drawback: it is time-consuming due to its high computational complexity. Herein, a density peaks…

机器学习 · 统计学 2022-07-21 Yunxiao Shan , Shu Li , Fuxiang Li , Yuxin Cui , Shuai Li , Ming Zhou , Xiang Li

The $\ell_1$ norm is the tight convex relaxation for the $\ell_0$ "norm" and has been successfully applied for recovering sparse signals. For problems with fewer samplings, one needs to enhance the sparsity by nonconvex penalties such as…

最优化与控制 · 数学 2016-01-05 Xiaolin Huang , Lei Shi , Ming Yan

The popular K-means clustering algorithm potentially suffers from a major weakness for further analysis or interpretation. Some cluster may have disproportionately more (or fewer) points from one of the subpopulations in terms of some…

机器学习 · 计算机科学 2026-02-10 Guancheng Zhou , Haiping Xu , Hongkang Xu , Chenyu Li , Donghui Yan

High-dimensional data often lie in low-dimensional subspaces corresponding to different classes they belong to. Finding sparse representations of data points in a dictionary built using the collection of data helps to uncover…

机器学习 · 统计学 2016-02-16 Ehsan Elhamifar , Mahdi Soltanolkotabi , Shankar Sastry

Simultaneous feature selection and non-linear function estimation is challenging in modeling, especially in high-dimensional settings where the number of variables exceeds the available sample size. In this article, we investigate the…

机器学习 · 统计学 2026-01-05 Bin Luo , Susan Halabi

Clustering and estimating cluster means are core problems in statistics and machine learning, with k-means and Expectation Maximization (EM) being two widely used algorithms. In this work, we provide a theoretical explanation for the…

机器学习 · 统计学 2025-06-19 David Silva-Sánchez , Roy R. Lederman

Sparse representation learning has recently gained a great success in signal and image processing, thanks to recent advances in dictionary learning. To this end, the $\ell_0$-norm is often used to control the sparsity level. Nevertheless,…

计算机视觉与模式识别 · 计算机科学 2017-09-19 Yuan Liu , Stéphane Canu , Paul Honeine , Su Ruan

Subspace clustering methods based on $\ell_1$, $\ell_2$ or nuclear norm regularization have become very popular due to their simplicity, theoretical guarantees and empirical success. However, the choice of the regularizer can greatly impact…

计算机视觉与模式识别 · 计算机科学 2016-05-09 Chong You , Daniel P. Robinson , Rene Vidal

In general, the clustering problem is NP-hard, and global optimality cannot be established for non-trivial instances. For high-dimensional data, distance-based methods for clustering or classification face an additional difficulty, the…

统计理论 · 数学 2016-04-26 Tsvetan Asamov , Adi Ben-Israel

The learning of mixture models can be viewed as a clustering problem. Indeed, given data samples independently generated from a mixture of distributions, we often would like to find the {\it correct target clustering} of the samples…

机器学习 · 统计学 2022-08-26 Zhaoqiang Liu , Vincent Y. F. Tan