English
Related papers

Related papers: Sparse Group Fused Lasso for Model Segmentation

200 papers

Federated learning (FL) enables collaborative model training across multiple parties without sharing raw data, with semi-asynchronous FL (SAFL) emerging as a balanced approach between synchronous and asynchronous FL. However, SAFL faces…

Machine Learning · Computer Science 2025-11-26 Yunbo Li , Jiaping Gui , Zhihang Deng , Fanchao Meng , Yue Wu

We propose a new method of learning a sparse nonnegative-definite target matrix. Our primary example of the target matrix is the inverse of a population covariance or correlation matrix. The algorithm first estimates each column of the…

Statistics Theory · Mathematics 2013-10-15 Tingni Sun , Cun-Hui Zhang

A novel Gaussian mixture model (GMM) aided sparse Bayesian learning (SBL) framework is proposed for channel state information (CSI) estimation in orthogonal time-frequency space (OTFS) modulated systems. The key attribute of the proposed…

Signal Processing · Electrical Eng. & Systems 2026-03-31 Surbhi Gehlot , Suraj Srivastava , Sandeep Kumar Yadav , Lajos Hanzo

Federated learning client selection is crucial for determining participant clients while balancing model accuracy and communication efficiency. Existing methods have limitations in handling data heterogeneity, computational burdens, and…

Machine Learning · Computer Science 2024-05-28 Shijie Na , Yuzhi Liang , Siu-Ming Yiu

Federated Learning (FL) is a promising paradigm for realizing edge intelligence, allowing collaborative learning among distributed edge devices by sharing models instead of raw data. However, the shared models are often assumed to be ideal,…

Machine Learning · Computer Science 2025-06-02 Dongzi Jin , Yong Xiao , Yingyu Li

Federated learning (FL) and federated distillation (FD) are distributed learning paradigms that train UE models with enhanced privacy, each offering different trade-offs between noise robustness and learning speed. To mitigate their…

Machine Learning · Computer Science 2026-01-09 Yongjun Kim , Hyeongjun Park , Hwanjin Kim , Junil Choi

We present a novel approach to the formulation and the resolution of sparse Linear Discriminant Analysis (LDA). Our proposal, is based on penalized Optimal Scoring. It has an exact equivalence with penalized LDA, contrary to the multi-class…

Machine Learning · Computer Science 2012-07-03 Luis Francisco Sanchez Merchante , Yves Grandvalet , Gerrad Govaert

Sparse linear regression is a central problem in high-dimensional statistics. We study the correlated random design setting, where the covariates are drawn from a multivariate Gaussian $N(0,\Sigma)$, and we seek an estimator with small…

Data Structures and Algorithms · Computer Science 2023-05-29 Jonathan Kelner , Frederic Koehler , Raghu Meka , Dhruv Rohatgi

This paper considers the problem of recovering a group sparse signal matrix $\mathbf{Y} = [\mathbf{y}_1, \cdots, \mathbf{y}_L]$ from sparsely corrupted measurements $\mathbf{M} = [\mathbf{A}_{(1)}\mathbf{y}_{1}, \cdots,…

Information Theory · Computer Science 2016-06-14 Xiaohan Wei , Qing Ling , Zhu Han

The additive partially linear model (APLM) combines the flexibility of nonparametric regression with the parsimony of regression models, and has been widely used as a popular tool in multivariate nonparametric regression to alleviate the…

Methodology · Statistics 2019-03-19 Xinyi Li , Li Wang , Dan Nettleton

Regularized regression problems are ubiquitous in statistical modeling, signal processing, and machine learning. Sparse regression in particular has been instrumental in scientific model discovery, including compressed sensing applications,…

Machine Learning · Statistics 2018-11-09 Peng Zheng , Travis Askham , Steven L. Brunton , J. Nathan Kutz , Aleksandr Y. Aravkin

Convex optimization is an essential tool for modern data analysis, as it provides a framework to formulate and solve many problems in machine learning and data mining. However, general convex optimization solvers do not scale well, and…

Social and Information Networks · Computer Science 2015-07-02 David Hallac , Jure Leskovec , Stephen Boyd

Federated learning (FL) enables multiple devices to collaboratively train a global model while maintaining data on local servers. Each device trains the model on its local server and shares only the model updates (i.e., gradient weights)…

Machine Learning · Computer Science 2024-12-31 Nishant S. Gaikwad , Lucas Heublein , Nisha L. Raichur , Tobias Feigl , Christopher Mutschler , Felix Ott

Sparse Partial Least Squares (sPLS) is a common dimensionality reduction technique for data fusion, which projects data samples from two views by seeking linear combinations with a small number of variables with the maximum variance.…

Machine Learning · Computer Science 2023-08-15 Wenwen Min , Taosheng Xu , Chris Ding

This paper provides a statistical analysis of high-dimensional batch Reinforcement Learning (RL) using sparse linear function approximation. When there is a large number of candidate features, our result sheds light on the fact that…

Machine Learning · Computer Science 2020-11-10 Botao Hao , Yaqi Duan , Tor Lattimore , Csaba Szepesvári , Mengdi Wang

This article proposes diffusion LMS strategies for distributed estimation over adaptive networks that are able to exploit sparsity in the underlying system model. The approach relies on convex regularization, common in compressive sensing,…

Machine Learning · Computer Science 2015-06-05 Paolo Di Lorenzo , Ali H. Sayed

Selective inference methods are developed for group lasso estimators for use with a wide class of distributions and loss functions. The method includes the use of exponential family distributions, as well as quasi-likelihood modeling for…

Methodology · Statistics 2024-03-28 Yiling Huang , Sarah Pirenne , Snigdha Panigrahi , Gerda Claeskens

There are situations where data relevant to machine learning problems are distributed across multiple locations that cannot share the data due to regulatory, competitiveness, or privacy reasons. Machine learning approaches that require data…

Machine Learning · Computer Science 2022-06-28 Dimitris Stripelis , Jose Luis Ambite

High-quality digital terrain models derived from airborne laser scanning (ALS) data are essential for a wide range of geospatial analyses, and their generation typically relies on robust ground filtering (GF) to separate point clouds across…

Computer Vision and Pattern Recognition · Computer Science 2026-04-24 Nannan Qin , Pengjie Tao , Haiyan Guan , Zhizhong Kang , Lingfei Ma , Xiangyun Hu , Jonathan Li

We develop tools for selective inference in the setting of group sparsity, including the construction of confidence intervals and p-values for testing selected groups of variables. Our main technical result gives the precise distribution of…

Methodology · Statistics 2016-07-28 Fan Yang , Rina Foygel Barber , Prateek Jain , John Lafferty