English
Related papers

Related papers: Graph-Fused Multivariate Regression via Total Vari…

200 papers

We propose a calibrated multivariate regression method named CMR for fitting high dimensional multivariate regression models. Compared with existing methods, CMR calibrates regularization for each regression task with respect to its noise…

Machine Learning · Statistics 2017-06-06 Han Liu , Lie Wang , Tuo Zhao

Finite Mixture of Regressions (FMR) models are among the most widely used approaches in dealing with the heterogeneity among the observations in regression problems. One of the limitations of current approaches is their inability to…

Applications · Statistics 2018-06-25 Haidar Almohri , Arash Ali Amini , Ratna Babu Chinnam

Most of the recent results in polynomial functional regression have been focused on an in-depth exploration of single-parameter regularization schemes. In contrast, in this study we go beyond that framework by introducing an algorithm for…

In this paper, we introduce the Generalized Mixed Regularized Reduced Rank Regression model (GMR4), an extension of the GMR3 model designed to improve performance in high-dimensional settings. GMR3 is a regression method for a mix of…

Methodology · Statistics 2025-12-16 Lorenza Cotugno , Mark de Rooij , Roberta Siciliano

An autonomous variational inference algorithm for arbitrary graphical models requires the ability to optimize variational approximations over the space of model parameters as well as over the choice of tractable families used for the…

Machine Learning · Computer Science 2012-07-19 Eric P. Xing , Michael I. Jordan , Stuart Russell

We address regularised versions of the Expectation-Maximisation (EM) algorithm for Generalised Linear Mixed Models (GLMM) in the context of panel data (measured on several individuals at different time-points). A random response y is…

Methodology · Statistics 2019-08-21 Jocelyn Chauvet , Catherine Trottier , Xavier Bry

This paper studies the estimation of high dimensional Gaussian graphical model (GGM). Typically, the existing methods depend on regularization techniques. As a result, it is necessary to choose the regularized parameter. However, the…

Methodology · Statistics 2013-06-06 Weidong Liu

Non-Euclidean data that are indexed with a scalar predictor such as time are increasingly encountered in data applications, while statistical methodology and theory for such random objects are not well developed yet. To address the need for…

Methodology · Statistics 2021-08-24 Zhenhua Lin , Hans-Georg Müller

Undirected graphical models are powerful tools for uncovering complex relationships among high-dimensional variables. This paper aims to fully recover the structure of an undirected graphical model when the data naturally take matrix form,…

Methodology · Statistics 2025-08-08 Minsub Shin , Johan Lim , Seongoh Park

This work presents a novel general regularized distributed solution for the state estimation problem in networked systems. Resting on the graph-based representation of sensor networks and adopting a multivariate least-squares approach, the…

Systems and Control · Electrical Eng. & Systems 2021-11-17 Marco Fabris , Giulia Michieletto , Angelo Cenedese

We consider distributed estimation of the inverse covariance matrix, also called the concentration or precision matrix, in Gaussian graphical models. Traditional centralized estimation often requires global inference of the covariance…

Machine Learning · Statistics 2015-06-15 Zhaoshi Meng , Dennis Wei , Ami Wiesel , Alfred O. Hero

We propose an approach for fitting linear regression models that splits the set of covariates into groups. The optimal split of the variables into groups and the regularized estimation of the regression coefficients are performed by…

Methodology · Statistics 2019-12-13 Anthony Christidis , Ruben Zamar , Laks V. S. Lakshmanan , Ezequiel Smucler

Graph Neural Networks (GNNs) and their message passing framework that leverages both structural and feature information, have become a standard method for solving graph-based machine learning problems. However, these approaches still…

Machine Learning · Computer Science 2024-11-20 Simon Delarue , Thomas Bonald , Tiphaine Viard

Rank regression offers robustness to outliers and heavy-tailed response distributions, invariance to monotonic transformations, and improved efficiency under non-Gaussian errors, making it a versatile tool for analyzing complex data. This…

Methodology · Statistics 2026-05-25 Jiyuan Tu , Suqi Wu , Yichen Zhang , Wen-Xin Zhou

Co-administration of two or more drugs simultaneously can result in adverse drug reactions. Identifying drug-drug interactions (DDIs) is necessary, especially for drug development and for repurposing old drugs. DDI prediction can be viewed…

Quantitative Methods · Quantitative Biology 2022-10-21 Stuti Jain , Emilie Chouzenoux , Kriti Kumar , Angshul Majumdar

Factorization machine (FM) is a prevalent approach to modeling pairwise (second-order) feature interactions when dealing with high-dimensional sparse data. However, on the one hand, FM fails to capture higher-order feature interactions…

Machine Learning · Computer Science 2025-02-24 Shu Wu , Zekun Li , Yunyue Su , Zeyu Cui , Xiaoyu Zhang , Liang Wang

Spatiotemporal matrix-valued data arise frequently in modern applications, yet performing effective regression analysis remains challenging due to complex, dimension-specific dependencies. In this work, we propose a regularized framework…

Optimization and Control · Mathematics 2026-02-17 Meixia Lin , Ziyang Zeng , Yangjing Zhang

We propose graph-based predictable feature analysis (GPFA), a new method for unsupervised learning of predictable features from high-dimensional time series, where high predictability is understood very generically as low variance in the…

Machine Learning · Computer Science 2017-05-12 Björn Weghenkel , Asja Fischer , Laurenz Wiskott

Hyperspectral analysis has gained popularity over recent years as a way to infer what materials are displayed on a picture whose pixels consist of a mixture of spectral signatures. Computing both signatures and mixture coefficients is known…

Optimization and Control · Mathematics 2017-06-29 Adrien Faivre , Clément Dombry

Regularization has become a primary tool for developing reliable estimators of the covariance matrix in high-dimensional settings. To curb the curse of dimensionality, numerous methods assume that the population covariance (or inverse…

Methodology · Statistics 2018-02-19 Jacob Bien