English
Related papers

Related papers: Joint modeling and inference of multiple-subject h…

200 papers

We present the framework of slowly varying regression under sparsity, allowing sparse regression models to exhibit slow and sparse variations. The problem of parameter estimation is formulated as a mixed-integer optimization problem. We…

Machine Learning · Computer Science 2023-11-14 Dimitris Bertsimas , Vassilis Digalakis , Michael Linghzi Li , Omar Skali Lami

Granger causal modeling is an emerging topic that can uncover Granger causal relationship behind multivariate time series data. In many real-world systems, it is common to encounter a large amount of multivariate time series data collected…

Machine Learning · Computer Science 2021-02-11 Yunfei Chu , Xiaowei Wang , Jianxin Ma , Kunyang Jia , Jingren Zhou , Hongxia Yang

Homogeneity, low rank, and sparsity are three widely adopted assumptions in multi-response regression models to address the curse of dimensionality and improve estimation accuracy. However, there is limited literature that examines these…

Methodology · Statistics 2025-01-28 Ruipeng Dong , Ganggang Xu , Yongtao Guan

Multi-task learning is frequently used to model a set of related response variables from the same set of features, improving predictive performance and modeling accuracy relative to methods that handle each response variable separately.…

Methodology · Statistics 2023-08-11 Snigdha Panigrahi , Natasha Stewart , Chandra Sekhar Sripada , Elizaveta Levina

Multivariate categorical data occur in many applications of machine learning. One of the main difficulties with these vectors of categorical variables is sparsity. The number of possible observations grows exponentially with vector length,…

Machine Learning · Statistics 2015-03-10 Yarin Gal , Yutian Chen , Zoubin Ghahramani

In this paper we propose a heterogeneous modeling framework which achieves individual-wise feature selection and individualized covariates' effects subgrouping simultaneously. In contrast to conventional model selection approaches, the new…

Methodology · Statistics 2019-06-11 Xiwei Tang , Fei Xue , Annie Qu

Assuming stationarity is unrealistic in many time series applications. A more realistic alternative is to allow for piecewise stationarity, where the model is allowed to change at given time points. We propose a three-stage procedure for…

Methodology · Statistics 2018-05-31 Abolfazl Safikhani , Ali Shojaie

A factor-augmented vector autoregressive (FAVAR) model is defined by a VAR equation that captures lead-lag correlations amongst a set of observed variables $X$ and latent factors $F$, and a calibration equation that relates another set of…

Methodology · Statistics 2020-06-02 Jiahe Lin , George Michailidis

Radiogenomics is an emerging field in cancer research that combines medical imaging data with genomic data to predict patients clinical outcomes. In this paper, we propose a multivariate sparse group lasso joint model to integrate imaging…

Methodology · Statistics 2022-06-06 Tiantian Zeng , Md Selim , Jie Zhang , Arnold Stromberg , Jin Chen , Chi Wang

Spatial dependent data frequently occur in many fields such as spatial econometrics and epidemiology. To deal with the dependence of variables and estimate quantile-specific effects by covariates, spatial quantile autoregressive models…

Methodology · Statistics 2021-11-16 Ping Dong , Jiawei Hou , Yunquan Song

It is an important task to model realized volatilities for high-frequency data in finance and economics and, as arguably the most popular model, the heterogeneous autoregressive (HAR) model has dominated the applications in this area.…

Methodology · Statistics 2023-03-07 Huiling Yuan , Kexin Lu , Yifeng Guo , Guodong Li

For statistical analysis of network data, the $\beta$-model has emerged as a useful tool, thanks to its flexibility in incorporating nodewise heterogeneity and theoretical tractability. To generalize the $\beta$-model, this paper proposes…

Statistics Theory · Mathematics 2024-10-01 Stefan Stein , Rui Feng , Chenlei Leng

We study the problem of estimating multiple linear regression equations for the purpose of both prediction and variable selection. Following recent work on multi-task learning Argyriou et al. [2008], we assume that the regression vectors…

Machine Learning · Statistics 2012-08-21 Karim Lounici , Massimiliano Pontil , Alexandre B. Tsybakov , Sara van de Geer

This paper develops a new empirical Bayesian inference algorithm for solving a linear inverse problem given multiple measurement vectors (MMV) of under-sampled and noisy observable data. Specifically, by exploiting the joint sparsity across…

Numerical Analysis · Mathematics 2021-03-30 Jiahui Zhang , Anne Gelb , Theresa Scarnati

How to estimate heterogeneity, e.g. the effect of some variable differing across observations, is a key question in political science. Methods for doing so make simplifying assumptions about the underlying nature of the heterogeneity to…

Methodology · Statistics 2021-03-31 Max Goplerud

While visual autoregressive modeling (VAR) strategies have shed light on image generation with the autoregressive models, their potential for segmentation, a task that requires precise low-level spatial perception, remains unexplored.…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Rongkun Zheng , Lu Qi , Xi Chen , Yi Wang , Kun Wang , Hengshuang Zhao

Sparse additive models have attracted much attention in high-dimensional data analysis due to their flexible representation and strong interpretability. However, most existing models are limited to single-level learning under the…

Machine Learning · Computer Science 2026-04-23 Xuelin Zhang , Xinyue Liu , Lingjuan Wu , Hong Chen

Multi-output regression models must exploit dependencies between outputs to maximise predictive performance. The application of Gaussian processes (GPs) to this setting typically yields models that are computationally demanding and have…

Machine Learning · Statistics 2019-02-27 James Requeima , Will Tebbutt , Wessel Bruinsma , Richard E. Turner

Studies often estimate associations between an outcome and multiple variates. For example, studies of diagnostic test accuracy estimate sensitivity and specificity, and studies of predictive and prognostic factors typically estimate…

In this paper, we propose Varying Effects Regression with Graph Estimation (VERGE), a novel Bayesian method for feature selection in regression. Our model has key aspects that allow it to leverage the complex structure of data sets arising…

Methodology · Statistics 2024-10-10 Yangfan Ren , Christine B. Peterson , Marina Vannucci