English
Related papers

Related papers: Fused Lasso Additive Model

200 papers

Personalized federated learning (PFL) is an approach proposed to address the issue of poor convergence on heterogeneous data. However, most existing PFL frameworks require strong assumptions for convergence. In this paper, we propose an…

Machine Learning · Computer Science 2024-08-23 Shengkun Zhu , Jinshan Zeng , Sheng Wang , Yuan Sun , Zhiyong Peng

Estimation of a precision matrix (i.e., inverse covariance matrix) is widely used to exploit conditional independence among continuous variables. The influence of abnormal observations is exacerbated in a high dimensional setting as the…

Methodology · Statistics 2021-05-17 Peng Tang , Huijing Jiang , Heeyoung Kim , Xinwei Deng

This paper is concerned with inference on the regression function of a high-dimensional linear model when outcomes are missing at random. We propose an estimator which combines a Lasso pilot estimate of the regression function with a bias…

Methodology · Statistics 2024-12-11 Yikun Zhang , Alexander Giessing , Yen-Chi Chen

Analysis of state-of-the-art VO/VSLAM system exposes a gap in balancing performance (accuracy & robustness) and efficiency (latency). Feature-based systems exhibit good performance, yet have higher latency due to explicit data association;…

Robotics · Computer Science 2020-01-06 Yipu Zhao , Patricio A. Vela

Consider the case that we observe $n$ independent and identically distributed copies of a random variable with a probability distribution known to be an element of a specified statistical model. We are interested in estimating an infinite…

Statistics Theory · Mathematics 2017-09-20 Mark J. van der Laan , Aurélien F. Bibaut

In an ordinary feature selection procedure, a set of important features is obtained by solving an optimization problem such as the Lasso regression problem, and we expect that the obtained features explain the data well. In this study,…

Machine Learning · Statistics 2018-10-16 Satoshi Hara , Takanori Maehara

In machine learning and data mining, linear models have been widely used to model the response as parametric linear functions of the predictors. To relax such stringent assumptions made by parametric linear models, additive models consider…

Machine Learning · Statistics 2017-10-18 Sheng Chen , Arindam Banerjee

A novel approach to quantile estimation in multivariate linear regression models with change-points is proposed: the change-point detection and the model estimation are both performed automatically, by adopting either the quantile fused…

Statistics Theory · Mathematics 2019-04-10 Gabriela Ciuperca , Matus Maciak

Inferring network structures remains an interesting question for its importance on the understanding and controlling collective dynamics of complex systems. The existing shrinking methods such as Lasso-type estimation can not suitably…

Statistics Theory · Mathematics 2025-09-03 Lei Shi , Jie Hu , Huaiyu Tan , Libin Jin , Wei Zhong , Chen Shen

As a prevalent distributed learning paradigm, Federated Learning (FL) trains a global model on a massive amount of devices with infrequent communication. This paper investigates a class of composite optimization and statistical recovery…

Machine Learning · Computer Science 2022-10-04 Yajie Bao , Michael Crawshaw , Shan Luo , Mingrui Liu

This article describes a full Bayesian treatment for simultaneous fixed-effect selection and parameter estimation in high-dimensional generalized linear mixed models. The approach consists of using a Bayesian adaptive Lasso penalty for…

Methodology · Statistics 2016-08-31 Dao Thanh Tung , Minh-Ngoc Tran , Tran Manh Cuong

We propose a novel framework for fitting additive quantile regression models, which provides well calibrated inference about the conditional quantiles and fast automatic estimation of the smoothing parameters, for model structures as…

Methodology · Statistics 2020-03-13 M. Fasiolo , S. N. Wood , M. Zaffran , R. Nedellec , Y. Goude

We propose a computational framework named iterative local adaptive majorize-minimization (I-LAMM) to simultaneously control algorithmic complexity and statistical error when fitting high dimensional models. I-LAMM is a two-stage…

Statistics Theory · Mathematics 2017-04-06 Jianqing Fan , Han Liu , Qiang Sun , Tong Zhang

Nonlinear relationships between covariates and a response variable of interest are frequently encountered in animal science research. Within statistical models, these nonlinear effects have, traditionally, been handled using a range of…

Applications · Statistics 2025-10-28 Gavin L. Simpson

It is well-known that the statistical performance of Lasso can suffer significantly when the covariates of interest have strong correlations. In particular, the prediction error of Lasso becomes much worse than computationally inefficient…

Machine Learning · Statistics 2024-02-26 Jonathan Kelner , Frederic Koehler , Raghu Meka , Dhruv Rohatgi

We suggest an adaptive version of a partial linearization method for composite optimization problems. The goal function is the sum of a smooth function and a non necessary smooth convex separable function, whereas the feasible set is the…

Optimization and Control · Mathematics 2016-05-26 I. V. Konnov

Additive models form a widely popular class of regression models which represent the relation between covariates and response variables as the sum of low-dimensional transfer functions. Besides flexibility and accuracy, a key benefit of…

Machine Learning · Statistics 2015-05-20 Alhussein Fawzi , Mathieu Sinn , Pascal Frossard

We propose the Factor Augmented sparse linear Regression Model (FARM) that not only encompasses both the latent factor regression and sparse linear regression as special cases but also bridges dimension reduction and sparse regression…

Methodology · Statistics 2022-03-03 Jianqing Fan , Zhipeng Lou , Mengxin Yu

This paper contributes to the literature on treatment effects estimation with machine learning inspired methods by studying the performance of different estimators based on the Lasso. Building on recent work in the field of high-dimensional…

Econometrics · Economics 2018-05-15 Michael Zimmert

The method of instrumental variables provides a fundamental and practical tool for causal inference in many empirical studies where unmeasured confounding between the treatments and the outcome is present. Modern data such as the genetical…

Methodology · Statistics 2022-10-28 Ziang Niu , Yuwen Gu , Wei Li