English
Related papers

Related papers: A Note on Estimation Error Bound and Grouping Effe…

200 papers

This paper addresses the estimation of a time- varying parameter in a network. A group of agents sequentially receive noisy signals about the parameter (or moving target), which does not follow any particular dynamics. The parameter is not…

Optimization and Control · Mathematics 2016-03-03 Shahin Shahrampour , Alexander Rakhlin , Ali Jadbabaie

In recent years, there has been a significant growth in research focusing on minimum $\ell_2$ norm (ridgeless) interpolation least squares estimators. However, the majority of these analyses have been limited to an unrealistic regression…

Statistics Theory · Mathematics 2024-06-14 Sungyoon Lee , Sokbae Lee

Neural networks achieve outstanding accuracy in classification and regression tasks. However, understanding their behavior still remains an open challenge that requires questions to be addressed on the robustness, explainability and…

Machine Learning · Computer Science 2021-05-13 Anna-Kathrin Kopetzki , Stephan Günnemann

This paper considers the estimation of treatment effects in randomized experiments with complex experimental designs, including cases with interference between units. We develop a design-based estimation theory for arbitrary experimental…

Econometrics · Economics 2025-05-27 Haoge Chang

In some supervised learning settings, the practitioner might have additional information on the features used for prediction. We propose a new method which leverages this additional information for better prediction. The method, which we…

Methodology · Statistics 2020-06-03 J. Kenneth Tay , Nima Aghaeepour , Trevor Hastie , Robert Tibshirani

We establish non-asymptotic error bounds for the classical Maximal Likelihood Estimation of the transition matrix of a given Markov chain. Meanwhile, in the reversible case, we propose a new reversibility-preserving online Symmetric…

Statistics Theory · Mathematics 2025-11-07 De Huang , Xiangyuan Li

This paper presents a distributed estimator for a deterministic parametric physical field sensed by a homogeneous sensor network and develops a new transformed expression for the Cramer-Rao lower bound (CRLB) on the variance of distributed…

Information Theory · Computer Science 2015-06-17 Salvatore Talarico , Natalia A. Schmid , Marwan Alkhweldi , Matthew C. Valenti

Nested error regression models are useful tools for analysis of grouped data, especially in the case of small area estimation. This paper suggests a nested error regression model using uncertain random effects in which the random effect in…

Methodology · Statistics 2017-02-28 Shonosuke Sugasawa , Tatsuya Kubokawa

The Linear Threshold Model is a widely used model that describes how information diffuses through a social network. According to this model, an individual adopts an idea or product after the proportion of their neighbors who have adopted it…

Social and Information Networks · Computer Science 2022-01-28 Christopher Tran , Elena Zheleva

In this paper, we develop asymptotic theories for a class of latent variable models for large-scale multi-relational networks. In particular, we establish consistency results and asymptotic error bounds for the (penalized) maximum…

Statistics Theory · Mathematics 2020-09-01 Zhi Wang , Xueying Tang , Jingchen Liu

This paper consider penalized empirical loss minimization of convex loss functions with unknown non-linear target functions. Using the elastic net penalty we establish a finite sample oracle inequality which bounds the loss of our estimator…

Statistics Theory · Mathematics 2013-12-13 Mehmet Caner , Anders Bredahl Kock

Transfer learning has emerged as a highly sought-after and actively pursued research area within the statistical community. The core concept of transfer learning involves leveraging insights and information from auxiliary datasets to…

Methodology · Statistics 2024-08-01 Pengfei Li , Tao Yu , Chixiang Chen , Jing Qin

Individuals or companies in a large social or financial network often display rather heterogeneous behaviors for various reasons. In this work, we propose a network vector autoregressive model with a latent group structure to model…

Methodology · Statistics 2023-08-14 Xuening Zhu , Ganggang Xu , Jianqing Fan

For the identification of switched systems with a measured switching signal, this work aims to analyze the effect of switching strategies on the estimation error. The data for identification is assumed to be collected from globally…

Systems and Control · Electrical Eng. & Systems 2022-07-26 Shengling Shi , Othmane Mazhar , Bart De Schutter

Transfer entropy measures directed information flow in time series, and it has become a fundamental quantity in applications spanning neuroscience, finance, and complex systems analysis. However, existing estimation methods suffer from the…

Machine Learning · Computer Science 2026-04-10 Simon Pedro Galeano Munoz , Mustapha Bounoua , Giulio Franzese , Pietro Michiardi , Maurizio Filippone

In fitting a mixture of linear regression models, normal assumption is traditionally used to model the error and then regression parameters are estimated by the maximum likelihood estimators (MLE). This procedure is not valid if the normal…

Methodology · Statistics 2018-11-06 Yanyuan Ma , Shaoli Wang , Lin Xu , Weixin Yao

We study online aggregation of the predictions of experts, and first show new second-order regret bounds in the standard setting, which are obtained via a version of the Prod algorithm (and also a version of the polynomially weighted…

Machine Learning · Statistics 2014-02-11 Pierre Gaillard , Gilles Stoltz , Tim Van Erven

A key problem in the theory of meta-learning is to understand how the task distributions influence transfer risk, the expected error of a meta-learner on a new task drawn from the unknown task distribution. In this paper, focusing on fixed…

Machine Learning · Statistics 2021-06-15 Mikhail Konobeev , Ilja Kuzborskij , Csaba Szepesvári

Distributed decision problems features a group of agents that can only communicate over a peer-to-peer network, without a central memory. In applications such as network control and data ranking, each agent is only affected by a small…

Optimization and Control · Mathematics 2024-04-24 Mattia Bianchi , Sergio Grammatico

Latent space models are powerful statistical tools for modeling and understanding network data. While the importance of accounting for uncertainty in network analysis has been well recognized, the current literature predominantly focuses on…

Statistics Theory · Mathematics 2025-08-15 Jinming Li , Shihao Wu , Chengyu Cui , Gongjun Xu , Ji Zhu