English
Related papers

Related papers: A Note on Estimation Error Bound and Grouping Effe…

200 papers

Transfer learning seeks to accelerate sequential decision-making by leveraging offline data from related agents. However, data from heterogeneous sources that differ in observed features, distributions, or unobserved confounders often…

Machine Learning · Computer Science 2025-07-10 Xueping Gong , Wei You , Jiheng Zhang

In this paper, we study the framework of collaborative inference, or edge ensembles. This framework enables multiple edge devices to improve classification accuracy by exchanging intermediate features rather than raw observations. However,…

Information Theory · Computer Science 2025-10-03 Mateus P. Mota , Mattia Merluzzi , Emilio Calvanese Strinati

In recent years, transfer learning has garnered significant attention. Its ability to leverage knowledge from related studies to improve generalization performance in a target study has made it highly appealing. This paper focuses on…

Machine Learning · Statistics 2025-10-30 Chao Wang , Caixing Wang , Xin He , Xingdong Feng

We develop original models to study interacting agents in financial markets and in social networks. Within these models randomness is vital as a form of shock or news that decays with time. Agents learn from their observations and learning…

Mathematical Finance · Quantitative Finance 2023-07-14 Ionel Popescu , Tushar Vaidya

The paper studies distributed static parameter (vector) estimation in sensor networks with nonlinear observation models and noisy inter-sensor communication. It introduces \emph{separably estimable} observation models that generalize the…

Multiagent Systems · Computer Science 2012-05-21 Soummya Kar , Jose M. F. Moura , Kavita Ramanan

This paper discusses a nonparametric regression model that naturally generalizes neural network models. The model is based on a finite number of one-dimensional transformations and can be estimated with a one-dimensional rate of…

Statistics Theory · Mathematics 2008-12-18 Joel L. Horowitz , Enno Mammen

Adaptive-network models are typically studied using deterministic differential equations which approximately describe their dynamics. In simulations, however, the discrete nature of the network gives rise to intrinsic noise which can…

Statistical Mechanics · Physics 2012-09-04 Tim Rogers , William Clifford-Brown , Catherine Mills , Tobias Galla

Capturing aleatoric uncertainty is a critical part of many machine learning systems. In deep learning, a common approach to this end is to train a neural network to estimate the parameters of a heteroscedastic Gaussian distribution by…

Machine Learning · Computer Science 2022-04-04 Maximilian Seitzer , Arash Tavakoli , Dimitrije Antic , Georg Martius

Online nonparametric estimators are gaining popularity due to their efficient computation and competitive generalization abilities. An important example includes variants of stochastic gradient descent. These algorithms often take one…

Statistics Theory · Mathematics 2025-07-08 Tianyu Zhang , Jing Lei

Ensemble techniques are powerful approaches that combine several weak learners to build a stronger one. As a meta learning framework, ensemble techniques can easily be applied to many machine learning techniques. In this paper we propose a…

Computation and Language · Computer Science 2017-11-15 Hamideh Hajiabadi , Diego Molla-Aliod , Reza Monsefi

Motivated by inferring cellular signaling networks using noisy flow cytometry data, we develop procedures to draw inference for Bayesian networks based on error-prone data. Two methods for inferring causal relationships between nodes in a…

Methodology · Statistics 2020-02-11 Xianzheng Huang , Hongmei Zhang

We introduce techniques for rapidly transferring the information stored in one neural net into another neural net. The main purpose is to accelerate the training of a significantly larger neural net. During real-world workflows, one often…

Machine Learning · Computer Science 2016-04-26 Tianqi Chen , Ian Goodfellow , Jonathon Shlens

Unstructured text provides decision-makers with a rich data source in many domains, ranging from product reviews in retail to nursing notes in healthcare. To leverage this information, words are typically translated into word embeddings --…

Machine Learning · Statistics 2024-02-20 Kan Xu , Xuanyi Zhao , Hamsa Bastani , Osbert Bastani

This paper investigates the problem of distributed stochastic approximation in multi-agent systems. The algorithm under study consists of two steps: a local stochastic approximation step and a diffusion step which drives the network to a…

Multiagent Systems · Computer Science 2014-10-28 Gemma Morral , Pascal Bianchi , Gersende Fort

Transfer learning involves taking information and insight from one problem domain and applying it to a new problem domain. Although widely used in practice, theory for transfer learning remains less well-developed. To address this, we prove…

Machine Learning · Statistics 2020-06-24 Jake Williams , Abel Tadesse , Tyler Sam , Huey Sun , George D. Montanez

Regression adjustments are often considered by investigators to improve the estimation efficiency of causal effect in randomized experiments when there exists many pre-experiment covariates. In this paper, we provide conditions that…

Statistics Theory · Mathematics 2018-09-25 Hanzhong Liu , Yuehan Yang

Background: Pairwise and network meta-analyses using fixed effect and random effects models are commonly applied to synthesise evidence from randomised controlled trials. The models differ in their assumptions and the interpretation of the…

Methodology · Statistics 2017-08-04 Shijie Ren , Jeremy E. Oakley , John W. Stevens

Understanding how information propagates in real-life complex networks yields a better understanding of dynamic processes such as misinformation or epidemic spreading. The recently introduced branch of machine learning methods for learning…

Social and Information Networks · Computer Science 2023-02-21 Sebastian Mežnar , Nada Lavrač , Blaž Škrlj

Existing weighting methods for treatment effect estimation are often built upon the idea of propensity scores or covariate balance. They usually impose strong assumptions on treatment assignment or outcome model to obtain unbiased…

Machine Learning · Computer Science 2023-05-09 Dongcheng Zhang , Kunpeng Zhang

We investigate an existing distributed algorithm for learning sparse signals or data over networks. The algorithm is iterative and exchanges intermediate estimates of a sparse signal over a network. This learning strategy using exchange of…

Machine Learning · Statistics 2017-09-25 Ahmed Zaki , Partha P. Mitra , Lars K. Rasmussen , Saikat Chatterjee