English
Related papers

Related papers: Efficient Estimation for Generalized Linear Models…

200 papers

We propose a communication- and computation-efficient distributed optimization algorithm using second-order information for solving ERM problems with a nonsmooth regularization term. Current second-order and quasi-Newton methods for this…

Optimization and Control · Mathematics 2018-05-29 Ching-pei Lee , Cong Han Lim , Stephen J. Wright

This paper proposes a distributed pseudo-likelihood method (DPL) to conveniently identify the community structure of large-scale networks. Specifically, we first propose a block-wise splitting method to divide large-scale network data into…

Methodology · Statistics 2024-11-05 Jiayi Deng , Danyang Huang , Bo Zhang

The proliferation of science and technology has led to the prevalence of voluminous data sets that are distributed across multiple machines. It is an established fact that conventional statistical methodologies may be unfeasible in the…

Statistics Theory · Mathematics 2023-10-24 Lu Yan , Jiang Hu

The aim of this paper is to propose diffusion strategies for distributed estimation over adaptive networks, assuming the presence of spatially correlated measurements distributed according to a Gaussian Markov random field (GMRF) model. The…

Systems and Control · Computer Science 2015-06-22 Paolo Di Lorenzo

We present new algorithms and fast implementations to find efficient approximations for modelling stochastic processes. For many numerical computations it is essential to develop finite approximations for stochastic processes. While the…

Optimization and Control · Mathematics 2020-12-03 Kipngeno Benard Kirui , Georg Ch. Pflug , Alois Pichler

Motivated by a recently proposed error estimator for the transfer function of the reduced-order model of a given linear dynamical system, we further develop more theoretical results in this work. Furthermore, we propose several variants of…

Numerical Analysis · Mathematics 2023-01-16 Lihong Feng , Peter Benner

Modern statistical estimation is often performed in a distributed setting where each sample belongs to a single user who shares their data with a central server. Users are typically concerned with preserving the privacy of their samples,…

Machine Learning · Computer Science 2023-05-16 Gecia Bravo-Hermsdorff , Róbert Busa-Fekete , Mohammad Ghavamzadeh , Andres Muñoz Medina , Umar Syed

Nonlinear state estimation (SE), with the goal of estimating complex bus voltages based on all types of measurements available in the power system, is usually solved using the iterative Gauss-Newton method. The nonlinear SE presents some…

Machine Learning · Computer Science 2022-09-09 Ognjen Kundacina , Mirsad Cosovic , Dragisa Miskovic , Dejan Vukobratovic

This paper considers the problem of remote state estimation for Markov jump linear systems in the presence of uncertainty in the posterior mode probabilities. Such uncertainty may arise when the estimator receives noisy or incomplete…

Systems and Control · Electrical Eng. & Systems 2025-09-05 Ioannis Tzortzis , Themistoklis Charalambous , Charalambos D. Charalambous

Gaussian state space models have been used for decades as generative models of sequential data. They admit an intuitive probabilistic interpretation, have a simple functional form, and enjoy widespread adoption. We introduce a unified…

Machine Learning · Statistics 2016-12-06 Rahul G. Krishnan , Uri Shalit , David Sontag

An algorithm is described that enables efficient deterministic approximate computation of the bootstrap distribution for any linear bootstrap method $T_n^*$, alleviating the need for repeated resampling from observations (resp.…

Methodology · Statistics 2019-04-10 Thomas Pitschel

Considering the increasing size of available data, the need for statistical methods that control the finite sample bias is growing. This is mainly due to the frequent settings where the number of variables is large and allowed to increase…

Statistics Theory · Mathematics 2018-10-12 Stéphane Guerrier , Mucyo Karemera , Samuel Orso , Maria-Pia Victoria-Feser

Many conventional statistical procedures are extremely sensitive to seemingly minor deviations from modeling assumptions. This problem is exacerbated in modern high-dimensional settings, where the problem dimension can grow with and…

Machine Learning · Statistics 2017-02-27 Simon S. Du , Sivaraman Balakrishnan , Aarti Singh

Regression trees and their ensemble methods are popular methods for nonparametric regression: they combine strong predictive performance with interpretable estimators. To improve their utility for locally smooth response surfaces, we study…

Methodology · Statistics 2021-09-13 Sören R. Künzel , Theo F. Saarinen , Edward W. Liu , Jasjeet S. Sekhon

This work proposes a unified framework for efficient estimation under latent space modeling of heterogeneous networks. We consider a class of latent space models that decompose latent vectors into shared and network-specific components…

Methodology · Statistics 2025-12-10 Yuang Tian , Jiajin Sun , Yinqiu He

We study the semiparametric efficient estimation of a class of linear functionals in settings where a complete multivariate dataset is supplemented by additional datasets recording subsets of the variables of interest. These datasets are…

Statistics Theory · Mathematics 2025-06-19 Thomas B. Berrett

Distributed parameter identification for large-scale multi-agent networks encounters challenges due to nonlinear dynamics and partial observations. Simultaneously, ensuring the stability is crucial for the robust identification of dynamic…

Dynamical Systems · Mathematics 2024-01-09 Chunhui Li , Chengpu Yu

Random sampling is an essential tool in the processing and transmission of data. It is used to summarize data too large to store or manipulate and meet resource constraints on bandwidth or battery power. Estimators that are applied to the…

Databases · Computer Science 2015-03-19 Edith Cohen , Haim Kaplan

Estimating the expectation of a real-valued function of a random variable from sample data is a critical aspect of statistical analysis, with far-reaching implications in various applications. Current methodologies typically assume…

Machine Learning · Computer Science 2026-02-18 Paweł Lorek , Rafał Nowak , Rafał Topolnicki , Tomasz Trzciński , Maciej Zięba , Aleksandra Krystecka

In the era of big data, it is necessary to split extremely large data sets across multiple computing nodes and construct estimators using the distributed data. When designing distributed estimators, it is desirable to minimize the amount of…

Statistics Theory · Mathematics 2022-04-25 Azeem Zaman , Botond Szabó