English
Related papers

Related papers: M-estimation in multistage sampling procedures

200 papers

We develop a novel and general framework for reduced-bias $M$-estimation from asymptotically unbiased estimating functions. The framework relies on an empirical approximation of the bias by a function of derivatives of estimating function…

Methodology · Statistics 2023-08-11 Ioannis Kosmidis , Nicola Lunardon

This article introduces an iterative distributed computing estimator for the multinomial logistic regression model with large choice sets. Compared to the maximum likelihood estimator, the proposed iterative distributed estimator achieves…

Econometrics · Economics 2024-12-03 Yanqin Fan , Yigit Okar , Xuetao Shi

We introduce a novel framework for efficient sampling from complex, unnormalised target distributions by exploiting multiscale dynamics. Traditional score-based sampling methods either rely on learned approximations of the score function or…

Computation · Statistics 2025-11-04 Paula Cordero-Encinar , Andrew B. Duncan , Sebastian Reich , O. Deniz Akyildiz

A two-stage batch estimation algorithm for solving a class of nonlinear, static parameter estimation problems that appear in aerospace engineering applications is proposed. It is shown how these problems can be recast into a form suitable…

Signal Processing · Electrical Eng. & Systems 2020-02-18 Kerry Sun , Demoz Gebre-Egziabher

We propose a multistage method for making inference at all levels of a Bayesian hierarchical model (BHM) using natural data partitions to increase efficiency by allowing computations to take place in parallel form using software that is…

Methodology · Statistics 2021-09-23 Devin S. Johnson , Brian M. Brost , Mevin B. Hooten

We introduce the class of multistage stochastic optimization problems with a random number of stages. For such problems, we show how to write dynamic programming equations and detail the Stochastic Dual Dynamic Programming algorithm to…

Optimization and Control · Mathematics 2019-07-18 Vincent Guigues

Hypothesis testing is a statistical method used to draw conclusions about populations from sample data, typically represented in tables. With the prevalence of graph representations in real-life applications, hypothesis testing in graphs is…

Machine Learning · Statistics 2025-02-27 Yun Wang , Chrysanthi Kosyfaki , Sihem Amer-Yahia , Reynold Cheng

We consider multistage stochastic optimization problems involving multiple units. Each unit is a (small) control system. Static constraints couple units at each stage. We present a mix of spatial and temporal decompositions to tackle such…

Optimization and Control · Mathematics 2021-06-18 Pierre Carpentier , Jean-Philippe Chancelier , Michel de Lara , François Pacaud

We study a class of multi-stage stochastic programs, which incorporate modeling features from Markov decision processes (MDPs). This class includes structured MDPs with continuous action and state spaces. We extend policy graphs to include…

Machine Learning · Computer Science 2026-04-09 David P. Morton , Oscar Dowson , Bernardo K. Pagnoncelli

Multilevel optimization has gained renewed interest in machine learning due to its promise in applications such as hyperparameter tuning and continual learning. However, existing methods struggle with the inherent difficulty of efficiently…

Machine Learning · Computer Science 2024-10-16 Yuntian Gu , Xuzheng Chen

The paper describes multistage design of composite (modular) systems (i.e., design of a system trajectory). This design process consists of the following: (i) definition of a set of time/logical points; (ii) modular design of the system for…

Artificial Intelligence · Computer Science 2013-06-20 Mark Sh. Levin

Real-world scenarios frequently involve multi-objective data-driven optimization problems, characterized by unknown problem coefficients and multiple conflicting objectives. Traditional two-stage methods independently apply a machine…

Machine Learning · Computer Science 2024-06-04 Peng Li , Lixia Wu , Chaoqun Feng , Haoyuan Hu , Lei Fu , Jieping Ye

A common problem in health research is that we have a large database with many variables measured on a large number of individuals. We are interested in measuring additional variables on a subsample; these measurements may be newly…

Methodology · Statistics 2022-03-22 Thomas Lumley , Tong Chen

Complex biological processes are usually experimented along time among a collection of individuals. Longitudinal data are then available and the statistical challenge is to better understand the underlying biological mechanisms. The…

Statistics Theory · Mathematics 2015-06-11 Pierre Barbillon , Célia Barthélémy , Adeline Samson

When environmental interaction is expensive, model-based reinforcement learning offers a solution by planning ahead and avoiding costly mistakes. Model-based agents typically learn a single-step transition model. In this paper, we propose a…

Machine Learning · Computer Science 2018-11-02 Kavosh Asadi , Evan Cater , Dipendra Misra , Michael L. Littman

Applications of structural equation models (SEMs) are often restricted to linear associations between variables. Maximum likelihood (ML) estimation in non-linear models may be complex and require numerical integration. Furthermore, ML…

Methodology · Statistics 2019-03-15 Klaus Kähler Holst , Esben Budtz-Jørgensen

We consider the problem of the construction of the estimator-process of the unknown finite-dimensional parameter in the case of the observations of nonlinear autoregressive process. The estimation is done in two or three steps. First we…

Statistics Theory · Mathematics 2016-02-01 Yury A. Kutoyants , Anastasia Motrunich

The increased availability of massive data sets provides a unique opportunity to discover subtle patterns in their distributions, but also imposes overwhelming computational challenges. To fully utilize the information contained in big…

Statistics Theory · Mathematics 2018-04-12 Stanislav Volgushev , Shih-Kang Chao , Guang Cheng

In this paper, probabilistic guarantees for constraint sampling of multistage robust convex optimization problems are derived. The dynamic nature of these problems is tackled via the so-called scenario-with-certificates approach. This…

Optimization and Control · Mathematics 2016-11-08 Francesca Maggioni , Marida Bertocchi , Fabrizio Dabbene , Roberto Tempo

Bayesian multinomial logistic regression provides a principled, interpretable approach to multiclass classification, but posterior sampling becomes increasingly expensive as the model dimension grows. Prior work has studied scalability in…

Computation · Statistics 2026-02-27 Jared D. Fisher , Kyle R. McEvoy