English
Related papers

Related papers: Reinforcing RCTs with Multiple Priors while Learni…

200 papers

Causal discovery is to learn cause-effect relationships among variables given observational data and is important for many applications. Existing causal discovery methods assume data sufficiency, which may not be the case in many real world…

Machine Learning · Computer Science 2022-06-20 Zijun Cui , Naiyu Yin , Yuru Wang , Qiang Ji

Many sequential decision-making problems that are currently automated, such as those in manufacturing or recommender systems, operate in an environment where there is either little uncertainty, or zero risk of catastrophe. As companies and…

Machine Learning · Computer Science 2023-04-04 Marc Rigter

Experiments with pre-trained models such as BERT are often based on a single checkpoint. While the conclusions drawn apply to the artifact tested in the experiment (i.e., the particular instance of the model), it is not always clear whether…

When we plan to use money as an incentive to change the behavior of a person (such as making riders to deliver more orders or making consumers to buy more items), the common approach of this problem is to adopt a two-stage framework in…

Machine Learning · Computer Science 2025-04-08 Juhua Chen , Karson shi , Jialing He , North Chen , Kele Jiang

Model checking procedures are considered based on the use of the Dirichlet process and relative belief. This combination is seen to lead to some unique advantages for this problem. In particular, it avoids double use of the data and…

Methodology · Statistics 2016-06-28 Luai Al-Labadi , Michael Evans

We introduce Robust Bayesian Sequential Borrowing (RBSB), a framework for extrapolating evidence across adjacent subgroups in multi-population clinical programmes where studies are conducted in sequence and populations are ordered by…

Methodology · Statistics 2026-04-27 Erik Hermansson , Lynn Dunsire , David Svensson , Thomas Jaki

We develop a Bayesian approach to predict a continuous or binary outcome from data that are collected from multiple sources with a multi-way (i.e.. multidimensional tensor) structure. As a motivating example we consider molecular data from…

Methodology · Statistics 2022-08-09 Jonathan Kim , Brian J. Sandri , Raghavendra B. Rao , Eric F. Lock

Assessment of replicability is critical to ensure the quality and rigor of scientific research. In this paper, we discuss inference and modeling principles for replicability assessment. Targeting distinct application scenarios, we propose…

Methodology · Statistics 2021-05-11 Yi Zhao , Xiaoquan Wen

In this work, we investigate how explicitly modeling problem's difficulty prior information shapes the effectiveness of reinforcement learning based fine-tuning for multimodal reasoning. Our exploration mainly comprises of following three…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Mingrui Chen , Haogeng Liu , Hao Liang , Huaibo Huang , Wentao Zhang , Ran He

We study a class of binary treatment choice problems with partial identification through the lens of robust (multiple prior) Bayesian analysis. We use a convenient set of prior distributions to derive ex-ante and ex-post robust Bayes…

In this work we apply the methodology of integral priors to handle Bayesian model selection in binomial regression models with a general link function. These models are very often used to investigate associations and risks in…

Methodology · Statistics 2013-07-01 Diego Salmeron , Juan Antonio Cano , C. P. Robert

Reinforcement learning provides a general framework for flexible decision making and control, but requires extensive data collection for each new task that an agent needs to learn. In other machine learning fields, such as natural language…

Machine Learning · Computer Science 2020-11-20 Avi Singh , Huihan Liu , Gaoyue Zhou , Albert Yu , Nicholas Rhinehart , Sergey Levine

In this paper we present tools for applied researchers that re-purpose off-the-shelf methods from the computer-science field of machine learning to create a "discovery engine" for data from randomized controlled trials (RCTs). The applied…

Machine Learning · Statistics 2019-05-13 Jens Ludwig , Sendhil Mullainathan , Jann Spiess

Reinforcement learning is an essential paradigm for solving sequential decision problems under uncertainty. Despite many remarkable achievements in recent decades, applying reinforcement learning methods in the real world remains…

Machine Learning · Computer Science 2023-11-22 Zhihong Deng , Jing Jiang , Guodong Long , Chengqi Zhang

The two-level normal hierarchical model has played an important role in statistical theory and applications. In this paper, we first introduce a general adjusted maximum likelihood method for estimating the unknown variance component of the…

Methodology · Statistics 2019-01-25 Masayo Y. Hirose , Partha Lahiri

Many multiagent applications require an agent to learn quickly how to interact with previously unknown other agents. To address this problem, researchers have studied learning algorithms which compute posterior beliefs over a hypothesised…

Artificial Intelligence · Computer Science 2019-07-12 Stefano V. Albrecht , Jacob W. Crandall , Subramanian Ramamoorthy

Posterior sampling allows exploitation of prior knowledge on the environment's transition dynamics to improve the sample efficiency of reinforcement learning. The prior is typically specified as a class of parametric distributions, the…

Machine Learning · Computer Science 2024-04-09 Mirco Mutti , Riccardo De Santi , Marcello Restelli , Alexander Marx , Giorgia Ramponi

The prior distribution for the unknown model parameters plays a crucial role in the process of statistical inference based on Bayesian methods. However, specifying suitable priors is often difficult even when detailed prior knowledge is…

Methodology · Statistics 2020-03-18 Marcelo Hartmann , Georgi Agiashvili , Paul Bürkner , Arto Klami

Foundation models, and in particular large language models, can generate highly informative responses, prompting growing interest in using these ''synthetic'' outputs as data in empirical research and decision-making. This paper introduces…

Artificial Intelligence · Computer Science 2025-12-02 Sanjog Misra

In the Bayesian framework power prior distributions are increasingly adopted in clinical trials and similar studies to incorporate external and past information, typically to inform the parameter associated to a treatment effect. Their use…

Methodology · Statistics 2025-08-12 Roberto Macrì Demartino , Leonardo Egidi , Nicola Torelli , Ioannis Ntzoufras