English
Related papers

Related papers: Reliability-Targeted Simulation of Item Response D…

200 papers

In-context learning (ICL) is a new paradigm for natural language processing that utilizes Generative Pre-trained Transformer (GPT)-like models. This approach uses prompts that include in-context demonstrations to generate the corresponding…

Computation and Language · Computer Science 2024-01-24 Momin Abbas , Yi Zhou , Parikshit Ram , Nathalie Baracaldo , Horst Samulowitz , Theodoros Salonidis , Tianyi Chen

The reverse Monte Carlo (RMC) method is widely used in structural modelling and analysis of experimental data. More recently, RMC has been applied to the calculation of equilibrium thermodynamic properties and dynamic problems. These…

Other Condensed Matter · Physics 2022-12-02 Akash Kumar Ball , Suhail Haque , Abhijit Chatterjee

In robotic systems, the performance of reinforcement learning depends on the rationality of predefined reward functions. However, manually designed reward functions often lead to policy failures due to inaccuracies. Inverse Reinforcement…

Robotics · Computer Science 2025-09-12 Yongkai Tian , Yirong Qi , Xin Yu , Wenjun Wu , Jie Luo

Measurement error arises through a variety of mechanisms. A rich literature exists on the bias introduced by covariate measurement error and on methods of analysis to address this bias. By comparison, less attention has been given to errors…

Methodology · Statistics 2018-11-27 Pamela Shaw , Jiwei He , Bryan Shepherd

As the size of engineered systems grows, problems in reliability theory can become computationally challenging, often due to the combinatorial growth in the cut sets. In this paper we demonstrate how Multilevel Monte Carlo (MLMC) - a…

Computation · Statistics 2017-03-14 Louis J. M. Aslett , Tigran Nagapetyan , Sebastian J. Vollmer

We consider an inverse shape problem arising in electrical impedance tomography (EIT) for nondestructive testing, in which interior defects are modeled through Robin transmission conditions. Unlike classical formulations, we impose Robin…

Numerical Analysis · Mathematics 2026-01-19 Rafael Ceja Ayala , Malena I. Español , Govanni Granados

A Monte Carlo simulation was used to determine which assumptions for ordered categorical data, continuity vs. discrete categories, most frequently identifies the underlying factor structure when a response variable has five ordered…

Applications · Statistics 2020-09-17 R. Noah Padgett , Rebecca J. Tipton

The application of machine learning models can be significantly impeded by the occurrence of distributional shifts, as the assumption of homogeneity between the population of training and testing samples in machine learning and statistics…

Machine Learning · Statistics 2023-06-06 Wenlu Tang , Zicheng Liu

Empirical risk minimization is the main tool for prediction problems, but its extension to relational data remains unsolved. We solve this problem using recent ideas from graph sampling theory to (i) define an empirical risk for relational…

Machine Learning · Statistics 2019-02-25 Victor Veitch , Morgane Austern , Wenda Zhou , David M. Blei , Peter Orbanz

The rapid release of both language models and benchmarks makes it increasingly costly to evaluate every model on every dataset. In practice, models are often evaluated on different samples, making scores difficult to compare across studies.…

Computation and Language · Computer Science 2026-04-16 Eliya Habba , Itay Itzhak , Asaf Yehudai , Yotam Perlitz , Elron Bandel , Michal Shmueli-Scheuer , Leshem Choshen , Gabriel Stanovsky

Reliability in cell type annotation is challenging in single-cell RNA-sequencing data analysis because both expert-driven and automated methods can be biased or constrained by their training data, especially for novel or rare cell types.…

Quantitative Methods · Quantitative Biology 2024-09-25 Wenjin Ye , Yuanchen Ma , Junkai Xiang , Hongjie Liang , Tao Wang , Qiuling Xiang , Andy Peng Xiang , Wu Song , Weiqiang Li , Weijun Huang

Understanding the confidence with which a machine learning model classifies an input datum is an important, and perhaps under-investigated, concept. In this paper, we propose a new calibration metric, the Entropic Calibration Difference…

Machine Learning · Computer Science 2025-02-21 Daniel James Sumler , Lee Devlin , Simon Maskell , Richard O. Lane

Unstructured text data annotation is foundational to management research. LLMs offer a cost-effective and scalable alternative to human annotation, but they introduce a novel challenge: the annotator itself can be retired. Proprietary…

Computation and Language · Computer Science 2026-05-13 Xiang Cheng , Raveesh Mayya , João Sedoc

Computerized Adaptive Testing (CAT) has proven effective for efficient LLM evaluation on multiple-choice benchmarks, but modern LLM evaluation increasingly relies on generation tasks where outputs are scored continuously rather than marked…

Computation and Language · Computer Science 2026-01-21 Esma Balkır , Alice Pernthaller , Marco Basaldella , José Hernández-Orallo , Nigel Collier

As large language models (LLMs) are increasingly deployed in critical decision-making systems, the lack of reliable methods to measure their uncertainty presents a fundamental trustworthiness risk. We introduce a normalized confidence score…

Machine Learning · Computer Science 2026-03-10 Xie Xiaohu , Liu Xiaohu , Yao Benjamin

As large language models (LLMs) improve, so do their offensive applications: frontier agents now generate working exploits for under $50 in compute (Heelan, 2026). Defensive incident response (IR) agents must keep pace, but existing…

Artificial Intelligence · Computer Science 2026-02-10 Jarrod Barnes

Inverse problems describe the task of recovering an underlying signal of interest given observables. Typically, the observables are related via some non-linear forward model applied to the underlying unknown signal. Inverting the non-linear…

Signal Processing · Electrical Eng. & Systems 2023-05-19 Jihui Jin , Etienne Ollivier , Richard Touret , Matthew McKinley , Karim G. Sabra , Justin K. Romberg

We provide a general methodology for unbiased estimation for intractable stochastic models. We consider situations where the target distribution can be written as an appropriate limit of distributions, and where conventional approaches…

Methodology · Statistics 2014-12-01 Sergios Agapiou , Gareth O. Roberts , Sebastian J. Vollmer

In data-driven stochastic optimization, model parameters of the underlying distribution need to be estimated from data in addition to the optimization task. Recent literature considers integrating the estimation and optimization processes…

Machine Learning · Statistics 2025-05-23 Adam N. Elmachtoub , Henry Lam , Haofeng Zhang , Yunfan Zhao

Linguistic cues such as "I believe" and "probably" offer an intuitive interface for communicating confidence, yet a generalisable, principled calibration framework for linguistic confidence expressions remains underexplored. In particular,…

Computation and Language · Computer Science 2026-05-20 Yi-Fan Yeh , Linwei Tao , Minjing Dong , Tao Huang , Jialin Yu , Philip Torr , Chang Xu