English
Related papers

Related papers: Accurate Liability Estimation Improves Power in As…

200 papers

Evaluating large language models (LLMs) has become increasingly challenging as model capabilities advance rapidly. While recent models often achieve higher scores on standard benchmarks, these improvements do not consistently reflect…

Computation and Language · Computer Science 2025-08-21 Haiquan Hu , Jiazhi Jiang , Shiyou Xu , Ruhan Zeng , Tian Wang

Large language models (LLMs) show promise in clinical decision support yet risk acquiescing to patient pressure for inappropriate care. We introduce SycoEval-EM, a multi-agent simulation framework evaluating LLM robustness through…

Artificial Intelligence · Computer Science 2026-03-05 Dongshen Peng , Yi Wang , Austin Schoeffler , Carl Preiksaitis , Christian Rose

Machine learning (ML) has been used to develop increasingly accurate link quality estimators for wireless networks. However, more in-depth questions regarding the most suitable class of models, most suitable metrics and model performance on…

Machine Learning · Computer Science 2021-05-13 Gregor Cerar , Halil Yetgin , Mihael Mohorčič , Carolina Fortuna

The complexity of linear mixed-effects (LME) models means that traditional diagnostics are rendered less effective. This is due to a breakdown of asymptotic results, boundary issues, and visible patterns in residual plots that are…

Methodology · Statistics 2016-12-08 Adam Loy , Heike Hofmann , Dianne Cook

Large language models (LLMs) are increasingly used in statistical research and applications. However,they are also notorious for unreliable or biased information. Here, we explore whether LLMs can be used to improve the precision of…

Applications · Statistics 2026-05-29 Jaylin Lowe , Adam Sales , Johann A. Gagnon-Bartsch

Large Language Models have been shown to demonstrate stereotypical biases in their representations and behavior due to the discriminative nature of the data that they have been trained on. Despite significant progress in the development of…

Computation and Language · Computer Science 2025-10-29 Kaveh Eskandari Miandoab , Mahammed Kamruzzaman , Arshia Gharooni , Gene Louis Kim , Vasanth Sarathy , Ninareh Mehrabi

Large language models (LLMs) frequently achieve impressive scores on standardized benchmarks, yet accuracy alone offers a limited view of their capabilities. Evaluating open-source LLMs through leaderboards faces persistent issues like data…

We study the law of the iterated logarithm (LIL) for the maximum likelihood estimation of the parameters (as a convex optimization problem) in the generalized linear models with independent or weakly dependent ($\rho$-mixing, $m$-dependent)…

Statistics Theory · Mathematics 2020-04-28 Xiaowei Yang , Shuang Song , Huiming Zhang

This paper develops asymptotic theory for estimation of parameters in regression models for binomial response time series where serial dependence is present through a latent process. Use of generalized linear model (GLM) estimating…

Statistics Theory · Mathematics 2016-06-06 W. T. M. Dunsmuir , J. Y. He

The linear regression model is widely used in the biomedical and social sciences as well as in policy and business research to adjust for covariates and estimate the average effects of treatments. Behind every causal inference endeavor…

Methodology · Statistics 2024-04-23 Ambarish Chattopadhyay , Noah Greifer , Jose R. Zubizarreta

We put forward an adaptive alpha (Type I Error) that decreases as the information grows, for hypothesis tests in which nested linear models are compared. A less elaborate adaptation was already presented in \citet{PP2014} for comparing…

Methodology · Statistics 2021-01-06 D. Vélez , M. E. Pérez , L. R. Pericchi

Traditional AI safety evaluations on isolated LLMs are insufficient as multi-agent AI ensembles become prevalent, introducing novel emergent risks. This paper introduces the Multi-Agent Emergent Behavior Evaluation (MAEBE) framework to…

Multiagent Systems · Computer Science 2025-07-11 Sinem Erisken , Timothy Gothard , Martin Leitgab , Ram Potham

Confounding can lead to spurious associations. Typically, one must observe confounders in order to adjust for them, but in high-dimensional settings, recent research has shown that it becomes possible to adjust even for unobserved…

Methodology · Statistics 2025-10-07 Yujing Lu , Patrick Breheny

As Large Language Models (LLMs) transition from standalone chat interfaces to foundational reasoning layers in multi-agent systems and recursive evaluation loops (LLM-as-a-judge), the detection of durable, provider-level behavioral…

Computation and Language · Computer Science 2026-02-20 Dusan Bosnjakovic

Large Language Models (LLMs) are known to hallucinate, whereby they generate plausible but inaccurate text. This phenomenon poses significant risks in critical applications, such as medicine or law, necessitating robust hallucination…

Computation and Language · Computer Science 2024-10-23 Benedict Aaron Tjandra , Muhammed Razzak , Jannik Kossen , Kunal Handa , Yarin Gal

Active learning aims to efficiently build a labeled training set by strategically selecting samples to query labels from annotators. In this sequential process, each sample acquisition influences subsequent selections, causing dependencies…

Machine Learning · Computer Science 2025-10-07 Beyza Kalkanli , Tales Imbiriba , Stratis Ioannidis , Deniz Erdogmus , Jennifer Dy

Recent claims of strong performance by Large Language Models (LLMs) on causal discovery are undermined by a key flaw: many evaluations rely on benchmarks likely included in pretraining corpora. Thus, apparent success suggests that LLM-only…

Formal verification via theorem proving enables the expressive specification and rigorous proof of software correctness, but it is difficult to scale due to the significant manual effort and expertise required. While Large Language Models…

Software Engineering · Computer Science 2025-10-30 Minghai Lu , Zhe Zhou , Danning Xie , Songlin Jia , Benjamin Delaware , Tianyi Zhang

Error detection (ED), which aims to identify incorrect or inconsistent cell values in tabular data, is important for ensuring data quality. Recent state-of-the-art ED methods leverage the pre-trained knowledge and semantic capability…

Computation and Language · Computer Science 2025-12-09 Mengqi Wang , Jianwei Wang , Qing Liu , Xiwei Xu , Zhenchang Xing , Liming Zhu , Wenjie Zhang

There is growing interest in using machine learning (ML) to support clinical diagnosis, but most approaches rely on static, fully observed datasets and fail to reflect the sequential, resource-aware reasoning clinicians use in practice.…

Artificial Intelligence · Computer Science 2025-11-18 Silas Ruhrberg Estévez , Nicolás Astorga , Mihaela van der Schaar