English
Related papers

Related papers: Sublinear Risk-Limiting Audits from Direct Ballot …

200 papers

Ranked Choice Voting (RCV) adoption is expanding across U.S. elections, but faces persistent criticism for complexity, strategic manipulation, and ballot exhaustion. We empirically test these concerns on real election data, across three…

Computers and Society · Computer Science 2026-02-17 Sanyukta Deshpande , Nikhil Garg , Sheldon H. Jacobson

Tabulation audits for an election provide statistical evidence that a reported contest outcome is "correct" (meaning that the tabulation of votes was properly performed), or else the tabulation audit determines the correct outcome. Stark…

Cryptography and Security · Computer Science 2018-02-13 Ronald L. Rivest

ONEAudit provides more efficient risk-limiting audits than other extant methods when the voting system cannot report a cast-vote record linked to each cast card. It obviates the need for re-scanning; it is simpler and more efficient than…

Methodology · Statistics 2025-08-20 Jacob V Spertus , Amanda K Glazer , Philip B Stark

LLM code-generation pipelines often sample multiple candidates and select one final answer without access to a complete oracle. Existing pipelines mix textual voting, ranking, and execution-based agreement, but the relative contribution of…

Software Engineering · Computer Science 2026-05-12 Shan Jiang , Zijian Yi , Chenguang Zhu

Meta-analyses statistically aggregate the findings of different randomized controlled trials (RCTs) to assess treatment effectiveness. Because this yields robust estimates of treatment effectiveness, results from meta-analyses are…

Computation and Language · Computer Science 2024-07-26 Hye Sun Yun , David Pogrebitskiy , Iain J. Marshall , Byron C. Wallace

Variable selection in linear models plays a pivotal role in modern statistics. Hard-thresholding methods such as $l_0$ regularization are theoretically ideal but computationally infeasible. In this paper, we propose a new approach, called…

Machine Learning · Statistics 2015-03-20 Kun Yang

Post-election audits use the discrepancy between machine counts and a hand tally of votes in a random sample of precincts to infer whether error affected the electoral outcome. The maximum relative overstatement of pairwise margins (MRO)…

Applications · Statistics 2008-11-12 Philip B. Stark

Repeated sampling is a standard way to spend test-time compute, but its benefit is controlled by the latent distribution of correctness across examples, not by one-call accuracy alone. We study the binary correctness layer of repeated LLM…

Machine Learning · Computer Science 2026-05-08 Yi Liu

LLMs are widely used, yet they remain prone to factual errors that erode user trust and limit adoption in high-risk settings. One approach to mitigate this risk is to equip models with uncertainty estimation mechanisms that abstain when…

Artificial Intelligence · Computer Science 2026-02-16 Shani Goren , Ido Galil , Ran El-Yaniv

Indian Electronic Voting Machines (EVMs) will be fitted with printers that produce Voter-Verifiable Paper Audit Trails (VVPATs) in time for the 2019 general election. VVPATs provide evidence that each vote was recorded as the voter…

Cryptography and Security · Computer Science 2019-01-28 Vishal Mohanty , Nicholas Akinyokun , Andrew Conway , Chris Culnane , Philip B. Stark , Vanessa Teague

We propose an approach for preventing unsafe or otherwise low-quality large language model (LLM) outputs by leveraging the stochasticity of LLMs, an approach we call Repeated Checking with Regeneration (RCR). In this system, LLM checkers…

Artificial Intelligence · Computer Science 2025-09-30 Jake R. Watts , Joel Sokol

A matrix algorithm runs superfast (aka at sublinear cost) if it involves much fewer flops and memory cells than an input matrix has entries. Big Data are frequently represented by matrices of immense sizes that cannot be handled directly…

Numerical Analysis · Mathematics 2025-11-11 Qi Luan , Victor Y. Pan

Suicide rates have risen worldwide in recent years, underscoring the urgent need for proactive prevention strategies. Social media provides valuable signals, as many at-risk individuals - who often avoid formal help due to stigma - choose…

Computation and Language · Computer Science 2025-10-10 Yukai Song , Pengfei Zhou , César Escobar-Viera , Candice Biernesser , Wei Huang , Jingtong Hu

In sensitive domains, Retrieval-Augmented Generation (RAG) must be interpretable and robust because errors do not just mislead, they invite lawsuits, undermine scholarly credibility, and breach compliance. Stakeholders require traceable…

Computation and Language · Computer Science 2026-01-21 Yash Saxena , Ankur Padia , Mandar S Chaudhary , Kalpa Gunaratna , Srinivasan Parthasarathy , Manas Gaur

Adapting large language models (LLMs) to specific domains often faces a critical bottleneck: the scarcity of high-quality, human-curated data. While large volumes of unchecked data are readily available, indiscriminately using them for…

Computation and Language · Computer Science 2025-09-09 Jian Wu , Hang Yu , Bingchang Liu , Wenjie Yang , Peng Di , Jianguo Li , Yue Zhang

Context. Risk analysis assesses potential risks in specific scenarios. Risk analysis principles are context-less; the same methodology can be applied to a risk connected to health and information technology security. Risk analysis requires…

Computation and Language · Computer Science 2024-09-10 Matteo Esposito , Francesco Palagiano , Valentina Lenarduzzi , Davide Taibi

Multiple Choice Question (MCQ) answering is a widely used method for evaluating the performance of Large Language Models (LLMs). However, LLMs often exhibit selection bias in MCQ tasks, where their choices are influenced by factors like…

Computation and Language · Computer Science 2025-12-01 Blessed Guda , Lawrence Francis , Gabrial Zencha Ashungafac , Carlee Joe-Wong , Moise Busogi

Machine learning models in high-stakes applications, such as recidivism prediction and automated personnel selection, often exhibit systematic performance disparities across sensitive subpopulations, raising critical concerns regarding…

Machine Learning · Statistics 2026-02-13 Jie Tang , Chuanlong Xie , Xianli Zeng , Lixing Zhu

Bias audits of large language models now operate within governance frameworks such as the EU AI Act, making benchmark reliability a security concern in its own right. Many current benchmarks, however, collapse bias into a single scalar from…

Computation and Language · Computer Science 2026-05-12 Jialing Gan , Junhao Dong , Songze Li

The City and County of San Francisco, CA, has used Instant Runoff Voting (IRV) for some elections since 2004. This report describes the first ever process pilot of Risk Limiting Audits for IRV, for the San Francisco District Attorney's race…

Computers and Society · Computer Science 2020-04-02 Michelle Blom , Andrew Conway , Dan King , Laurent Sandrolini , Philip B. Stark , Peter J. Stuckey , Vanessa Teague