English
Related papers

Related papers: Doing More With Less: Mismatch-Based Risk-Limiting…

200 papers

Control variates can be a powerful tool to reduce the variance of Monte Carlo estimators, but constructing effective control variates can be challenging when the number of samples is small. In this paper, we show that when a large number of…

Methodology · Statistics 2023-06-08 Zhuo Sun , Chris J. Oates , François-Xavier Briol

An oracle is a mechanism to decide whether the outputs of the program for the executed test cases are correct. For machine learning programs, such oracle is not available or too difficult to apply. Metamorphic testing is a testing approach…

Software Engineering · Computer Science 2022-09-02 Madhusudan Srinivasan , Upulee Kanewala

Large Language Models (LLMs) are widely used across multiple domains but continue to raise concerns regarding security and fairness. Beyond known attack vectors such as data poisoning and prompt injection, LLMs are also vulnerable to…

Artificial Intelligence · Computer Science 2025-10-01 Matheus Vinicius da Silva de Oliveira , Jonathan de Andrade Silva , Awdren de Lima Fontao

We study risk-sensitive Reinforcement Learning (RL), where we aim to maximize the Conditional Value at Risk (CVaR) with a fixed risk tolerance $\tau$. Prior theoretical work studying risk-sensitive RL focuses on the tabular Markov Decision…

Machine Learning · Computer Science 2023-11-21 Yulai Zhao , Wenhao Zhan , Xiaoyan Hu , Ho-fung Leung , Farzan Farnia , Wen Sun , Jason D. Lee

Randomized controlled trials (RCTs) are the gold standard for estimating heterogeneous treatment effects, yet they are often underpowered for detecting effect heterogeneity. Large observational studies (OS) can supplement RCTs for…

Machine Learning · Computer Science 2026-04-07 Amir Asiaee , Samhita Pal

This paper presents DiffSum, a simple post-election risk-limiting ballot-polling audit for two-candidate plurality elections. DiffSum sequentially draws ballots (without replacement) until the numbers $a$, $b$, of votes for candidates $A$,…

Computers and Society · Computer Science 2015-09-02 Ronald L. Rivest

Large Language Models (LLMs) are increasingly deployed in various applications, raising critical concerns about fairness and potential biases in their outputs. This paper explores the prioritization of metamorphic relations (MRs) in…

Computation and Language · Computer Science 2025-05-14 Suavis Giramata , Madhusudan Srinivasan , Venkat Naidu Gudivada , Upulee Kanewala

Various risk-limiting audit (RLA) methods have been developed for instant-runoff voting (IRV) elections. A recent method, AWAIRE, is the first efficient approach that can take advantage of but does not require cast vote records (CVRs).…

Computers and Society · Computer Science 2024-12-03 Alexander Ek , Philip B. Stark , Peter J. Stuckey , Damjan Vukcevic

Ranked Choice Voting (RCV) adoption is expanding across U.S. elections, but faces persistent criticism for complexity, strategic manipulation, and ballot exhaustion. We empirically test these concerns on real election data, across three…

Computers and Society · Computer Science 2026-02-17 Sanyukta Deshpande , Nikhil Garg , Sheldon H. Jacobson

In legal decisions, split votes (SV) occur when judges cannot reach a unanimous decision, posing a difficulty for lawyers who must navigate diverse legal arguments and opinions. In high-stakes domains, understanding the alignment of…

Computation and Language · Computer Science 2024-06-07 Shanshan Xu , T. Y. S. S Santosh , Oana Ichim , Barbara Plank , Matthias Grabmair

Conditional value-at-risk (CVaR) precisely characterizes the influence that rare, catastrophic events can exert over decisions. Such characterizations are important for both normal decision-making and for psychiatric conditions such as…

Artificial Intelligence · Computer Science 2021-11-15 Chris Gagne , Peter Dayan

SOBA is an approach to election verification that provides observers with justifiably high confidence that the reported results of an election are consistent with an audit trail ("ballots"), which can be paper or electronic. SOBA combines…

Applications · Statistics 2011-07-05 Josh Benaloh , Douglas Jones , Eric Lazarus , Mark Lindeman , Philip B. Stark

Majority voting is a simple mathematical function that returns the value that appears most often in a set. As a popular decision fusion technique, the majority voting function (MVF) finds applications in resolving conflicts, where a number…

Machine Learning · Statistics 2023-09-19 Sina Aeeneh , Nikola Zlatanov , Jiangshan Yu

Optimizing risk measures such as Value-at-Risk (VaR) and Conditional Value-at-Risk (CVaR) of a general loss distribution is usually difficult, because 1) the loss function might lack structural properties such as convexity or…

Optimization and Control · Mathematics 2016-08-03 Helin Zhu , Joshua Hale , Enlu Zhou

Large language models (LLMs) can often accurately describe probability distributions using natural language, yet they still struggle to generate faithful samples from them. This mismatch limits their use in tasks requiring reliable…

Machine Learning · Computer Science 2026-04-24 Tim Z. Xiao , Johannes Zenn , Zhen Liu , Weiyang Liu , Robert Bamler , Bernhard Schölkopf

We consider the task of evaluating policies of algorithmic resource allocation through randomized controlled trials (RCTs). Such policies are tasked with optimizing the utilization of limited intervention resources, with the goal of…

Artificial Intelligence · Computer Science 2023-02-07 Aditya Mate , Bryan Wilder , Aparna Taneja , Milind Tambe

Surveys provide valuable insights into public opinion and behavior, but their execution is costly and slow. Large language models (LLMs) have been proposed as a scalable, low-cost substitute for human respondents, but their outputs are…

Computation and Language · Computer Science 2025-10-21 Stefan Krsteski , Giuseppe Russo , Serina Chang , Robert West , Kristina Gligorić

Reinforcement Learning (RL) controllers have generated excitement within the control community. The primary advantage of RL controllers relative to existing methods is their ability to optimize uncertain systems independently of explicit…

Machine Learning · Computer Science 2021-12-07 Max Mowbray , Panagiotis Petsagkourakis , Ehecatl Antonio del Río Chanona , Dongda Zhang

Large Reasoning Models (LRMs) achieve strong performance on mathematical reasoning tasks but remain unreliable on challenging instances. Existing test-time scaling methods, such as repeated sampling, self-correction, and tree search,…

Artificial Intelligence · Computer Science 2026-04-30 Zhimin Lin , Yixin Ji , Jinpeng Li , Yu Luo , Dong Li , Junhua Fang , Juntao Li , Min Zhang

Ensuring that large language models (LLMs) remain both helpful and harmless poses a significant challenge: fine-tuning on repetitive safety datasets, where unsafe prompts are paired with standard refusal templates, often leads to false…

Machine Learning · Computer Science 2026-03-17 Quan Liu , Han Zhou , Wenquan Wu , Hua Wu , Sen Su