English
Related papers

Related papers: Next Steps for the Colorado Risk-Limiting Audit (C…

200 papers

Count data are collected in many scientific and engineering tasks including image processing, single-cell RNA sequencing and ecological studies. Such data sets often contain missing values, for example because some ecological sites cannot…

Methodology · Statistics 2018-10-25 Geneviève Robin , Julie Josse , Eric Moulines , Sylvain Sardy

In the November 2016 U.S. presidential election, many state level public opinion polls, particularly in the Upper Midwest, incorrectly predicted the winning candidate. One leading explanation for this polling miss is that the precipitous…

Methodology · Statistics 2021-11-15 Eli Ben-Michael , Avi Feller , Erin Hartman

Context: Systematic literature reviews (SLRs) rely on a rigorous and auditable methodology for minimizing biases and ensuring reliability. A common kind of bias arises when selecting studies using a set of inclusion/exclusion criteria. This…

Software Engineering · Computer Science 2020-05-28 Jorge Pérez , Jessica Díaz , Javier Garcia-Martin , Bernardo Tabuenca

Large language models enable flexible multi-agent planning but remain fragile in practice: verification is often circular, state changes are not tracked for repair, and small faults trigger costly global recomputation. We present ALAS, a…

Multiagent Systems · Computer Science 2025-11-06 Longling Geng , Edward Y. Chang

The advent of complex, interconnected long-horizon LLM systems has made it incredibly tricky to identify where and when these systems break down. Evaluation capabilities that currently exist today are limited in that they often focus on…

Artificial Intelligence · Computer Science 2026-02-02 Chenyang Zhu , Spencer Hong , Jingyu Wu , Kushal Chawla , Charlotte Tang , Youbing Yin , Nathan Wolfe , Erin Babinsky , Daben Liu

Accurate and unambiguous guidelines are critical for large language model (LLM) based graders, yet manually crafting these prompts is often sub-optimal as LLMs can misinterpret expert guidelines or lack necessary domain specificity.…

Artificial Intelligence · Computer Science 2026-03-03 Yucheng Chu , Hang Li , Kaiqi Yang , Yasemin Copur-Gencturk , Joseph Krajcik , Namsoo Shin , Jiliang Tang

Context: Software testing plays an essential role in product quality improvement. For this reason, several software testing models have been developed to support organizations. However, adoption of testing process models inside…

Software Engineering · Computer Science 2019-01-08 Katarína Hrabovská , Bruno Rossi , Tomáš Pitner

Test-Time Scaling (TTS) improves the performance of Large Language Models (LLMs) by using additional inference-time computation to explore multiple reasoning paths through search. Yet how to allocate a fixed rollout budget most effectively…

Machine Learning · Computer Science 2025-10-21 Xinglin Wang , Yiwei Li , Shaoxiong Feng , Peiwen Yuan , Yueqi Zhang , Jiayi Shi , Chuyi Tan , Boyuan Pan , Yao Hu , Kan Li

A new method for combining several initial estimators of the regression function is introduced. Instead of building a linear or convex optimized combination over a collection of basic estimators $r_1,\dots,r_M$, we use them as a collective…

Statistics Theory · Mathematics 2019-05-24 Gérard Biau , Aurélie Fischer , Benjamin Guedj , James Malley

Parameter-Efficient Fine-Tuning (PEFT) methods like Low-Rank Adaptation (LoRA) optimize federated training by reducing computational and communication costs. We propose RoLoRA, a federated framework using alternating optimization to…

Machine Learning · Computer Science 2025-11-06 Shuangyi Chen , Yuanxin Guo , Yue Ju , Harik Dalal , Zhongwen Zhu , Ashish Khisti

Reinforcement Learning with Verifiable Rewards (RLVR) has emerged as a key approach for enhancing LLM reasoning. However, standard frameworks like Group Relative Policy Optimization (GRPO) typically employ a uniform rollout budget, leading…

Machine Learning · Computer Science 2026-02-09 Zhiyuan Yao , Yi-Kai Zhang , Yuxin Chen , Yueqing Sun , Zishan Xu , Yu Yang , Tianhao Hu , Qi Gu , Hui Su , Xunliang Cai

This paper presents our system for Task 3 of the CLEF 2025 CheckThat! Lab, which focuses on verifying numerical and temporal claims using retrieved evidence. We explore two complementary approaches: zero-shot prompting with…

Computation and Language · Computer Science 2025-09-16 Anirban Saha Anik , Md Fahimul Kabir Chowdhury , Andrew Wyckoff , Sagnik Ray Choudhury

Fact-checking techniques can mitigate hallucinations in Large Language Models (LLMs), a prominent issue in specialized domains. As parameter-efficient techniques such as Low-Rank Adaptation (LoRA) can overcome substantial computational…

Computation and Language · Computer Science 2024-10-17 Hyeryun Park , Jeongwon Kwak , Dongsuk Jang , Sumin Park , Jinwook Choi

Cross-validation plays a fundamental role in Machine Learning, enabling robust evaluation of model performance and preventing overestimation on training and validation data. However, one of its drawbacks is the potential to create data…

Machine Learning · Computer Science 2025-08-28 Afonso Martini Spezia , Thomas Fontanari , Mariana Recamonde-Mendoza

Mathematical reasoning through Chain-of-Thought (CoT) has emerged as a powerful capability of Large Language Models (LLMs), which can be further enhanced through Test-Time Scaling (TTS) methods like Beam Search and DVTS. However, these…

Computation and Language · Computer Science 2025-05-26 Zezhong Wang , Xingshan Zeng , Weiwen Liu , Yufei Wang , Liangyou Li , Yasheng Wang , Lifeng Shang , Xin Jiang , Qun Liu , Kam-Fai Wong

Randomized controlled trials (RCTs) are the benchmark for causal inference, yet field implementation can drift from the registered design or, by chance, yield imbalances. We introduce a remote audit -- a preregistrable, design-based…

Methodology · Statistics 2025-10-21 Connor T. Jerzak , Adel Daoud

Common election poll reporting is often misleading as sample uncertainty is addressed insufficiently or not covered at all. Furthermore, main interest usually lies beyond the simple party shares. For a more comprehensive opinion poll and…

Applications · Statistics 2018-07-26 Alexander Bauer , Andreas Bender , André Klima , Helmut Küchenhoff

In this paper we introduce an iterative voting algorithm and then use it to obtain a rating method which is very robust against collusion attacks as well as random and biased raters. Unlike the previous iterative methods, our method is not…

Information Retrieval · Computer Science 2014-06-12 Mohammad Allahbakhsh , Aleksandar Ignjatovic

Runtime failures are commonplace in modern distributed systems. When such issues arise, users often turn to platforms such as Github or JIRA to report them and request assistance. Automatically identifying the root cause of these failures…

Software Engineering · Computer Science 2025-04-01 Yichen Li , Yulun Wu , Jinyang Liu , Zhihan Jiang , Zhuangbin Chen , Guangba Yu , Michael R. Lyu

Deep Reinforcement Learning (DRL) algorithms have been increasingly employed during the last decade to solve various decision-making problems such as autonomous driving and robotics. However, these algorithms have faced great challenges…

Software Engineering · Computer Science 2023-08-08 Amirhossein Zolfagharian , Manel Abdellatif , Lionel Briand , Mojtaba Bagherzadeh , Ramesh S