中文
相关论文

相关论文: PROVIDENCE: a Flexible Round-by-Round Risk-Limitin…

200 篇论文

Reinforcement learning (RL) commonly relies on scalar rewards with limited ability to express temporal, conditional, or safety-critical goals, and can lead to reward hacking. Temporal logic expressible via the more general class of…

人工智能 · 计算机科学 2025-11-26 Dominik Wagner , Leon Witzman , Luke Ong

Vision-language-action (VLA) models have shown strong generalization across tasks and embodiments; however, their reliance on large-scale human demonstrations limits their scalability owing to the cost and effort of manual data collection.…

机器人学 · 计算机科学 2025-09-30 Rushuai Yang , Hangxing Wei , Ran Zhang , Zhiyuan Feng , Xiaoyu Chen , Tong Li , Chuheng Zhang , Li Zhao , Jiang Bian , Xiu Su , Yi Chen

Reinforcement learning (RL) has significantly improved the reasoning ability of large language models. However, current reward models underperform in challenging reasoning scenarios and predominant RL training paradigms rely on rule-based…

计算与语言 · 计算机科学 2025-07-30 Meng Zhou , Bei Li , Jiahao Liu , Xiaowen Shi , Yang Bai , Rongxiang Weng , Jingang Wang , Xunliang Cai

A crucial part of data analysis is the validation of the resulting estimators, in particular, if several competing estimators need to be compared. Whether an estimator can be objectively validated is not a trivial property. If there exists…

统计理论 · 数学 2024-05-17 Tino Werner

Conformal prediction offers a distribution-free framework for constructing prediction sets with finite-sample coverage. Yet, efficiently leveraging multiple conformity scores to reduce prediction set size remains a major open challenge.…

统计方法学 · 统计学 2025-11-18 Congbin Xu , Yue Yu , Haojie Ren , Zhaojun Wang , Changliang Zou

Document Layout Analysis (DLA) pipelines provide structured page representations for retrieval-augmented generation, long-document question answering, and other document intelligence systems, yet their robustness evaluation remains largely…

计算与语言 · 计算机科学 2026-05-27 Yue Chen , Yihao Wang , Ziyi Tang , Yongsen Zheng , Keze Wang

This paper presents a novel approach to reinforcement learning (RL) for control systems that provides probabilistic stability guarantees using finite data. Leveraging Lyapunov's method, we propose a probabilistic stability theorem that…

机器学习 · 计算机科学 2026-03-03 Minghao Han , Lixian Zhang , Chenliang Liu , Zhipeng Zhou , Jun Wang , Wei Pan

Reinforcement learning has been widely applied to diffusion and flow models for visual tasks such as text-to-image generation. However, these tasks remain challenging because diffusion models have intractable likelihoods, which creates a…

机器学习 · 计算机科学 2026-05-20 Jaemoo Choi , Yuchen Zhu , Wei Guo , Petr Molodyk , Bo Yuan , Jinbin Bai , Yi Xin , Molei Tao , Yongxin Chen

Reinforcement learning (RL) has emerged as a powerful method for improving the reasoning abilities of large language models (LLMs). Outcome-based RL, which rewards policies solely for the correctness of the final answer, yields substantial…

机器学习 · 计算机科学 2025-09-09 Yuda Song , Julia Kempe , Remi Munos

U.S. discrimination law can impose liability on firms that fail to adopt a less discriminatory alternative (LDA): a decision policy that achieves the same business objectives while reducing disparate impact on legally protected groups.…

计算机与社会 · 计算机科学 2026-05-21 Chris Hays , Ben Laufer , Solon Barocas , Manish Raghavan

Regulatory efforts to protect against algorithmic bias have taken on increased urgency with rapid advances in large language models (LLMs), which are machine learning models that can achieve performance rivaling human experts on a wide…

应用统计 · 统计学 2024-04-05 Johann D. Gaebler , Sharad Goel , Aziz Huq , Prasanna Tambe

Reinforcement learning with verifiable rewards (RLVR) is a simple but powerful paradigm for training LLMs: sample a completion, verify it, and update. In practice, however, the verifier is almost never clean--unit tests probe only limited…

机器学习 · 计算机科学 2026-01-09 Ali Rad , Khashayar Filom , Darioush Keivan , Peyman Mohajerin Esfahani , Ehsan Kamalinejad

Diffusion policies are competitive for offline reinforcement learning (RL) but are typically guided at sampling time by heuristics that lack a statistical notion of risk. We introduce LRT-Diffusion, a risk-aware sampling rule that treats…

机器学习 · 计算机科学 2026-02-20 Ximan Sun , Xiang Cheng

Multi-agent LLM debate improves factuality and reasoning, but most recipes pick a fixed round count, over-spending on easy items and under-spending on hard ones. We adapt Wald's Sequential Probability Ratio Test (SPRT) as a plug-in compute…

机器学习 · 计算机科学 2026-05-20 Andrea Morandi

Risk-limiting post-election audits limit the chance of certifying an electoral outcome if the outcome is not what a full hand count would show. Building on previous work, we report on pilot risk-limiting audits in four elections during 2008…

Reinforcement Learning with Verifiable Rewards (RLVR) enhances Large Language Model (LLM) reasoning but suffers from advantage collapse on ``hard samples'' where all rollouts fail. This lack of variance eliminates crucial learning signals.…

机器学习 · 计算机科学 2026-05-08 Xinyu Lu , Kaiqi Zhang , Jinglin Yang , Boxi Cao , Yaojie Lu , Hongyu Lin , Min He , Xianpei Han , Le Sun

Vision-based reinforcement learning (RL) is a promising technique to solve control tasks involving images as the main observation. State-of-the-art RL algorithms still struggle in terms of sample efficiency, especially when using image…

机器学习 · 计算机科学 2021-09-29 Elie Aljalbout , Maximilian Ulmer , Rudolph Triebel

Job scheduling is widely used in real-world manufacturing systems to assign ordered job operations to machines under various constraints. Existing solutions remain limited by long running time or insufficient schedule quality, especially…

机器学习 · 计算机科学 2026-01-09 Zhengyi Kwan , Wei Zhang , Aik Beng Ng , Zhengkui Wang , Simon See

Recently, financial industry and regulators have enhanced the debate on the good properties of a risk measure. A fundamental issue is the evaluation of the quality of a risk estimation. On the one hand, a backtesting procedure is desirable…

风险管理 · 定量金融 2017-02-07 Matteo Burzoni , Ilaria Peri , Chiara Maria Ruffo

We study efficiency improvements in randomized experiments for estimating a vector of potential outcome means using regression adjustment (RA) when there are more than two treatment levels. We show that linear RA which estimates separate…

计量经济学 · 经济学 2025-01-13 Akanksha Negi , Jeffrey M. Wooldridge