中文
相关论文

相关论文: Sequential Consensus for Multi-Agent LLM Debates: …

200 篇论文

Prompt engineering is crucial for fully leveraging large language models (LLMs), yet most existing optimization methods follow a single trajectory, resulting in limited adaptability, gradient conflicts, and high computational overhead. We…

人工智能 · 计算机科学 2026-02-04 Yichen Han , Yuhang Han , Siteng Huang , Guanyu Liu , Zhengpeng Zhou , Bojun Liu , Yujia Zhang , Isaac N Shi , Lewei He , Tianyu Shi

Tabular anomaly detection is often handled by single detectors or static ensembles, even though strong performance on tabular data typically comes from heterogeneous model families (e.g., tree ensembles, deep tabular networks, and tabular…

机器学习 · 计算机科学 2026-02-17 Pinqiao Wang , Sheng Li

Outcome-reward reinforcement learning (RL) is a common and increasingly significant way to refine the step-by-step reasoning of multimodal large language models (MLLMs). In the multiple-choice setting - a dominant format for multimodal…

计算机视觉与模式识别 · 计算机科学 2025-11-14 Jiahao Wang , Weiye Xu , Aijun Yang , Wengang Zhou , Lewei Lu , Houqiang Li , Xiaohua Wang , Jinguo Zhu

Scaling test-time computation with reinforcement learning (RL) has emerged as a reliable path to improve large language models (LLM) reasoning ability. Yet, outcome-based reward often incentivizes models to be overconfident, leading to…

机器学习 · 计算机科学 2026-04-28 Liaoyaqi Wang , Chunsheng Zuo , William Jurayj , Benjamin Van Durme , Anqi Liu

Large Language Models (LLMs) have achieved remarkable success on reasoning benchmarks through Reinforcement Learning with Verifiable Rewards (RLVR), excelling at tasks such as math, coding, logic, and puzzles. However, existing benchmarks…

人工智能 · 计算机科学 2026-05-12 Xiaozhe Li , Xinyu Fang , Shengyuan Ding , Yang Li , Linyang Li , Haodong Duan , Qingwen Liu , Kai Chen

Large language models (LLMs) achieve impressive performance when a task is fully specified in a single turn, yet the same models lose up to 39% of that performance when the identical task is revealed incrementally across multiple turns, a…

计算与语言 · 计算机科学 2026-05-27 Ramakrishna Vamsi Setti , Jagadeesh Rachapudi , Sachin Chaudhary , Praful Hambarde , Amit Shukla

As Industry 4.0 transforms the food industry, the role of software in achieving compliance with food-safety regulations is becoming increasingly critical. Food-safety regulations, like those in many legal domains, have largely been…

软件工程 · 计算机科学 2025-01-27 Shabnam Hassani , Mehrdad Sabetzadeh , Daniel Amyot

The advent of tool-using LLM agents shifts safety monitoring from output moderation to auditing long, noisy interaction trajectories, where risk-critical evidence is sparse-making standard binary supervision poorly suited for credit…

机器学习 · 计算机科学 2026-04-07 Lin Wang , Junfeng Fang , Dan Zhang , Fei Shen , Xiang Wang , Tat-Seng Chua

Large language models (LLMs) have demonstrated their remarkable performance across various language understanding tasks. While emerging benchmarks have been proposed to evaluate LLMs in various domains such as mathematics and computer…

人工智能 · 计算机科学 2024-10-28 Junnan Dong , Zijin Hong , Yuanchen Bei , Feiran Huang , Xinrun Wang , Xiao Huang

The rapid advancement of Large Language Models (LLMs) presents new opportunities for automated software vulnerability detection, a crucial task in securing modern codebases. This paper presents a comparative study on the effectiveness of…

软件工程 · 计算机科学 2026-01-05 Md Hasan Saju , Maher Muhtadi , Akramul Azim

Real-time sequential control agents are often bottlenecked by inference latency. Even modest per-step planning delays can destabilize control and degrade overall performance. We propose a speculation-and-correction framework that adapts the…

人工智能 · 计算机科学 2025-12-22 Ziyang Lin , Zixuan Sun , Sanhorn Chen , Xiaoyang Chen , Roy Zhao

While LLM-as-a-Judge is widely used in automated evaluation, existing validation practices primarily operate at the level of observed outputs, offering limited insight into whether LLM judges themselves function as stable and reliable…

人工智能 · 计算机科学 2026-02-03 Junhyuk Choi , Sohhyung Park , Chanhee Cho , Hyeonchu Park , Bugeun Kim

Large language models (LLMs) have achieved impressive performance across various mathematical reasoning benchmarks. However, there are increasing debates regarding whether these models truly understand and apply mathematical knowledge or…

计算与语言 · 计算机科学 2024-07-03 Qintong Li , Leyang Cui , Xueliang Zhao , Lingpeng Kong , Wei Bi

The use of LLMs as automated judges ("LLM-as-a-judge") is now widespread, yet standard judges suffer from a multitude of reliability issues. To address these challenges, we introduce Verdict, an open-source library for scaling judge-time…

计算与语言 · 计算机科学 2025-11-06 Nimit Kalra , Leonard Tang

The paradigm of large language model (LLM) reasoning is shifting from parameter scaling to test-time compute scaling, yet many existing approaches still rely on uniform brute-force sampling (for example, fixed best-of-N or self-consistency)…

人工智能 · 计算机科学 2026-03-02 Siyuan Ma , Bo Gao , Xiaojun Jia , Simeng Qin , Tianlin Li , Ke Ma , Xiaoshuang Jia , Wenqi Ren , Yang Liu

Evaluating the conversational abilities of large language models (LLMs) remains a challenging task. Current mainstream approaches primarily rely on the "LLM-as-a-judge" paradigm, where an LLM is prompted to serve as an evaluator to assess…

计算与语言 · 计算机科学 2026-01-07 Yuqi Tang , Kehua Feng , Yunfeng Wang , Zhiwen Chen , Chengfei Lv , Gang Yu , Qiang Zhang , Keyan Ding , Huajun Chen

The advent of large language models (LLMs) has dramatically advanced the state-of-the-art in numerous natural language generation tasks. For LLMs to be applied reliably, it is essential to have an accurate measure of their confidence.…

计算与语言 · 计算机科学 2024-06-05 Zhen Lin , Shubhendu Trivedi , Jimeng Sun

In this study, we explore a collaborative multi-agent stochastic linear bandit setting involving a network of $N$ agents that communicate locally to minimize their collective regret while keeping their expected cost under a specified…

机器学习 · 计算机科学 2024-10-24 Amirhossein Afsharrad , Parisa Oftadeh , Ahmadreza Moradipari , Sanjay Lall

Boundary value analysis and testing (BVT) is fundamental in software quality assurance because faults tend to cluster at input extremes, yet testers often struggle to understand and justify why certain input-output pairs represent…

软件工程 · 计算机科学 2026-02-02 Sabinakhon Akbarova , Felix Dobslaw , Robert Feldt

Large language models (LLMs) are increasingly applied as automatic evaluators for natural language generation assessment often using pairwise comparative judgements. Existing approaches typically rely on single judges or aggregate multiple…

计算与语言 · 计算机科学 2026-05-29 Mengjie Qian , Guangzhi Sun , Mark J. F. Gales , Kate M. Knill