English
Related papers

Related papers: Multi-Agent Verification: Scaling Test-Time Comput…

200 papers

The advancement of large language models (LLMs) has enabled the construction of multi-agent systems to solve complex tasks by dividing responsibilities among specialized agents, such as a planning agent for subgoal generation and a…

Computation and Language · Computer Science 2025-09-12 Minghang Zhu , Zhengliang Shi , Zhiwei Xu , Shiguang Wu , Lingjie Wang , Pengjie Ren , Zhaochun Ren , Zhumin Chen

Visual compliance verification is a critical yet underexplored problem in computer vision, especially in domains such as media, entertainment, and advertising where content must adhere to complex and evolving policy rules. Existing methods…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Rahul Ghosh , Baishali Chaudhury , Hari Prasanna Das , Meghana Ashok , Ryan Razkenari , Long Chen , Sungmin Hong , Chun-Hao Liu

Recent advancements in Large Language Models (LLMs) have created new opportunities to enhance performance on complex reasoning tasks by leveraging test-time computation. However, existing scaling methods have key limitations: parallel…

Artificial Intelligence · Computer Science 2025-12-04 Jiefeng Chen , Jie Ren , Xinyun Chen , Chengrun Yang , Ruoxi Sun , Jinsung Yoon , Sercan Ö Arık

Large language models (LLMs) achieve impressive abilities in numerous domains, but exhibit inconsistent performance in response to minor input changes. Rather than view this as a drawback, in this paper we introduce a novel method for…

Machine Learning · Computer Science 2025-05-21 Uri Dalal , Meirav Segal , Zvika Ben-Haim , Dan Lahav , Omer Nevo

Contrastive decoding strategies are widely used to mitigate object hallucinations in multimodal large language models (MLLMs). By reducing over-reliance on language priors, these strategies ensure that generated content remains closely…

Computer Vision and Pattern Recognition · Computer Science 2025-05-28 Hao Yin , Guangzong Si , Zilei Wang

In this study, a new ensemble approach for classifiers is introduced. A verification method for better error elimination is developed through the integration of multiple classifiers. A multi-agent system comprised of multiple classifiers is…

Artificial Intelligence · Computer Science 2022-06-03 Amirhoshang Hoseinpour Dehkordi , Majid Alizadeh , Ali Movaghar

Recent advances in test-time scaling have shown promising results in improving Large Language Model (LLM) performance through strategic computation allocation during inference. While this approach has demonstrated strong improvements in…

Computation and Language · Computer Science 2025-05-21 Juntai Cao , Xiang Zhang , Raymond Li , Chuyuan Li , Chenyu You , Shafiq Joty , Giuseppe Carenini

Although speaker verification has conventionally been an audio-only task, some practical applications provide both audio and visual streams of input. In these cases, the visual stream provides complementary information and can often be…

Sound · Computer Science 2021-02-15 Leda Sarı , Kritika Singh , Jiatong Zhou , Lorenzo Torresani , Nayan Singhal , Yatharth Saraf

We find that, simply via a sampling-and-voting method, the performance of large language models (LLMs) scales with the number of agents instantiated. Also, this method, termed as Agent Forest, is orthogonal to existing complicated methods…

Computation and Language · Computer Science 2024-10-14 Junyou Li , Qin Zhang , Yangbin Yu , Qiang Fu , Deheng Ye

As the Virtual Reality (VR) industry expands, the need for automated GUI testing is growing rapidly. Large Language Models (LLMs), capable of retaining information long-term and analyzing both visual and textual data, are emerging as a…

Software Engineering · Computer Science 2025-09-30 Zhenyu Qi , Haotang Li , Hao Qin , Kebin Peng , Sen He , Xue Qin

Test-time scaling via solution sampling and aggregation has become a key paradigm for improving the reasoning performance of Large Language Models (LLMs). While reward model selection is commonly employed in this approach, it often fails to…

Machine Learning · Computer Science 2025-09-30 Zhicheng Yang , Zhijiang Guo , Yinya Huang , Yongxin Wang , Yiwei Wang , Xiaodan Liang , Jing Tang

On-screen learning behavior provides valuable insights into how students seek, use, and create information during learning. Analyzing on-screen behavioral engagement is essential for capturing students' cognitive and collaborative…

Artificial Intelligence · Computer Science 2026-04-07 Likai Peng , Shihui Feng

With recent advances in multi-modal foundation models, the previously text-only large language models (LLM) have evolved to incorporate visual input, opening up unprecedented opportunities for various applications in visualization. Our work…

Human-Computer Interaction · Computer Science 2023-12-08 Shusen Liu , Haichao Miao , Zhimin Li , Matthew Olson , Valerio Pascucci , Peer-Timo Bremer

Reinforcement learning with verifiable rewards (RLVR) has advanced the reasoning capabilities of large language models. However, existing methods rely solely on outcome rewards, without explicitly optimizing verification or leveraging…

Software Engineering · Computer Science 2025-10-22 Yiyang Jin , Kunzhao Xu , Hang Li , Xueting Han , Yanmin Zhou , Cheng Li , Jing Bai

Scaling test-time computation improves large language model performance without additional training. Recent work demonstrates that techniques such as repeated sampling, self-verification, and self-reflection can significantly enhance task…

Artificial Intelligence · Computer Science 2025-12-15 Dongwon Jung , Peng Shi , Yi Zhang

Verifiers can improve language model capabilities by scoring and ranking responses from generated candidates. Currently, high-quality verifiers are either unscalable (e.g., humans) or limited in utility (e.g., tools like Lean). While LM…

Large Language Models (LLMs) and Visual Language Models (VLMs) are attracting increasing interest due to their improving performance and applications across various domains and tasks. However, LLMs and VLMs can produce erroneous results,…

Artificial Intelligence · Computer Science 2024-12-31 Michele Brienza , Francesco Argenziano , Vincenzo Suriani , Domenico D. Bloisi , Daniele Nardi

Large language models (LLMs) have shown increasing competence in solving mathematical reasoning problems. However, many open-source LLMs still struggle with errors in calculation and semantic understanding during intermediate reasoning…

Computation and Language · Computer Science 2024-12-18 Vernon Y. H. Toh , Deepanway Ghosal , Soujanya Poria

Despite improvements in automatic speaker verification (ASV), vulnerability against spoofing attacks remains a major concern. In this study, we investigate the integration of ASV and countermeasure (CM) subsystems into a modular spoof-aware…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-17 Oguzhan Kurnaz , Tomi Kinnunen , Cemal Hanilci

We present a novel approach for claim verification from tabular data documents. Recent LLM-based approaches either employ complex pretraining/fine-tuning or decompose verification into subtasks, often lacking comprehensive explanations and…

Computation and Language · Computer Science 2026-04-21 Rudra Ranajee Saha , Laks V. S. Lakshmanan , Raymond T. Ng