English
Related papers

Related papers: Advancing Tool-Augmented Large Language Models via…

200 papers

Despite impressive advances in large language models (LLMs), existing benchmarks often focus on single-turn or single-step tasks, failing to capture the kind of iterative reasoning required in real-world settings. To address this…

Computation and Language · Computer Science 2025-11-26 Yiran Zhang , Mo Wang , Xiaoyang Li , Kaixuan Ren , Chencheng Zhu , Usman Naseem

This paper presents several novel findings on the explainability of vision reflection in large multimodal models (LMMs). First, we show that prompting an LMM to verify the prediction of a specialized vision model can improve recognition…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Guoyuan An , JaeYoon Kim , SungEui Yoon

Large language models (LLMs) excel at logical and algorithmic reasoning, yet their emotional intelligence (EQ) still lags far behind their cognitive prowess. While reinforcement learning from verifiable rewards (RLVR) has advanced in other…

Small Language Models (SLMs) are a cost-effective alternative to Large Language Models (LLMs), but often struggle with complex reasoning due to their limited capacity and a tendency to produce mistakes or inconsistent answers during…

Computation and Language · Computer Science 2025-08-19 Yuanfeng Xu , Zehui Dai , Jian Liang , Jiapeng Guan , Guangrun Wang , Liang Lin , Xiaohui Lv

Recent progress in large language models (LLMs) has been propelled by reinforcement learning with verifiable rewards (RLVR) and test-time scaling. However, the limited output length of LLMs constrains the depth of reasoning attainable in a…

Artificial Intelligence · Computer Science 2025-11-17 Shulin Liu , Dong Du , Tao Yang , Yang Li , Boyu Qiu

Reward Models (RMs) are critical components in the Reinforcement Learning from Human Feedback (RLHF) pipeline, directly determining the alignment quality of Large Language Models (LLMs). Recently, Generative Reward Models (GRMs) have…

Artificial Intelligence · Computer Science 2026-04-21 Kai Qin , Liangxin Liu , Yu Liang , Longzheng Wang , Yan Wang , Yueyang Zhang , Long Xia , Zhiyuan Sun , Houde Liu , Daiting Shi

Large language models (LLMs) have made significant advances in the field of natural language processing, but they still face challenges such as continuous decision-making, lack of long-term memory, and limited context windows in dynamic…

Computation and Language · Computer Science 2025-04-10 Xuechen Liang , Meiling Tao , Yinghui Xia , Jianhui Wang , Kun Li , Yijin Wang , Jingsong Yang , Tianyu Shi , Yuantao Wang , Miao Zhang , Xueqian Wang

We explore a method for improving the performance of large language models through self-reflection and reinforcement learning. By incentivizing the model to generate better self-reflections when it answers incorrectly, we demonstrate that a…

Computation and Language · Computer Science 2025-06-02 Shelly Bensal , Umar Jamil , Christopher Bryant , Melisa Russak , Kiran Kamble , Dmytro Mozolevskyi , Muayad Ali , Waseem AlShikh

Despite significant advancements in Large Language Models (LLMs) and Large Vision-Language Models (LVLMs), current models still face substantial challenges in handling complex, multi-turn, and visually-grounded tasks that demand deep…

Computation and Language · Computer Science 2025-08-22 Seungmin Han , Haeun Kwon , Ji-jun Park , Taeyang Yoon

The integration of tools in augmenting large language models presents a novel approach toward enhancing the efficiency and accuracy of these models in handling specific, complex tasks. This paper delves into the methodology,challenges, and…

Artificial Intelligence · Computer Science 2024-09-30 Zhuocheng Shen

Large Language Models (LLMs) struggle to automate real-world vulnerability detection due to two key limitations: the heterogeneity of vulnerability patterns undermines the effectiveness of a single unified model, and manual prompt…

Software Engineering · Computer Science 2026-01-28 Zihan Wu , Jie Xu , Yun Peng , Chun Yong Chong , Xiaohua Jia

Tool learning is increasingly important for large language models (LLMs) to effectively coordinate and utilize a diverse set of tools in order to solve complex real-world tasks. By selecting and integrating appropriate tools, LLMs extend…

Machine Learning · Computer Science 2026-01-21 Zheng Fang , Wolfgang Mayer , Zeyu Zhang , Jian Wang , Hong-Yu Zhang , Wanli Li , Zaiwen Feng

The emergence of large language models (LLMs) has revolutionized machine learning and related fields, showcasing remarkable abilities in comprehending, generating, and manipulating human language. However, their conventional usage through…

Computation and Language · Computer Science 2024-04-18 Andrea Bacciu , Florin Cuconasu , Federico Siciliano , Fabrizio Silvestri , Nicola Tonellotto , Giovanni Trappolini

Recent advancements in large language models (LLMs) have demonstrated that progressive refinement, rather than providing a single answer, results in more accurate and thoughtful outputs. However, existing methods often rely heavily on…

Computation and Language · Computer Science 2024-10-18 Chengyu Du , Jinyi Han , Yizhou Ying , Aili Chen , Qianyu He , Haokun Zhao , Sirui Xia , Haoran Guo , Jiaqing Liang , Zulong Chen , Liangyue Li , Yanghua Xiao

This critical review provides an in-depth analysis of Large Language Models (LLMs), encompassing their foundational principles, diverse applications, and advanced training methodologies. We critically examine the evolution from Recurrent…

Artificial Intelligence · Computer Science 2025-09-29 Milad Moradi , Ke Yan , David Colwell , Matthias Samwald , Rhona Asgari

Large language models (LLMs) have shown remarkable performance across a wide range of natural language tasks. However, a critical challenge remains in that they sometimes generate factually incorrect answers. To address this, while many…

Computation and Language · Computer Science 2025-09-22 Joonho Ko , Jinheon Baek , Sung Ju Hwang

Large language models (LLMs) possess strong semantic understanding, driving significant progress in data mining applications. This is further enhanced by large reasoning models (LRMs), which provide explicit multi-step reasoning traces. On…

Machine Learning · Computer Science 2026-04-07 Aobo Chen , Chenxu Zhao , Chenglin Miao , Mengdi Huai

Large Language Model (LLM) reasoning for complex tasks inherently involves a trade-off between solution accuracy and computational efficiency. The subsequent step of verification, while intended to improve performance, further complicates…

Artificial Intelligence · Computer Science 2025-05-20 Jianyuan Zhong , Zeju Li , Zhijian Xu , Xiangyu Wen , Kezhi Li , Qiang Xu

Multi-modal large language models (MLLMs) have demonstrated significant progress in reasoning capabilities and shown promising effectiveness in video anomaly understanding (VAU) tasks. However, existing MLLM-based approaches remain largely…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Zihao Zhao , Shengting Cao , Muchao Ye

In the era of Vision-Language Models (VLMs), enhancing multimodal reasoning capabilities remains a critical challenge, particularly in handling ambiguous or complex visual inputs, where initial inferences often lead to hallucinations or…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Haoyu Zhang , Yuwei Wu , Pengxiang Li , Xintong Zhang , Zhi Gao , Rui Gao , Mingyang Gao , Che Sun , Yunde Jia