English
Related papers

Related papers: Enhancing LLM Reasoning with Multi-Path Collaborat…

200 papers

Retrieval-Augmented Generation (RAG) has emerged as a powerful framework to overcome the knowledge limitations of Large Language Models (LLMs) by integrating external retrieval with language generation. While early RAG systems based on…

Artificial Intelligence · Computer Science 2025-06-13 Jintao Liang , Gang Su , Huifeng Lin , You Wu , Rui Zhao , Ziyue Li

Radiology visual question answering (RVQA) provides precise answers to questions about chest X-ray images, alleviating radiologists' workload. While recent methods based on multimodal large language models (MLLMs) and retrieval-augmented…

Artificial Intelligence · Computer Science 2025-08-06 Ziruo Yi , Jinyu Liu , Ting Xiao , Mark V. Albert

The rise of Large Language Models (LLMs) has sparked interest in their application to sequential recommendation tasks as they can provide supportive item information. However, due to the inherent complexities of sequential recommendation,…

Information Retrieval · Computer Science 2023-12-19 Yu Wang , Zhiwei Liu , Jianguo Zhang , Weiran Yao , Shelby Heinecke , Philip S. Yu

Large Reasoning Models (LRMs) demonstrate strong performance in complex tasks but often face the challenge of overthinking, leading to substantially high inference costs. Existing approaches synthesize shorter reasoning responses for LRMs…

Computation and Language · Computer Science 2026-03-02 Hexuan Deng , Wenxiang Jiao , Xuebo Liu , Jun Rao , Min Zhang

A key method for creating Artificial Intelligence (AI) agents is Reinforcement Learning (RL). However, constructing a standalone RL policy that maps perception to action directly encounters severe problems, chief among them being its lack…

Large language models (LLMs) serve as an active and promising field of generative artificial intelligence and have demonstrated abilities to perform complex tasks in multiple domains, including mathematical and scientific reasoning. In this…

Artificial Intelligence · Computer Science 2026-03-03 Ao Cheng , Lei Zhang , Guowei He

Video understanding is fundamental to tasks such as action recognition, video reasoning, and robotic control. Early video understanding methods based on large vision-language models (LVLMs) typically adopt a single-pass reasoning paradigm…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Yiyang Zhou , Yangfan He , Yaofeng Su , Siwei Han , Joel Jang , Gedas Bertasius , Mohit Bansal , Huaxiu Yao

Automated theorem proving is fundamental to formal methods, and the recent trend is to integrate large language models (LLMs) and proof assistants to form effective proof agents. While existing proof agents show promising performance, they…

Software Engineering · Computer Science 2026-04-22 Yican Sun , Chengwei Shi , Hangzhou Lyu , Yingfei Xiong

Large Language Models (LLMs) are increasingly being explored for building Agents capable of active environmental interaction (e.g., via tool use) to solve complex problems. Reinforcement Learning (RL) is considered a key technology with…

Computation and Language · Computer Science 2025-11-19 Mingyue Cheng , Jie Ouyang , Shuo Yu , Ruiran Yan , Yucong Luo , Zirui Liu , Daoyu Wang , Qi Liu , Enhong Chen

Cognitive Reframing, a core element of Cognitive Behavioral Therapy (CBT), helps individuals reinterpret negative experiences by finding positive meaning. Recent advances in Large Language Models (LLMs) have demonstrated improved…

Computation and Language · Computer Science 2025-04-02 Yilin Qi , Dong Won Lee , Cynthia Breazeal , Hae Won Park

Retrieval-Augmented Generation (RAG) lifts the factuality of Large Language Models (LLMs) by injecting external knowledge, yet it falls short on problems that demand multi-step inference; conversely, purely reasoning-oriented approaches…

Large Language Models (LLMs) have exhibited remarkable capabilities in many complex tasks including mathematical reasoning. However, traditional approaches heavily rely on ensuring self-consistency within single prompting method, which…

Computation and Language · Computer Science 2024-10-15 Gisang Lee , Sangwoo Park , Junyoung Park , Andrew Chung , Sieun Park , Yoonah Park , Byungju Kim , Min-gyu Cho

Recursive or looped language models have recently emerged as a new scaling axis by iteratively refining the same model computation over latent states to deepen reasoning. We extend such scaling principle from a single model to multi-agent…

Artificial Intelligence · Computer Science 2026-04-29 Xiyuan Yang , Jiaru Zou , Rui Pan , Ruizhong Qiu , Pan Lu , Shizhe Diao , Jindong Jiang , Hanghang Tong , Tong Zhang , Markus J. Buehler , Jingrui He , James Zou

Large Language Models (LLMs) often produce answers with a single chain-of-thought, which restricts their ability to explore reasoning paths or self-correct flawed outputs in complex tasks. In this paper, we introduce MALT (Multi-Agent LLM…

Applying reinforcement learning (RL) to real-world tasks requires converting informal descriptions into a formal Markov decision process (MDP), implementing an executable environment, and training a policy agent. Automating this process is…

Artificial Intelligence · Computer Science 2025-12-15 Hong Je-Gal , Chan-Bin Yi , Hyun-Suk Lee

The inference overhead induced by redundant reasoning undermines the interactive experience and severely bottlenecks the deployment of Large Reasoning Models. Existing reinforcement learning (RL)-based solutions tackle this problem by…

Artificial Intelligence · Computer Science 2026-01-30 Yiqun Chen , Jinyuan Feng , Wei Yang , Meizhi Zhong , Zhengliang Shi , Rui Li , Xiaochi Wei , Yan Gao , Yi Wu , Yao Hu , Zhiqiang Pu , Jiaxin Mao

Owing to recent advancements, Large Language Models (LLMs) can now be deployed as agents for increasingly complex decision-making applications in areas including robotics, gaming, and API integration. However, reflecting past experiences in…

Recent advancements in Multimodal Large Language Models (MLLMs) have incentivized models to ``think with images'' by actively invoking visual tools during multi-turn reasoning. The common Reinforcement Learning (RL) practice of relying on…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Wenhao Yang , Yu Xia , Jinlong Huang , Shiyin Lu , Qing-Guo Chen , Zhao Xu , Weihua Luo , Kaifu Zhang , Yuchen Zhou , Xiaobo Xia , Yuanyu Wan , Lijun Zhang , Tat-Seng Chua

Recent search-augmented LLMs trained with reinforcement learning (RL) can interleave searching and reasoning for multi-hop reasoning tasks. However, they face two critical failure modes as the accumulating context becomes flooded with both…

Computation and Language · Computer Science 2026-01-14 Kangcheng Luo , Tinglang Wu , Yansong Feng

Identifying the strategic uses of reformulation in discourse remains a key challenge for computational argumentation. While LLMs can detect surface-level similarity, they often fail to capture the pragmatic functions of rephrasing, such as…

Computation and Language · Computer Science 2026-03-18 Maciej Uberna , Michał Wawer , Jarosław A. Chudziak , Marcin Koszowy