English
Related papers

Related papers: OctoTools: An Agentic Framework with Extensible To…

200 papers

Multimodal large language models (MLLMs) have shown strong capabilities but remain limited to fixed modality pairs and require costly fine-tuning with large aligned datasets. Building fully omni-capable models that can integrate text,…

Artificial Intelligence · Computer Science 2025-11-06 Huawei Lin , Yunzhi Shi , Tong Geng , Weijie Zhao , Wei Wang , Ravender Pal Singh

Recent advances in Large Language Models (LLMs) demonstrate that chain-of-thought prompting and deep reasoning substantially enhance performance on complex tasks, and multi-agent systems can further improve accuracy by enabling model…

Artificial Intelligence · Computer Science 2025-10-16 Zehui Ling , Deshu Chen , Yichi Zhang , Yuchen Liu , Xigui Li , Xin Guo , Yuan Cheng

To achieve faithful reasoning that aligns with human expectations, large language models (LLMs) need to ground their reasoning to real-world knowledge (e.g., web facts, math and physical rules). Tools help LLMs access this external…

Modern coding scaffolds turn LLMs into capable software agents, but their ability to follow scaffold-specified instructions remains under-examined, especially when constraints are heterogeneous and persist across interactions. To fill this…

High-quality and carefully curated data is a cornerstone of training medical large language models, as it directly impacts both generalization and robustness to unseen clinical tasks. We investigate strategies for training and data curation…

Artificial Intelligence · Computer Science 2025-12-01 Timothy Ossowski , Sheng Zhang , Qianchu Liu , Guanghui Qin , Reuben Tan , Tristan Naumann , Junjie Hu , Hoifung Poon

Chain-of-thought prompting significantly boosts the reasoning ability of large language models but still faces three issues: hallucination problem, restricted interpretability, and uncontrollable generation. To address these challenges, we…

Computation and Language · Computer Science 2024-09-20 Chen Liang , Zhifan Feng , Zihe Liu , Wenbin Jiang , Jinan Xu , Yufeng Chen , Yong Wang

AI agents have become increasingly significant in various domains, enabling autonomous decision-making and problem-solving. To function effectively, these agents require a planning process that determines the best course of action and then…

Computation and Language · Computer Science 2024-06-27 Wei Chen , Zhiyuan Li , Zhen Guo , Yikang Shen

Multi-agent large language model frameworks are promising for complex multi step reasoning, yet existing systems remain weak for scientific and knowledge intensive domains due to static prompts and agent roles, rigid workflows, and…

Artificial Intelligence · Computer Science 2026-03-04 Yichao Feng , Haoran Luo , Zhenghong Lin , Yiqun Sun , Pengfei Wei , Lawrence B. Hsieh , Anh Tuan Luu

Video understanding requires active evidence seeking, motivating tool-augmented video agents for temporal reasoning, cross-modal understanding, and complex question answering. Existing video agents have improved video reasoning with…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Xiao Liu , Nayu Liu , Junnan Zhu , Ruirui Chen , Guohui Xiang , Changjian Wang , Kaiwen Wei , Rongzhen Li , Jiang Zhong

Existing agents based on large language models (LLMs) demonstrate robust problem-solving capabilities by integrating LLMs' inherent knowledge, strong in-context learning and zero-shot capabilities, and the use of tools combined with…

Artificial Intelligence · Computer Science 2024-07-17 Yulong Wang , Tianhao Shen , Lifeng Liu , Jian Xie

Vision language models (VLMs) are increasingly deployed as controllers with access to external tools for complex reasoning and decision-making, yet their effectiveness remains limited by the scarcity of high-quality multimodal trajectories…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 Tajamul Ashraf , Umair Nawaz , Abdelrahman M. Shaker , Rao Anwer , Philip Torr , Fahad Shahbaz Khan , Salman Khan

Large Language Models (LLMs) have demonstrated impressive capabilities as intelligent agents capable of solving complex problems. However, effective planning in scenarios involving dependencies between API or tool calls-particularly in…

With the development of artificial intelligence (AI), large language models (LLM) are widely used in many fields. However, the reasoning ability of LLM is still very limited when it comes to mathematical reasoning. Mathematics plays an…

Computation and Language · Computer Science 2024-08-06 Wenbei Xie , Donglin Liu , Haoran Yan , Wenjie Wu , Zongyang Liu

Agent systems based on large language models (LLMs) have shown great potential in complex reasoning tasks, but building efficient and generalizable workflows remains a major challenge. Most existing approaches rely on manually designed…

Computation and Language · Computer Science 2025-10-01 Yanbo Wang , Zixiang Xu , Yue Huang , Xiangqi Wang , Zirui Song , Lang Gao , Chenxi Wang , Xiangru Tang , Yue Zhao , Arman Cohan , Xiangliang Zhang , Xiuying Chen

Reasoning is a fundamental capability for solving complex multi-step problems, particularly in visual contexts where sequential step-wise understanding is essential. Existing approaches lack a comprehensive framework for evaluating visual…

Large language models (LLMs) can perform complex reasoning in few- and zero-shot settings by generating intermediate chain of thought (CoT) reasoning steps. Further, each reasoning step can rely on external tools to support computation…

Computation and Language · Computer Science 2023-03-17 Bhargavi Paranjape , Scott Lundberg , Sameer Singh , Hannaneh Hajishirzi , Luke Zettlemoyer , Marco Tulio Ribeiro

Multimodal Large Language Models (MLLMs) have shown impressive performance on vision-language tasks, but their long Chain-of-Thought (CoT) capabilities in multimodal scenarios remain underexplored. Inspired by OpenAI's o3 model, which…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Ye Wang , Qianglong Chen , Zejun Li , Siyuan Wang , Shijie Guo , Zhirui Zhang , Zhongyu Wei

Despite their powerful text generation capabilities, large language models (LLMs) still struggle to effectively utilize external tools to solve complex tasks, a challenge known as tool learning. Existing methods primarily rely on supervised…

Computation and Language · Computer Science 2025-08-19 Yuanqing Yu , Zhefan Wang , Weizhi Ma , Shuai Wang , Chuhan Wu , Zhiqiang Guo , Min Zhang

Current Large Language Model (LLM) agents demonstrate strong reasoning and tool use capabilities, but often lack self-awareness, failing to balance these approaches effectively. This imbalance leads to Tool Overuse, where models…

Artificial Intelligence · Computer Science 2025-05-27 Cheng Qian , Emre Can Acikgoz , Hongru Wang , Xiusi Chen , Avirup Sil , Dilek Hakkani-Tür , Gokhan Tur , Heng Ji

Enhancing the mathematical reasoning of large language models (LLMs) demands high-quality training data, yet conventional methods face critical challenges in scalability, cost, and data reliability. To address these limitations, we propose…

Computation and Language · Computer Science 2025-08-27 Sirui Chen , Changxin Tian , Binbin Hu , Kunlong Chen , Ziqi Liu , Zhiqiang Zhang , Jun Zhou