中文
相关论文

相关论文: ToolOmni: Enabling Open-World Tool Use via Agentic…

200 篇论文

Tool use enables large language models (LLMs) to access external information, invoke software systems, and act in digital environments beyond what can be solved from model parameters alone. Early research mainly studied whether a model…

Agents utilizing tools powered by large language models (LLMs) or vision-language models (VLMs) have demonstrated remarkable progress in diverse tasks across text and visual modalities. Unlike traditional tools such as calculators, which…

计算与语言 · 计算机科学 2025-10-09 Yunzhong Xiao , Yangmin Li , Hewei Wang , Yunlong Tang , Zora Zhiruo Wang

Multimodal large language models (MLLMs) have shown strong capabilities but remain limited to fixed modality pairs and require costly fine-tuning with large aligned datasets. Building fully omni-capable models that can integrate text,…

人工智能 · 计算机科学 2025-11-06 Huawei Lin , Yunzhi Shi , Tong Geng , Weijie Zhao , Wei Wang , Ravender Pal Singh

Training Large Language Models (LLMs) with Group Relative Policy Optimization (GRPO) encounters a significant challenge: models often fail to produce accurate responses, particularly in small-scale architectures. This limitation not only…

计算与语言 · 计算机科学 2025-10-10 Fu Chen , Peng Wang , Xiyin Li , Wen Li , Shichi Lei , Dongdong Xiang

Large Language Model (LLM)-based multi-agent systems show promise for automating real-world tasks but struggle to transfer across domains due to their domain-specific nature. Current approaches face two critical shortcomings: they require…

Agentic AI enables LLM to dynamically reason, plan, and interact with tools to solve complex tasks. However, agentic workflows often require many iterative reasoning steps and tool invocations, leading to significant operational expense,…

人工智能 · 计算机科学 2026-02-03 Sami Abuzakuk , Anne-Marie Kermarrec , Rishi Sharma , Rasmus Moorits Veski , Martijn de Vos

While achieving remarkable progress in a broad range of tasks, large language models (LLMs) remain significantly limited in properly using massive external tools. Existing in-context learning approaches simply format tools into a list of…

人工智能 · 计算机科学 2024-03-05 Xukun Liu , Zhiyuan Peng , Xiaoyuan Yi , Xing Xie , Lirong Xiang , Yuchen Liu , Dongkuan Xu

Agentic AI will be an essential enabling technology for designing future mobile communication systems, which could provide flexible and customized services, automate complex network operations, and drive autonomous decision-making across…

网络与互联网体系结构 · 计算机科学 2026-05-05 Purna Sai Garigipati , Onur Ayan , Kishor Chandra Joshi , Xueli An

Tool learning has emerged as a crucial capability for large language models (LLMs) to solve complex real-world tasks through interaction with external tools. Existing approaches face significant challenges, including reliance on…

计算与语言 · 计算机科学 2025-06-02 Hanxing Ding , Shuchang Tao , Liang Pang , Zihao Wei , Jinyang Gao , Bolin Ding , Huawei Shen , Xueqi Cheng

Large Language Model (LLM) agents have developed rapidly in recent years to solve complex real-world problems using external tools. However, the scarcity of high-quality trajectories still hinders the development of stronger LLM agents.…

人工智能 · 计算机科学 2025-12-08 Chen Yang , Ran Le , Yun Xing , Zhenwei An , Zongchao Chen , Wayne Xin Zhao , Yang Song , Tao Zhang

Utilizing tools with Large Language Models (LLMs) is essential for grounding AI agents in real-world applications. The prevailing approach involves few-shot prompting with demonstrations or fine-tuning with expert annotations. However, mere…

计算与语言 · 计算机科学 2024-10-10 Xiaohan Wang , Dian Li , Yilin Zhao , Sinbadliu , Hui Wang

Large Language Models (LLMs) can be seen as compressed knowledge bases, but it remains unclear what knowledge they truly contain and how far their knowledge boundary extends. Existing benchmarks are mostly static and provide limited support…

机器学习 · 计算机科学 2026-05-27 Yuheng Yang , Siqi Zhu , Tao Feng , Ge Liu , Jiaxuan You

The integration of Large Language Models (LLMs) into software engineering has driven a transition from traditional rule-based systems to autonomous agentic systems capable of solving complex problems. However, systematic progress is…

Large Language Models (LLMs) have become a popular interface for human-AI interaction, supporting information seeking and task assistance through natural, multi-turn dialogue. To respond to users within multi-turn dialogues, the…

计算与语言 · 计算机科学 2026-04-16 Fengran Mo , Yifan Gao , Sha Li , Hansi Zeng , Xin Liu , Zhaoxuan Tan , Xian Li , Jianshu Chen , Dakuo Wang , Meng Jiang

A burgeoning area within reinforcement learning (RL) is the design of sequential decision-making agents centered around large language models (LLMs). While autonomous decision-making agents powered by modern LLMs could facilitate numerous…

机器学习 · 计算机科学 2026-02-10 Dilip Arumugam , Thomas L. Griffiths

Large Language Models (LLMs) like GPT-4 have revolutionized natural language processing, showing remarkable linguistic proficiency and reasoning capabilities. However, their application in strategic multi-agent decision-making environments…

计算与语言 · 计算机科学 2024-05-29 Chuanhao Li , Runhan Yang , Tiankai Li , Milad Bafarassat , Kourosh Sharifi , Dirk Bergemann , Zhuoran Yang

Large language model (LLM) agents are moving beyond prompting alone. ChatGPT marked the rise of general-purpose LLM assistants, DeepSeek showed that on-policy reinforcement learning with verifiable rewards can improve reasoning and tool…

Omni-modal reasoning is essential for intelligent systems to understand and draw inferences from diverse data sources. While existing omni-modal large language models (OLLM) excel at perceiving diverse modalities, they lack the complex…

计算机视觉与模式识别 · 计算机科学 2026-03-24 Yiran Guan , Sifan Tu , Dingkang Liang , Linghao Zhu , Jianzhong Ju , Zhenbo Luo , Jian Luan , Yuliang Liu , Xiang Bai

Large language models (LLMs) demonstrate strong mathematical reasoning, but reliance on closed-source APIs for OR tasks raises privacy concerns, and training open-source models from scratch incurs high compute costs. We introduce…

人工智能 · 计算机科学 2025-10-03 Jianzhang Zhang , Jialong Zhou , Chuang Liu

Outcome-driven reinforcement learning has advanced reasoning in large language models (LLMs), but prevailing tool-augmented approaches train a single, monolithic policy that interleaves thoughts and tool calls under full context; this…

人工智能 · 计算机科学 2025-10-08 Zhuofeng Li , Haoxiang Zhang , Seungju Han , Sheng Liu , Jianwen Xie , Yu Zhang , Yejin Choi , James Zou , Pan Lu