English
Related papers

Related papers: UniToolCall: Unifying Tool-Use Representation, Dat…

200 papers

Existing GUI agent models relying on coordinate-based one-step visual grounding struggle with generalizing to varying input resolutions and aspect ratios. Alternatives introduce coordinate-free strategies yet suffer from learning under…

Machine Learning · Computer Science 2026-02-04 Xiaoce Wang , Guibin Zhang , Junzhe Li , Jinzhe Tu , Chun Li , Ming Li

Large language models (LLMs) combined with tool learning have gained impressive results in real-world applications. During tool learning, LLMs may call multiple tools in nested orders, where the latter tool call may take the former response…

Computation and Language · Computer Science 2025-01-08 Han Han , Tong Zhu , Xiang Zhang , Mengsong Wu , Hao Xiong , Wenliang Chen

Large Language Models (LLMs) are increasingly used for code generation, yet quantum code generation is still evaluated mostly within single frameworks, making it difficult to separate quantum reasoning from framework familiarity. We…

Large language model (LLM) agents are moving beyond prompting alone. ChatGPT marked the rise of general-purpose LLM assistants, DeepSeek showed that on-policy reinforcement learning with verifiable rewards can improve reasoning and tool…

Large language models (LLMs) have demonstrated exceptional reasoning capabilities, enabling them to solve various complex problems. Recently, this ability has been applied to the paradigm of tool learning. Tool learning involves providing…

Artificial Intelligence · Computer Science 2025-08-18 Yanming Liu , Xinyue Peng , Jiannan Cao , Yuwei Zhang , Xuhong Zhang , Sheng Cheng , Xun Wang , Jianwei Yin , Tianyu Du

Automated intrusion-style workflows require LLM agents to reason over partial observations, tool outputs, and executable artifacts under bounded budgets. A single LLM instance often compresses evidence extraction, planning, execution, and…

Cryptography and Security · Computer Science 2026-05-12 Minfeng Qi , Tianqing Zhu , Zijie Xu , Congcong Zhu , Qin Wang , Wanlei Zhou

We introduce CollabToolBuilder, a flexible multiagent LLM framework with expert-in-the-loop (HITL) guidance that iteratively learns to create tools for a target goal, aligning with human intent and process, while minimizing time for…

Artificial Intelligence · Computer Science 2025-12-02 Daull Xavier , Patrice Bellot , Emmanuel Bruno , Vincent Martin , Elisabeth Murisasco

Tool invocation is a crucial mechanism for extending the capabilities of Large Language Models (LLMs) and has recently garnered significant attention. It enables LLMs to solve complex problems through tool calls while accessing up-to-date…

Computation and Language · Computer Science 2025-05-08 Xu Huang , Yuefeng Huang , Weiwen Liu , Xingshan Zeng , Yasheng Wang , Ruiming Tang , Hong Xie , Defu Lian

Humans possess a unified cognitive ability to perceive, comprehend, and interact with the physical world. Why can't large language models replicate this holistic understanding? Through a systematic analysis of existing training paradigms in…

Tool-calling empowers Large Language Models (LLMs) to interact with external environments. However, current methods often struggle to handle massive and noisy candidate tools in long-context tool-calling tasks, limiting their real-world…

Computation and Language · Computer Science 2026-03-13 Kunfeng Chen , Qihuang Zhong , Juhua Liu , Bo Du , Dacheng Tao

Training tool-use agents typically relies on outcome-based filtering: Supervised Fine-Tuning (SFT) on successful trajectories and Reinforcement Learning (RL) on pass-rate-selected tasks. However, this paradigm ignores interaction dynamics:…

Machine Learning · Computer Science 2026-03-03 Jinluan Yang , Yuxin Liu , Zhengyu Chen , Chengcheng Han , Yueqing Sun , Qi Gu , Hui Su , Xunliang Cai , Fei Wu , Kun Kuang

Large language models (LLMs) have significantly advanced natural language processing, particularly through the integration of external tools and APIs. However, their effectiveness is frequently hampered by parameter mis-filling during tool…

Computation and Language · Computer Science 2025-06-03 Yue Cui , Liuyi Yao , Shuchang Tao , Weijie Shi , Yaliang Li , Bolin Ding , Xiaofang Zhou

LLM-based multi-agent systems decompose complex tasks into interacting roles, but most remain manually orchestrated by prompts, tools, and control rules, while agents are rarely optimized through a unified reinforcement learning interface.…

Artificial Intelligence · Computer Science 2026-05-27 Yiqun Chen , Wei Yang , Erhan Zhang , Shijie Wang , Qi Liu , Zechun Niu , Bin Zhang , Haitao Li , Rui Li , Lingyong Yan , Jinyuan Feng , Biqing Qi , Xiaochi Wei , Yan Gao , Yi Wu , Yao Hu , Jiaxin Mao

Evaluating Large Language Models (LLMs) is one of the most critical aspects of building a performant compound AI system. Since the output from LLMs propagate to downstream steps, identifying LLM errors is crucial to system performance. A…

Large language models (LLMs) have advanced virtual educators and learners, bridging NLP with AI4Education. Existing work often lacks scalability and fails to leverage diverse, large-scale course content, with limited frameworks for…

Artificial Intelligence · Computer Science 2025-09-08 Jiahuan Pei , Fanghua Ye , Xin Sun , Wentao Deng , Koen Hindriks , Junxiao Wang

Solving problems through tool use under explicit constraints constitutes a highly challenging yet unavoidable scenario for large language models (LLMs), requiring capabilities such as function calling, instruction following, and…

Computation and Language · Computer Science 2026-03-17 Junjie Ye , Guoqiang Zhang , Wenjie Fu , Tao Gui , Qi Zhang , Xuanjing Huang

Using intelligent systems to perceive psychological and social behaviors, that is, the underlying affective, cognitive, and pathological states that are manifested through observable behaviors and social interactions, remains a challenge…

Artificial Intelligence · Computer Science 2026-02-13 Keane Ong , Wei Dai , Carol Li , Dewei Feng , Hengzhi Li , Jingyao Wu , Jiaee Cheong , Rui Mao , Gianmarco Mengaldo , Erik Cambria , Paul Pu Liang

The deployment of agent systems in an enterprise environment is often hindered by several challenges: common models lack domain-specific process knowledge, leading to disorganized plans, missing key tools, and poor execution stability. To…

Enterprises possess a vast array of API assets scattered across various functions, forming the backbone of existing business processes. By leveraging these APIs as functional tools, enterprises can design diverse, scenario-specific agent…

Artificial Intelligence · Computer Science 2024-12-23 Guancheng Zeng , Wentao Ding , Beining Xu , Chi Zhang , Wenqiang Han , Gang Li , Jingjing Mo , Pengxu Qiu , Xinran Tao , Wang Tao , Haowen Hu

A broad use case of large language models (LLMs) is in goal-directed decision-making tasks (or "agent" tasks), where an LLM needs to not just generate completions for a given prompt, but rather make intelligent decisions over a multi-turn…

Machine Learning · Computer Science 2024-03-01 Yifei Zhou , Andrea Zanette , Jiayi Pan , Sergey Levine , Aviral Kumar