English
Related papers

Related papers: ToolCritic: Detecting and Correcting Tool-Use Erro…

200 papers

Large Language Models (LLMs) are evolving from text generators into reasoning agents. This transition makes their ability to use external tools a critical capability. However, evaluating this skill presents a significant challenge. Existing…

Computation and Language · Computer Science 2025-10-14 Fei Lei , Yibo Yang , Wenxiu Sun , Dahua Lin

An important unexplored aspect in previous work on user satisfaction estimation for Task-Oriented Dialogue (TOD) systems is their evaluation in terms of robustness for the identification of user dissatisfaction: current benchmarks for user…

Computation and Language · Computer Science 2024-08-21 Amin Abolghasemi , Zhaochun Ren , Arian Askari , Mohammad Aliannejadi , Maarten de Rijke , Suzan Verberne

Large language models (LLMs) have emerged as powerful and general solutions to many natural language tasks. However, many of the most important applications of language generation are interactive, where an agent has to talk to a person to…

Machine Learning · Computer Science 2023-11-10 Joey Hong , Sergey Levine , Anca Dragan

Retrieval-augmented generation (RAG) has become a widely adopted paradigm for enabling knowledge-grounded large language models (LLMs). However, standard RAG pipelines often fail to ensure that model reasoning remains consistent with the…

Artificial Intelligence · Computer Science 2025-10-14 Jiaqi Wei , Hao Zhou , Xiang Zhang , Di Zhang , Zijie Qiu , Wei Wei , Jinzhe Li , Wanli Ouyang , Siqi Sun

Conversational interfaces powered by Large Language Models (LLMs) have recently become a popular way to obtain feedback during document editing. However, standard chat-based conversational interfaces do not support transparency and…

Computation and Language · Computer Science 2023-09-28 Philippe Laban , Jesse Vig , Marti A. Hearst , Caiming Xiong , Chien-Sheng Wu

Large language models (LLMs) can now access a wide range of external tools, thanks to the Model Context Protocol (MCP). This greatly expands their abilities as various agents. However, LLMs rely entirely on the text descriptions of tools to…

Artificial Intelligence · Computer Science 2025-09-23 Kazem Faghih , Wenxiao Wang , Yize Cheng , Siddhant Bharti , Gaurang Sriramanan , Sriram Balasubramanian , Parsa Hosseini , Soheil Feizi

End-user robot programming grants users the flexibility to re-task robots in situ, yet it remains challenging for novices due to the need for specialized robotics knowledge. Large Language Models (LLMs) hold the potential to lower the…

Robotics · Computer Science 2026-03-10 Callie Y. Kim , Nathan Thomas White , Evan He , Frederic Sala , Bilge Mutlu

Large language models (LLMs) are increasingly deployed as conversational assistants in open-domain, multi-turn settings, where users often provide incomplete or ambiguous information. However, existing LLM-focused clarification benchmarks…

Computation and Language · Computer Science 2025-12-25 Sichun Luo , Yi Huang , Mukai Li , Shichang Meng , Fengyuan Liu , Zefa Hu , Junlan Feng , Qi Liu

Large language models (LLMs) have recently achieved significant success across various application domains, garnering substantial attention from different communities. Unfortunately, even for the best LLM, many \textit{faults} still exist…

Software Engineering · Computer Science 2024-11-06 Qiang Hu , Jin Wen , Maxime Cordy , Yuheng Huang , Wei Ma , Xiaofei Xie , Lei Ma

Medical conversational AI (AI) plays a pivotal role in the development of safer and more effective medical dialogue systems. However, existing benchmarks and evaluation frameworks for assessing the information-gathering and diagnostic…

Computation and Language · Computer Science 2026-01-08 Lecheng Gong , Weimin Fang , Ting Yang , Dongjie Tao , Chunxiao Guo , Peng Wei , Bo Xie , Jinqun Guan , Zixiao Chen , Fang Shi , Jinjie Gu , Junwei Liu

We have reached a practical and realistic phase in human-support dialogue agents by developing a large language model (LLM). However, when requiring expert knowledge or anticipating the utterance content using the massive size of the…

Human-Computer Interaction · Computer Science 2023-12-22 Naoki Yoshimaru , Motoharu Okuma , Takamasa Iio , Kenji Hatano

Tool-use capability is a fundamental component of LLM agents, enabling them to interact with external systems through structured function calls. However, existing research exhibits inconsistent interaction representations, largely overlooks…

Artificial Intelligence · Computer Science 2026-05-26 Yijuan Liang , Xinghao Chen , Yifan Ge , Ziyi Wu , Hao Wu , Changyu Zeng , Wei Xing , Xiaoyu Shen

We present ControlLLM, a novel framework that enables large language models (LLMs) to utilize multi-modal tools for solving complex real-world tasks. Despite the remarkable performance of LLMs, they still struggle with tool invocation due…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Zhaoyang Liu , Zeqiang Lai , Zhangwei Gao , Erfei Cui , Ziheng Li , Xizhou Zhu , Lewei Lu , Qifeng Chen , Yu Qiao , Jifeng Dai , Wenhai Wang

LLMs (Large Language Models) usually interact with users in the form of dialogue and generate responses following their instructions, which naturally require dialogue comprehension abilities. However, dialogue comprehension is a general…

Computation and Language · Computer Science 2024-04-02 Shuaijie She , Shujian Huang , Xingyun Wang , Yanke Zhou , Jiajun Chen

Large language models (LLMs) show an innate skill for solving language based tasks. But insights have suggested an inability to adjust for information or task-solving skills becoming outdated, as their knowledge, stored directly within…

Computation and Language · Computer Science 2024-04-16 Jerry Huang , Prasanna Parthasarathi , Mehdi Rezagholizadeh , Sarath Chandar

Large-scale language models (LLMs) have achieved remarkable success across various language tasks but suffer from hallucinations and temporal misalignment. To mitigate these shortcomings, Retrieval-augmented generation (RAG) has been…

Computation and Language · Computer Science 2024-04-30 Zhongzhen Huang , Kui Xue , Yongqi Fan , Linjie Mu , Ruoyu Liu , Tong Ruan , Shaoting Zhang , Xiaofan Zhang

Through the integration of external tools, large language models (LLMs) such as GPT-4o and Llama 3.1 significantly expand their functional capabilities, evolving from elementary conversational agents to general-purpose assistants. We argue…

Computation and Language · Computer Science 2024-10-16 Zhenchao Jin , Mengchen Liu , Dongdong Chen , Lingting Zhu , Yunsheng Li , Lequan Yu

The deployment of Large Language Models (LLMs) for code debugging (e.g., C and Python) is widespread, benefiting from their ability to understand and interpret intricate concepts. However, in the semiconductor industry, utilising LLMs to…

Hardware Architecture · Computer Science 2024-05-14 Ke Xu , Jialin Sun , Yuchen Hu , Xinwei Fang , Weiwei Shan , Xi Wang , Zhe Jiang

The rapid development of large language models (LLMs) has not only provided numerous opportunities but also presented significant challenges. This becomes particularly evident when LLMs inadvertently generate harmful or toxic content,…

Computation and Language · Computer Science 2024-02-20 Kai Chen , Chunwei Wang , Kuo Yang , Jianhua Han , Lanqing Hong , Fei Mi , Hang Xu , Zhengying Liu , Wenyong Huang , Zhenguo Li , Dit-Yan Yeung , Lifeng Shang , Xin Jiang , Qun Liu

Large Language Models (LLMs) have achieved remarkable performance in objective tasks such as open-domain question answering and mathematical reasoning, which can often be solved through recalling learned factual knowledge or…

Computation and Language · Computer Science 2024-02-28 Xiaolong Wang , Yile Wang , Yuanchi Zhang , Fuwen Luo , Peng Li , Maosong Sun , Yang Liu