English
Related papers

Related papers: Making Language Models Better Tool Learners with E…

200 papers

Large language models (LLMs) are now used in multi-turn workflows, but we still lack a clear way to measure when iteration helps and when it hurts. We present an evaluation framework for iterative refinement that spans ideation, code, and…

Artificial Intelligence · Computer Science 2025-09-16 Shashidhar Reddy Javaji , Bhavul Gauri , Zining Zhu

External tools help large language models succeed at tasks where they would otherwise typically fail. In existing frameworks, choosing tools at test time relies on naive greedy decoding, regardless of whether the model has been fine-tuned…

Computation and Language · Computer Science 2025-09-23 Lisa Alazraki , Marek Rei

Tool learning enables Large Language Models (LLMs) to interact with external environments by invoking tools, serving as an effective strategy to mitigate the limitations inherent in their pre-training data. In this process, tool…

Computation and Language · Computer Science 2025-02-27 Changle Qu , Sunhao Dai , Xiaochi Wei , Hengyi Cai , Shuaiqiang Wang , Dawei Yin , Jun Xu , Ji-Rong Wen

Tool learning enables large language models (LLMs) to interact with external tools and APIs, greatly expanding the application scope of LLMs. However, due to the dynamic nature of external environments, these tools and APIs may become…

Computation and Language · Computer Science 2025-03-03 Guoxin Chen , Zhong Zhang , Xin Cong , Fangda Guo , Yesai Wu , Yankai Lin , Wenzheng Feng , Yasheng Wang

Large Language Models (LLMs) have shown the potential to be valuable teaching tools, with the potential of giving every student a personalized tutor. However, one challenge with using LLMs to learn new concepts is that when learning a topic…

Human-Computer Interaction · Computer Science 2024-11-19 Steve Oney , Yue Shen , Fei Wu , Young Suh Hong , Ziang Wang , Yamini Khajekar , Jiacheng Zhang , April Yi Wang

Evaluating conversational AI systems that use external tools is challenging, as errors can arise from complex interactions among user, agent, and tools. While existing evaluation methods assess either user satisfaction or agents'…

Computation and Language · Computer Science 2025-10-23 Zhaoyi Joey Hou , Tanya Shourya , Yingfan Wang , Shamik Roy , Vinayshekhar Bannihatti Kumar , Rashmi Gangadharaiah

Pretrained language models often do not perform tasks in ways that are in line with our preferences, e.g., generating offensive text or factually incorrect summaries. Recent work approaches the above issue by learning from a simple form of…

Computation and Language · Computer Science 2022-11-18 Jérémy Scheurer , Jon Ander Campos , Jun Shern Chan , Angelica Chen , Kyunghyun Cho , Ethan Perez

Language model-based instruction-following systems have lately shown increasing performance on many benchmark tasks, demonstrating the capability of adapting to a broad variety of instructions. However, such systems are often not designed…

Computation and Language · Computer Science 2024-03-20 Rahul Nadkarni , Yizhong Wang , Noah A. Smith

Large Language Models (LLMs) have demonstrated remarkable versatility across various domains. To further advance LLMs, we propose 'SELF' (Self-Evolution with Language Feedback), a novel approach that enables LLMs to self-improve through…

Computation and Language · Computer Science 2024-02-02 Jianqiao Lu , Wanjun Zhong , Wenyong Huang , Yufei Wang , Qi Zhu , Fei Mi , Baojun Wang , Weichao Wang , Xingshan Zeng , Lifeng Shang , Xin Jiang , Qun Liu

Traditional end-of-quarter surveys often fail to provide instructors with timely, detailed, and actionable feedback about their teaching. In this paper, we explore how Large Language Model (LLM)-powered chatbots can reimagine the classroom…

Computers and Society · Computer Science 2025-08-19 Sai Siddartha Maram , Ulia Zaman , Magy Seif El-Nasr

Large language models (LLMs) show an innate skill for solving language based tasks. But insights have suggested an inability to adjust for information or task-solving skills becoming outdated, as their knowledge, stored directly within…

Computation and Language · Computer Science 2024-04-16 Jerry Huang , Prasanna Parthasarathi , Mehdi Rezagholizadeh , Sarath Chandar

Large Language Models (LLMs) have demonstrated remarkable capabilities on various tasks, while the further evolvement is limited to the lack of high-quality training data. In addition, traditional training approaches rely too much on…

Computation and Language · Computer Science 2025-02-14 Peidong Wang , Ming Wang , Zhiming Ma , Xiaocui Yang , Shi Feng , Daling Wang , Yifei Zhang , Kaisong Song

Tool learning methods have enhanced the ability of large language models (LLMs) to interact with real-world applications. Many existing works fine-tune LLMs or design prompts to enable LLMs to select appropriate tools and correctly invoke…

Computation and Language · Computer Science 2024-07-04 Chengrui Huang , Zhengliang Shi , Yuntao Wen , Xiuying Chen , Peng Han , Shen Gao , Shuo Shang

Large Language Models (LLMs) have emerged as powerful tools in various research domains. This article examines their potential through a literature review and firsthand experimentation. While LLMs offer benefits like cost-effectiveness and…

Human-Computer Interaction · Computer Science 2024-04-10 M. Namvarpour , A. Razi

Large language models (LLMs) have significantly advanced natural language processing, particularly through the integration of external tools and APIs. However, their effectiveness is frequently hampered by parameter mis-filling during tool…

Computation and Language · Computer Science 2025-06-03 Yue Cui , Liuyi Yao , Shuchang Tao , Weijie Shi , Yaliang Li , Bolin Ding , Xiaofang Zhou

Augmenting large language models (LLMs) with external tools has emerged as a promising approach to extend their utility, enabling them to solve practical tasks. Previous methods manually parse tool documentation and create in-context…

Computation and Language · Computer Science 2025-03-05 Zhengliang Shi , Shen Gao , Lingyong Yan , Yue Feng , Xiuyi Chen , Zhumin Chen , Dawei Yin , Suzan Verberne , Zhaochun Ren

Tool learning empowers large language models (LLMs) as agents to use external tools and extend their utility. Existing methods employ one single LLM-based agent to iteratively select and execute tools, thereafter incorporating execution…

Computation and Language · Computer Science 2024-06-25 Zhengliang Shi , Shen Gao , Xiuyi Chen , Yue Feng , Lingyong Yan , Haibo Shi , Dawei Yin , Pengjie Ren , Suzan Verberne , Zhaochun Ren

Open-sourced large language models (LLMs) have demonstrated remarkable efficacy in various tasks with instruction tuning. However, these models can sometimes struggle with tasks that require more specialized knowledge such as translation.…

Computation and Language · Computer Science 2024-01-23 Jiali Zeng , Fandong Meng , Yongjing Yin , Jie Zhou

The success of Large Language Models (LLMs) has significantly propelled the research of video understanding. To harvest the benefits of well-trained expert models (i.e., tools), video LLMs prioritize the exploration of tool usage…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Yuyang Liu , Meng Cao , Xinyuan Shi , Xiaondan Liang