English
Related papers

Related papers: From Exploration to Mastery: Enabling LLMs to Mast…

200 papers

Self-improvement is a significant techniques within the realm of large language model (LLM), aiming to enhance the LLM performance without relying on external data. Despite its significance, generally how LLM performances evolve during the…

Machine Learning · Computer Science 2026-02-10 Yifan Sun , Yushan Liang , Zhen Zhang , Xin Liu , Jiaye Teng

Safety critical software assessment requires robust assessment against complex regulatory frameworks, a process traditionally limited by manual evaluation. This paper presents Document Retrieval-Augmented Fine-Tuning (DRAFT), a novel…

Using tools by Large Language Models (LLMs) is a promising avenue to extend their reach beyond language or conversational settings. The number of tools can scale to thousands as they enable accessing sensory information, fetching updated…

Information Retrieval · Computer Science 2024-12-06 Mohammad Kachuee , Sarthak Ahuja , Vaibhav Kumar , Puyang Xu , Xiaohu Liu

Recent advancements in tool-augmented large language models have enabled them to interact with external tools, enhancing their ability to perform complex user tasks. However, existing approaches overlook the role of personalisation in…

Computation and Language · Computer Science 2025-09-17 Ekaterina Taktasheva , Jeff Dalton

In recent years, large language models (LLMs) have demonstrated significant potential in complex reasoning tasks like mathematical problem-solving. However, existing research predominantly relies on reinforcement learning (RL) frameworks…

Machine Learning · Computer Science 2026-01-12 ShaoZhen Liu , Xinting Huang , Houwen Peng , Xin Chen , Xinyang Song , Qi Li , Zhenan Sun

Large language models (LLMs) increasingly act as autonomous agents that must decide when to answer directly vs. when to invoke external tools. Prior work studying adaptive tool use has largely treated tool necessity as a model-agnostic…

Artificial Intelligence · Computer Science 2026-05-19 Yize Cheng , Chenrui Fan , Mahdi JafariRaviz , Keivan Rezaei , Soheil Feizi

Large Language Models (LLMs) have demonstrated remarkable performance on various tasks, yet their ability to extract and internalize deeper insights from domain-specific datasets remains underexplored. In this study, we investigate how…

Computation and Language · Computer Science 2025-01-30 Pouya Pezeshkpour , Estevam Hruschka

As large language models (LLMs) advance, their inability to autonomously execute tasks by directly interacting with external tools remains a critical limitation. Traditional methods rely on inputting tool descriptions as context, which is…

Computation and Language · Computer Science 2025-04-01 Renxi Wang , Xudong Han , Lei Ji , Shu Wang , Timothy Baldwin , Haonan Li

Large Language Models (LLMs) have achieved remarkable success across a wide range of natural language tasks, and recent efforts have sought to extend their capabilities to multimodal domains and resource-constrained environments. However,…

Machine Learning · Computer Science 2025-05-26 Yun-Da Tsai

Through the integration of external tools, large language models (LLMs) such as GPT-4o and Llama 3.1 significantly expand their functional capabilities, evolving from elementary conversational agents to general-purpose assistants. We argue…

Computation and Language · Computer Science 2024-10-16 Zhenchao Jin , Mengchen Liu , Dongdong Chen , Lingting Zhu , Yunsheng Li , Lequan Yu

Tool learning has emerged as a promising direction by extending Large Language Models' (LLMs) capabilities with external tools. Existing tool learning studies primarily focus on the general-purpose tool-use capability, which addresses…

Computation and Language · Computer Science 2025-02-27 Qiancheng Xu , Yongqi Li , Heming Xia , Fan Liu , Min Yang , Wenjie Li

Recent studies on software tool manipulation with large language models (LLMs) mostly rely on closed model APIs. The industrial adoption of these models is substantially constrained due to the security and robustness risks in exposing…

Computation and Language · Computer Science 2023-05-29 Qiantong Xu , Fenglu Hong , Bo Li , Changran Hu , Zhengyu Chen , Jian Zhang

Large Language Models (LLMs) have demonstrated impressive performance in various NLP tasks, but they still suffer from challenges such as hallucination and weak numerical reasoning. To overcome these challenges, external tools can be used…

Computation and Language · Computer Science 2023-06-26 Yuchen Zhuang , Yue Yu , Kuan Wang , Haotian Sun , Chao Zhang

Widely used language models (LMs) are typically built by scaling up a two-stage training pipeline: a pre-training stage that uses a very large, diverse dataset of text and a fine-tuning (sometimes, 'alignment') stage that uses targeted…

Computation and Language · Computer Science 2023-10-20 Eric Mitchell , Rafael Rafailov , Archit Sharma , Chelsea Finn , Christopher D. Manning

This paper presents a study on strategies to enhance the translation capabilities of large language models (LLMs) in the context of machine translation (MT) tasks. The paper proposes a novel paradigm consisting of three stages: Secondary…

Computation and Language · Computer Science 2024-04-16 Jiaxin Guo , Hao Yang , Zongyao Li , Daimeng Wei , Hengchao Shang , Xiaoyu Chen

Recently, large language models(LLMs) have played an increasingly important role in solving a wide range of NLP tasks, leveraging their capabilities of natural language understanding and generating. Integration with external tools further…

Computation and Language · Computer Science 2025-05-14 Aiyao He , Sijia Cui , Shuai Xu , Yanna Wang , Bo Xu

While integrating external tools into large language models (LLMs) enhances their ability to access real-time information and domain-specific services, existing approaches focus narrowly on functional tool selection following user…

Computation and Language · Computer Science 2025-05-23 Zihao Cheng , Hongru Wang , Zeming Liu , Yuhang Guo , Yuanfang Guo , Yunhong Wang , Haifeng Wang

Iterative self-refinement is a simple inference-time strategy for machine translation: an LLM revises its own translation over multiple inference-time passes. Yet document-scale refinement remains poorly understood: 1) which pipelines work…

Computation and Language · Computer Science 2026-05-14 Shaomu Tan , Dawei Zhu , Ke Tran , Michael Denkowski , Sony Trenous , Bill Byrne , Leonardo Ribeiro , Felix Hieber

Large Language Models (LLMs) possess substantial reasoning capabilities and are increasingly applied to optimization tasks, particularly in synergy with evolutionary computation. However, while recent surveys have explored specific aspects…

Neural and Evolutionary Computing · Computer Science 2026-01-08 Yisong Zhang , Ran Cheng , Guoxing Yi , Kay Chen Tan

Tool-augmented large language models (LLMs) leverage tools, often in the form of APIs, to improve their reasoning capabilities on complex tasks. This enables them to act as intelligent agents interacting with the real world. The recently…

Computation and Language · Computer Science 2025-03-24 Sijia Chen , Yibo Wang , Yi-Feng Wu , Qing-Guo Chen , Zhao Xu , Weihua Luo , Kaifu Zhang , Lijun Zhang