中文
相关论文

相关论文: From Tools to Teammates: Evaluating LLMs in Multi-…

200 篇论文

The prominent large language models (LLMs) of today differ from past language models not only in size, but also in the fact that they are trained on a combination of natural language and formal language (code). As a medium between humans…

计算与语言 · 计算机科学 2024-01-09 Ke Yang , Jiateng Liu , John Wu , Chaoqi Yang , Yi R. Fung , Sha Li , Zixuan Huang , Xu Cao , Xingyao Wang , Yiquan Wang , Heng Ji , Chengxiang Zhai

Large language models (LLMs) are growing increasingly capable, prompting recent interest in LLM teams. Yet, despite increased deployment of LLM teams at scale, we lack a principled framework for addressing key questions such as when a team…

多智能体系统 · 计算机科学 2026-03-13 Elizabeth Mieczkowski , Katherine M. Collins , Ilia Sucholutsky , Natalia Vélez , Thomas L. Griffiths

The planning ability of Large Language Models (LLMs) has garnered increasing attention in recent years due to their remarkable capacity for multi-step reasoning and their ability to generalize across a wide range of domains. While some…

人工智能 · 计算机科学 2025-02-19 Mohamed Aghzal , Erion Plaku , Gregory J. Stein , Ziyu Yao

Following the initial flourishing of large language models (LLMs), there has been a surge in proposed large vision-language models (LVLMs) that integrate LLMs with vision capabilities. However, it has been observed that LVLMs, after tuning…

计算与语言 · 计算机科学 2025-12-30 Daiki Shiono , Shumpei Miyawaki , Ryota Tanaka , Jun Suzuki

Large language models (LLMs) are increasingly explored for their reasoning capabilities, yet their ability to perform structured, constraint-based optimization from natural language remains insufficiently understood. This study evaluates…

分布式、并行与集群计算 · 计算机科学 2025-11-18 Aasish Kumar Sharma , Julian Kunkel

Task automation has been greatly empowered by the recent advances in Large Language Models (LLMs) via Python code, where the tasks ranging from software engineering development to general-purpose reasoning. While current benchmarks have…

Current advanced long-context language models offer great potential for real-world software engineering applications. However, progress in this critical domain remains hampered by a fundamental limitation: the absence of a rigorous…

软件工程 · 计算机科学 2025-03-07 Jia Li , Xuyuan Guo , Lei Li , Kechi Zhang , Ge Li , Jia Li , Zhengwei Tao , Fang Liu , Chongyang Tao , Yuqi Zhu , Zhi Jin

Robots are increasingly common in industry and daily life, such as in nursing homes where they can assist staff. A key challenge is developing intuitive interfaces for easy communication. The use of Large Language Models (LLMs) like GPT-4…

机器人学 · 计算机科学 2024-08-01 Stanislau Stankevich , Wojciech Dudek

With generative artificial intelligence driving the growth of dialogic data in education, automated coding is a promising direction for learning analytics to improve efficiency. This surge highlights the need to understand the nuances of…

人机交互 · 计算机科学 2025-12-25 Zijian Li , Luzhen Tang , Mengyu Xia , Xinyu Li , Naping Chen , Dragan Gašević , Yizhou Fan

Large Language Models (LLMs) are highly vulnerable to input perturbations, as even a small prompt change may result in a substantially different output. Existing methods to enhance LLM robustness are primarily focused on perturbed data…

计算与语言 · 计算机科学 2025-04-04 Aryan Agrawal , Lisa Alazraki , Shahin Honarvar , Marek Rei

Large language models (LLMs) have demonstrated remarkable capabilities across various NLP tasks and have recently expanded their impact to coding tasks, bridging the gap between natural languages (NL) and programming languages (PL). This…

计算与语言 · 计算机科学 2024-12-12 Nishat Raihan , Christian Newman , Marcos Zampieri

Large Language Models (LLMs) deliver powerful AI capabilities but face deployment challenges due to high resource costs and latency, whereas Small Language Models (SLMs) offer efficiency and deployability at the cost of reduced performance.…

人工智能 · 计算机科学 2025-05-13 Yi Chen , JiaHao Zhao , HaoHao Han

LLMs are increasingly used in applications where they interact with humans and other agents. We propose to use behavioural game theory to study LLM's cooperation and coordination behaviour. We let different LLMs play finitely repeated…

计算与语言 · 计算机科学 2025-05-13 Elif Akata , Lion Schulz , Julian Coda-Forno , Seong Joon Oh , Matthias Bethge , Eric Schulz

Large Language Models (LLMs) have increasingly been utilized in social simulations, where they are often guided by carefully crafted instructions to stably exhibit human-like behaviors during simulations. Nevertheless, we doubt the…

人工智能 · 计算机科学 2024-10-29 Zengqing Wu , Run Peng , Shuyuan Zheng , Qianying Liu , Xu Han , Brian Inhyuk Kwon , Makoto Onizuka , Shaojie Tang , Chuan Xiao

Large language models (LLMs) with extended context windows enable tasks requiring extensive information integration but are limited by the scarcity of high-quality, diverse datasets for long-context instruction tuning. Existing data…

计算与语言 · 计算机科学 2025-02-25 Jiaxi Li , Xingxing Zhang , Xun Wang , Xiaolong Huang , Li Dong , Liang Wang , Si-Qing Chen , Wei Lu , Furu Wei

A Large Language Model (LLM) represents a cutting-edge artificial intelligence model that generates coherent content, including grammatically precise sentences, human-like paragraphs, and syntactically accurate code snippets. LLMs can play…

软件工程 · 计算机科学 2023-12-11 Robson Santos , Italo Santos , Cleyton Magalhaes , Ronnie de Souza Santos

Tables stored in databases and tables which are present in web pages and articles account for a large part of semi-structured data that is available on the internet. It then becomes pertinent to develop a modeling approach with large…

计算与语言 · 计算机科学 2023-10-03 Soumajyoti Sarkar , Leonard Lausen

Memory emerges as the core module in the large language model (LLM)-based agents for long-horizon complex tasks (e.g., multi-turn dialogue, game playing, scientific discovery), where memory can enable knowledge accumulation, iterative…

计算与语言 · 计算机科学 2026-05-04 Yanchen Wu , Tenghui Lin , Yingli Zhou , Fangyuan Zhang , Qintian Guo , Xun Zhou , Sibo Wang , Xilin Liu , Yuchi Ma , Yixiang Fang

Large Language Models (LLMs) have advanced rapidly as tools for automating code generation in scientific research, yet their ability to interpret and use unfamiliar Python APIs for complex computational experiments remains poorly…

The programming landscape is nowadays being reshaped by the advent of Large Language Models (LLMs) able to automate code-related tasks related to code implementation (e.g., code completion) and comprehension (e.g., code summarization). Such…

软件工程 · 计算机科学 2025-01-10 Nathan Cooper , Rosalia Tufano , Gabriele Bavota , Denys Poshyvanyk