中文
相关论文

相关论文: Exploring and Controlling Diversity in LLM-Agent C…

200 篇论文

Multi-agent debate (MAD) is widely used to improve large language model (LLM) performance through test-time scaling, yet recent work shows that vanilla MAD often underperforms simple majority vote despite higher computational cost. Studies…

计算与语言 · 计算机科学 2026-01-29 Xiaochen Zhu , Caiqi Zhang , Yizhou Chi , Tom Stafford , Nigel Collier , Andreas Vlachos

The performance of large language models (LLMs) depends on how they are prompted, with choices spanning both the high-level prompting pattern (e.g., Zero-Shot, CoT, ReAct, ReWOO) and the specific prompt content (instructions and few-shot…

机器学习 · 计算机科学 2025-11-05 Claudio Spiess , Mandana Vaziri , Louis Mandel , Martin Hirzel

System prompts provide a lightweight yet powerful mechanism for conditioning large language models (LLMs) at inference time. While prior work has focused on English-only settings, real-world deployments benefit from having a single prompt…

计算与语言 · 计算机科学 2025-12-03 Lechen Zhang , Yusheng Zhou , Tolga Ergen , Lajanugen Logeswaran , Moontae Lee , David Jurgens

This report investigates approaches for prompting a tool-augmented large language model (LLM) to act as a role-playing dialogue agent in the API track of the Commonsense Persona-grounded Dialogue Challenge (CPDC) 2025. In this setting,…

计算与语言 · 计算机科学 2025-10-14 Saksorn Ruangtanusak , Pittawat Taveekitworachai , Kunat Pipatanakul

Large pre-trained vision-language models (VLMs) offer a promising approach to leveraging human language for enhancing downstream tasks. However, VLMs such as CLIP face significant limitation: its performance is highly sensitive to prompt…

计算机视觉与模式识别 · 计算机科学 2025-03-13 Ao Li , Zongfang Liu , Xinhua Li , Jinghui Zhang , Pengwei Wang , Hu Wang

Typical LLM responses tend to follow a default style, even though users often have distinct preferences regarding tone, verbosity, and formality that they do not explicitly state in their prompts. Evaluating whether personalization methods…

计算与语言 · 计算机科学 2026-05-21 Philipp Spohn , Leander Girrbach , Zeynep Akata

Code generation is one of the most active areas of application of Large Language Models (LLMs). While LLMs lower barriers to writing code and accelerate development process, the overall quality of generated programs depends on the quality…

软件工程 · 计算机科学 2026-03-19 Andrei Paleyes , Radzim Sendyka , Diana Robinson , Christian Cabrera , Neil D. Lawrence

This research investigates prompt designs of evaluating generated texts using large language models (LLMs). While LLMs are increasingly used for scoring various inputs, creating effective prompts for open-ended text evaluation remains…

计算与语言 · 计算机科学 2024-06-28 KuanChao Chu , Yi-Pei Chen , Hideki Nakayama

In the past year, large language models (LLMs) have had remarkable success in domains outside the traditional natural language processing, and their capacity is further expanded into the so-called LLM agents when connected with external…

计算与语言 · 计算机科学 2025-02-17 Weizhe Chen , Sven Koenig , Bistra Dilkina

Automatic prompt generation plays a crucial role in enabling general-purpose multi-agent systems to perform diverse tasks autonomously. Existing methods typically evaluate prompts based on their immediate task performance, overlooking the…

人工智能 · 计算机科学 2025-05-21 Ke Chen , Yufei Zhou , Xitong Zhang , Haohan Wang

Large Language Models (LLMs) have become increasingly capable of handling diverse tasks with the aid of well-crafted prompts and integration of external tools, but as task complexity rises, the workflow involving LLMs can be complicated and…

人工智能 · 计算机科学 2024-06-21 Honghua Dong , Qidong Su , Yubo Gao , Zhaoyu Li , Yangjun Ruan , Gennady Pekhimenko , Chris J. Maddison , Xujie Si

While Large Language Models (LLMs) have made significant strides in replicating human-like abilities, there are concerns about a reduction in the linguistic diversity of their outputs. This results in the homogenization of viewpoints and…

计算与语言 · 计算机科学 2024-12-05 Long Mai , Julie Carson-Berndsen

Generative models are increasingly powerful, yet users struggle to guide them through prompts. The generative process is difficult to control and unpredictable, and user instructions may be ambiguous or under-specified. Prior prompt…

人机交互 · 计算机科学 2026-02-16 Zhipeng Li , Yi-Chi Liao , Christian Holz

Large Language Models (LLMs) often generate substantively relevant content but fail to adhere to formal constraints, leading to outputs that are conceptually correct but procedurally flawed. Traditional prompt refinement approaches focus on…

人工智能 · 计算机科学 2026-01-08 Alberto Purpura , Li Wang , Sahil Badyal , Eugenio Beaufrand , Adam Faulkner

Large Language Models (LLMs) have demonstrated remarkable success in conversational systems by generating human-like responses. However, they can fall short, especially when required to account for personalization or specific knowledge. In…

计算与语言 · 计算机科学 2025-11-12 Soyeong Jeong , Aparna Elangovan , Emine Yilmaz , Oleg Rokhlenko

Prompt engineering, as an efficient and effective way to leverage Large Language Models (LLM), has drawn a lot of attention from the research community. The existing research primarily emphasizes the importance of adapting prompts to…

计算与语言 · 计算机科学 2024-07-08 Yuyan Chen , Zhihao Wen , Ge Fan , Zhengyu Chen , Wei Wu , Dayiheng Liu , Zhixu Li , Bang Liu , Yanghua Xiao

The adoption of Large Language Models (LLMs) is reshaping software development as developers integrate these LLMs into their applications. In such applications, prompts serve as the primary means of interacting with LLMs. Despite the…

软件工程 · 计算机科学 2025-01-14 Mahan Tafreshipour , Aaron Imani , Eric Huang , Eduardo Almeida , Thomas Zimmermann , Iftekhar Ahmed

Data augmentation (DA) is crucial to mitigate model training instability and over-fitting problems in low-resource open-domain dialogue generation. However, traditional DA methods often neglect semantic data diversity, restricting the…

计算与语言 · 计算机科学 2024-04-02 Zhenhua Liu , Tong Zhu , Jianxiang Xiang , Wenliang Chen

Deploying large language model (LLM)-driven conversational agents in enterprise settings requires prompts that are simultaneously correct at launch and resilient to the non-deterministic behavioral drift that characterizes production LLM…

人工智能 · 计算机科学 2026-05-18 Keshava Chaitanya , Jahnavi Gundakaram

Self-play preference optimization has emerged as a prominent paradigm for aligning large language models (LLMs). It typically involves a language model to generate on-policy responses for prompts and a reward model (RM) to guide the…

计算与语言 · 计算机科学 2026-03-03 Yao Xiao , Jung-jae Kim , Roy Ka-wei Lee , Lidong Bing