English
Related papers

Related papers: Role-playing Prompt Framework: Generation and Eval…

200 papers

Generative Large Language Models (LLMs) hold significant promise in healthcare, demonstrating capabilities such as passing medical licensing exams and providing clinical knowledge. However, their current use as information retrieval tools…

Large language models (LLMs) have been applied to a wide range of data-to-text generation tasks, including tables, graphs, and time-series numerical data-to-text settings. While research on generating prompts for structured data such as…

Computation and Language · Computer Science 2024-04-04 Masayuki Kawarada , Tatsuya Ishigaki , Hiroya Takamura

Task planning can require defining myriad domain knowledge about the world in which a robot needs to act. To ameliorate that effort, large language models (LLMs) can be used to score potential next actions during task planning, and even…

Large language models (LLMs) have taken the scientific world by storm, changing the landscape of natural language processing and human-computer interaction. These powerful tools can answer complex questions and, surprisingly, perform…

Artificial Intelligence · Computer Science 2023-11-14 Pier Luca Lanzi , Daniele Loiacono

Large Language Models (LLMs) demonstrate a notable capacity for adopting personas and engaging in role-playing. However, evaluating this ability presents significant challenges, as human assessments are resource-intensive and automated…

Computation and Language · Computer Science 2025-05-20 Yassine El Boudouri , Walter Nuninger , Julian Alvarez , Yvan Peter

Recently, Large Language Models~(LLMs) such as ChatGPT have showcased remarkable abilities in solving general tasks, demonstrating the potential for applications in recommender systems. To assess how effectively LLMs can be used in…

Information Retrieval · Computer Science 2025-01-17 Lanling Xu , Junjie Zhang , Bingqian Li , Jinpeng Wang , Sheng Chen , Wayne Xin Zhao , Ji-Rong Wen

The robustness of large language models (LLMs) becomes increasingly important as their use rapidly grows in a wide range of domains. Retrieval-Augmented Generation (RAG) is considered as a means to improve the trustworthiness of text…

Computation and Language · Computer Science 2025-05-22 Zhibo Hu , Chen Wang , Yanfeng Shu , Helen , Paik , Liming Zhu

Pre-trained large language models (PLMs) underlie most new developments in natural language processing. They have shifted the field from application-specific model pipelines to a single model that is adapted to a wide range of tasks.…

Computation and Language · Computer Science 2023-06-30 Joshua Maynez , Priyanka Agrawal , Sebastian Gehrmann

In this paper, we investigate the use of large language models (LLMs) like ChatGPT for document-grounded response generation in the context of information-seeking dialogues. For evaluation, we use the MultiDoc2Dial corpus of task-oriented…

Computation and Language · Computer Science 2023-09-22 Norbert Braunschweiler , Rama Doddipatla , Simon Keizer , Svetlana Stoyanchev

Reward design in reinforcement learning (RL) is challenging since specifying human notions of desired behavior may be difficult via reward functions or require many expert demonstrations. Can we instead cheaply design rewards using a…

Machine Learning · Computer Science 2023-03-02 Minae Kwon , Sang Michael Xie , Kalesha Bullard , Dorsa Sadigh

The quality of texts generated by natural language generation (NLG) systems is hard to measure automatically. Conventional reference-based metrics, such as BLEU and ROUGE, have been shown to have relatively low correlation with human…

Computation and Language · Computer Science 2023-05-25 Yang Liu , Dan Iter , Yichong Xu , Shuohang Wang , Ruochen Xu , Chenguang Zhu

The remarkable success of pretrained language models has motivated the study of what kinds of knowledge these models learn during pretraining. Reformulating tasks as fill-in-the-blanks problems (e.g., cloze tests) is a natural approach for…

Computation and Language · Computer Science 2020-11-10 Taylor Shin , Yasaman Razeghi , Robert L. Logan , Eric Wallace , Sameer Singh

Large Language Models (LLM) show strong abilities in code generation, but their skill in creating efficient parallel programs is less studied. This paper explores how LLMs generate task-based parallel code from three kinds of input prompts:…

Programming Languages · Computer Science 2026-02-27 Linus Bantel , Moritz Strack , Alexander Strack , Dirk Pflüger

Humans follow criteria when they execute tasks, and these criteria are directly used to assess the quality of task completion. Therefore, having models learn to use criteria to provide feedback can help humans or models to perform tasks…

Computation and Language · Computer Science 2024-06-05 Weizhe Yuan , Pengfei Liu , Matthias Gallé

Large transformer-based language models (LMs) trained on huge text corpora have shown unparalleled generation capabilities. However, controlling attributes of the generated language (e.g. switching topic or sentiment) is difficult without…

Computation and Language · Computer Science 2020-03-04 Sumanth Dathathri , Andrea Madotto , Janice Lan , Jane Hung , Eric Frank , Piero Molino , Jason Yosinski , Rosanne Liu

Optimizing language models for use in conversational agents requires large quantities of example dialogues. Increasingly, these dialogues are synthetically generated by using powerful large language models (LLMs), especially in domains…

Computation and Language · Computer Science 2025-09-19 Joachim De Baer , A. Seza Doğruöz , Thomas Demeester , Chris Develder

Large Language Models (LLMs) play a pivotal role in generating vast arrays of narratives, facilitating a systematic exploration of their effectiveness for communicating life events in narrative form. In this study, we employ a zero-shot…

Large language models (LLMs) have gained considerable attention for Artificial Intelligence Generated Content (AIGC), particularly with the emergence of ChatGPT. However, the direct adaptation of continuous speech to LLMs that process…

Audio and Speech Processing · Electrical Eng. & Systems 2023-08-28 Haibin Wu , Kai-Wei Chang , Yuan-Kuei Wu , Hung-yi Lee

Large Language Models (LLMs) have achieved impressive performance across various reasoning tasks. However, even state-of-the-art LLMs such as ChatGPT are prone to logical errors during their reasoning processes. Existing solutions, such as…

Computation and Language · Computer Science 2024-03-25 Chi Hu , Yuan Ge , Xiangnan Ma , Hang Cao , Qiang Li , Yonghua Yang , Tong Xiao , Jingbo Zhu

Recently, the emergence of large language models (LLMs) has unlocked new opportunities for procedural content generation. However, recent attempts mainly focus on level generation for specific games with defined game rules such as Super…

Artificial Intelligence · Computer Science 2024-05-31 Chengpeng Hu , Yunlong Zhao , Jialin Liu