中文
相关论文

相关论文: Zero-shot Conversational Summarization Evaluations…

200 篇论文

We claim that LLMs can be paired with formal analysis methods to provide accessible, relevant feedback for HRI tasks. While logic specifications are useful for defining and assessing a task, these representations are not easily interpreted…

机器人学 · 计算机科学 2024-05-28 Emily Jensen , Sriram Sankaranarayanan , Bradley Hayes

The capabilities of large language models (LLMs) have raised concerns about their potential to create and propagate convincing narratives. Here, we study their performance in detecting convincing arguments to gain insights into LLMs'…

计算与语言 · 计算机科学 2024-10-07 Paula Rescala , Manoel Horta Ribeiro , Tiancheng Hu , Robert West

Large Language Models (LLMs) are rapidly evolving and impacting various fields, necessitating the development of effective methods to evaluate and compare their performance. Most current approaches for performance evaluation are either…

计算与语言 · 计算机科学 2025-02-11 Behrad Moniri , Hamed Hassani , Edgar Dobriban

Large Language Models (LLMs) have revolutionized various Natural Language Generation (NLG) tasks, including Argument Summarization (ArgSum), a key subfield of Argument Mining. This paper investigates the integration of state-of-the-art LLMs…

Recent work has explored the use of large language models (LLMs) to generate tutoring responses in mathematics, yet it remains unclear how closely their instructional behavior aligns with expert human practice. We analyze a dataset of math…

计算与语言 · 计算机科学 2026-05-28 Ramatu Oiza Abdulsalam , Segun Aroyehun

Large Language Models (LLMs) have shown capabilities close to human performance in various analytical tasks, leading researchers to use them for time and labor-intensive analyses. However, their capability to handle highly specialized and…

计算与语言 · 计算机科学 2024-10-08 Alexander S. Choi , Syeda Sabrina Akter , JP Singh , Antonios Anastasopoulos

This paper assesses the potential for the large language models (LLMs) GPT-4 and GPT-3.5 to aid in deriving insight from education feedback surveys. Exploration of LLM use cases in education has focused on teaching and learning, with less…

计算与语言 · 计算机科学 2024-06-28 Michael J. Parker , Caitlin Anderson , Claire Stone , YeaRim Oh

Plain language summaries (PLSs) are essential for facilitating effective communication between clinicians and patients by making complex medical information easier for laypeople to understand and act upon. Large language models (LLMs) have…

计算与语言 · 计算机科学 2025-05-16 Yue Guo , Jae Ho Sohn , Gondy Leroy , Trevor Cohen

Recent studies have used both automatic metrics and human evaluations to assess the simplification abilities of LLMs. However, the suitability of existing evaluation methodologies for LLMs remains in question. First, the suitability of…

计算与语言 · 计算机科学 2025-07-15 Xuanxin Wu , Yuki Arase

Language models (LMs) trained on large amounts of data have shown impressive performance on many NLP tasks under the zero-shot and few-shot setup. Here we aim to better understand the extent to which such models learn commonsense knowledge…

This paper introduces a parameterization framework for controlling conversation quality in large language models. We explore nine key parameters across six dimensions that enable precise specification of dialogue properties. Through…

计算与语言 · 计算机科学 2025-08-06 Shengqi Li , Amarnath Gupta

Large language models (LLMs) have been well-researched in various long-context tasks. However, the scarcity of long-context summarization datasets hinders progress in this area. To address this, we introduce CNNSum, a multi-scale…

计算与语言 · 计算机科学 2025-06-03 Lingxiao Wei , He Yan , Xiangju Lu , Junmin Zhu , Jun Wang , Wei Zhang

Large language models (LLMs) are capable of performing conditional sequence generation tasks, such as translation or summarization, through instruction fine-tuning. The fine-tuning data is generally sequentially concatenated from a specific…

计算与语言 · 计算机科学 2023-08-24 Yijin Liu , Xianfeng Zeng , Fandong Meng , Jie Zhou

Large language models (LLMs) have emerged as a potential solution to automate the complex processes involved in writing literature reviews, such as literature collection, organization, and summarization. However, it is yet unclear how good…

计算与语言 · 计算机科学 2025-08-22 Xuemei Tang , Xufeng Duan , Zhenguang G. Cai

The development of highly fluent large language models (LLMs) has prompted increased interest in assessing their reasoning and problem-solving capabilities. We investigate whether several LLMs can solve a classic type of deductive reasoning…

计算与语言 · 计算机科学 2024-04-16 Spencer M. Seals , Valerie L. Shalin

Current Large Language Models (LLMs) are unparalleled in their ability to generate grammatically correct, fluent text. LLMs are appearing rapidly, and debates on LLM capacities have taken off, but reflection is lagging behind. Thus, in this…

计算与语言 · 计算机科学 2023-11-01 Bram M. A. van Dijk , Tom Kouwenhoven , Marco R. Spruit , Max J. van Duijn

Online reviews play a pivotal role in influencing consumer decisions across various domains, from purchasing products to selecting hotels or restaurants. However, the sheer volume of reviews -- often containing repetitive or irrelevant…

计算与语言 · 计算机科学 2024-10-18 Mir Tafseer Nayeem , Davood Rafiei

This study investigates the use of Large Language Models (LLMs) for predicting human-perceived misery scores from natural language descriptions of real-world scenarios. The task is framed as a regression problem, where the model assigns a…

计算与语言 · 计算机科学 2025-08-19 Bishanka Seal , Rahul Seetharaman , Aman Bansal , Abhilash Nandy

Large Language Models (LLMs) are increasingly deployed in real-world applications where users engage in extended, mixed-topic conversations that depend on prior context. Yet, their reliability under realistic multi-turn interactions remains…

计算与语言 · 计算机科学 2026-03-03 Jiyoon Myung

This paper investigates the effectiveness of large language models (LLMs) in answering questions over datasets. We examine their performance in two scenarios: (a) directly answering questions given a dataset file as input, and (b)…

计算与语言 · 计算机科学 2026-05-12 Andreas Xenofontos , Pavlos Fafalios