中文
相关论文

相关论文: Evaluating LLM Story Generation through Large-scal…

200 篇论文

Large language models (LLMs) have demonstrated capabilities across diverse domains, yet their performance on rare disease diagnosis from narrative medical cases remains underexplored. We introduce a novel dataset of 176 symptom-diagnosis…

计算与语言 · 计算机科学 2025-11-17 Arsh Gupta , Ajay Narayanan Sridhar , Bonam Mingole , Amulya Yadav

Large language models (LLMs) offer the potential to simulate human-like responses and behaviors, creating new opportunities for psychological science. In the context of self-regulated learning (SRL), if LLMs can reliably simulate survey…

Large language models (LLMs) have recently emerged as a powerful tool for a wide range of language generation tasks. Nevertheless, this progress has been slower in Arabic. In this work, we focus on the task of generating stories from LLMs.…

计算与语言 · 计算机科学 2024-07-11 Ahmed Oumar El-Shangiti , Fakhraddin Alwajih , Muhammad Abdul-Mageed

This study explores the potential of Large Language Models (LLMs), specifically GPT-4, to enhance objectivity in organizational task performance evaluations. Through comparative analyses across two studies, including various task…

计算与语言 · 计算机科学 2024-08-13 Ning Li , Huaikang Zhou , Mingze Xu

In today's visually dominated social media landscape, predicting the perceived credibility of visual content and understanding what drives human judgment are crucial for countering misinformation. However, these tasks are challenging due to…

计算机视觉与模式识别 · 计算机科学 2025-04-16 Yilang Peng , Sijia Qian , Yingdan Lu , Cuihua Shen

Automated story generation has been one of the long-standing challenges in NLP. Among all dimensions of stories, suspense is very common in human-written stories but relatively under-explored in AI-generated stories. While recent advances…

计算与语言 · 计算机科学 2024-02-28 Kaige Xie , Mark Riedl

Social networks profoundly influence how humans form opinions, exchange information, and organize collectively. As large language models (LLMs) are increasingly embedded into social and professional environments, it is critical to…

社会与信息网络 · 计算机科学 2025-10-07 Marios Papachristou , Yuan Yuan

Large language models (LLMs) have achieved great success in many fields, and recent works have studied exploring LLMs for graph discriminative tasks such as node classification. However, the abilities of LLMs for graph generation remain…

机器学习 · 计算机科学 2024-03-22 Yang Yao , Xin Wang , Zeyang Zhang , Yijian Qin , Ziwei Zhang , Xu Chu , Yuekui Yang , Wenwu Zhu , Hong Mei

Large Language Models (LLMs) play a pivotal role in generating vast arrays of narratives, facilitating a systematic exploration of their effectiveness for communicating life events in narrative form. In this study, we employ a zero-shot…

The powerful ability to understand, follow, and generate complex language emerging from large language models (LLMs) makes LLM-generated text flood many areas of our daily lives at an incredible speed and is widely accepted by humans. As…

计算与语言 · 计算机科学 2024-04-22 Junchao Wu , Shu Yang , Runzhe Zhan , Yulin Yuan , Derek F. Wong , Lidia S. Chao

In the field of natural language processing, the rapid development of large language model (LLM) has attracted more and more attention. LLMs have shown a high level of creativity in various tasks, but the methods for assessing such…

计算与语言 · 计算机科学 2025-02-21 Yunpu Zhao , Rui Zhang , Wenyi Li , Di Huang , Jiaming Guo , Shaohui Peng , Yifan Hao , Yuanbo Wen , Xing Hu , Zidong Du , Qi Guo , Ling Li , Yunji Chen

In this study, we present the first comprehensive evaluation of modern LLMs - including GPT-4, GPT-4o, GPT-3.5-Turbo, Gemini 1.5 Pro, DeepSeek-V3, Llama 3.2, and BERT - across three core social media analytics tasks on a Twitter (X)…

计算与语言 · 计算机科学 2026-04-22 Ramtin Davoudi , Kartik Thakkar , Nazanin Donyapour , Tyler Derr , Hamid Karimi

Large Language Models (LLMs) have demonstrated human-like capabilities in language comprehension and generation, becoming active participants in social and cognitive domains. This study investigates whether LLMs exhibit personality-like…

计算与语言 · 计算机科学 2025-05-22 Wang Jiaqi , Wang bo , Guo fa , Cheng cheng , Yang li

Large Language Models (LLMs) often struggle with creative generation, and multi-agent frameworks that improve reasoning through interaction can paradoxically hinder creativity by inducing content homogenization. We introduce LLM Review, a…

计算与语言 · 计算机科学 2026-01-14 Weiyue Li , Mingxiao Song , Zhenda Shen , Dachuan Zhao , Yunfan Long , Yi Li , Yongce Li , Ruyi Yang , Mengyu Wang

Dialogue-based Role Playing Games (RPGs) require powerful storytelling. The narratives of these may take years to write and typically involve a large creative team. In this work, we demonstrate the potential of large generative text models…

计算与语言 · 计算机科学 2024-06-07 Jorge Leandro , Sudha Rao , Michael Xu , Weijia Xu , Nebosja Jojic , Chris Brockett , Bill Dolan

The widespread adoption of large language models (LLMs) makes it important to recognize their strengths and limitations. We argue that in order to develop a holistic understanding of these systems we need to consider the problem that they…

计算与语言 · 计算机科学 2023-09-26 R. Thomas McCoy , Shunyu Yao , Dan Friedman , Matthew Hardy , Thomas L. Griffiths

The advancing fluency of LLMs raises important questions about their ability to emulate complex human traits, including emotional expression and personality, across diverse linguistic and cultural contexts. This study investigates whether…

计算与语言 · 计算机科学 2026-03-25 Nasser A Alsadhan

LLMs have demonstrated exceptional proficiency in a wide range of NLP tasks. However, a notable gap remains in practical data analysis scenarios, particularly when LLMs are required to process long sequences of unstructured documents, such…

计算与语言 · 计算机科学 2026-05-21 Yuefeng Shi , Nedjma Ousidhoum , Jose Camacho-Collados

The paper explores stylometry as a method to distinguish between texts created by Large Language Models (LLMs) and humans, addressing issues of model attribution, intellectual property, and ethical AI use. Stylometry has been used…

计算与语言 · 计算机科学 2025-07-25 Karol Przystalski , Jan K. Argasiński , Iwona Grabska-Gradzińska , Jeremi K. Ochab

Large language models (LLMs) are emerging as promising tools for mental health care, offering scalable support through their ability to generate human-like responses. However, the effectiveness of these models in clinical settings remains…

人工智能 · 计算机科学 2024-08-22 Yining Hua , Hongbin Na , Zehan Li , Fenglin Liu , Xiao Fang , David Clifton , John Torous