English
Related papers

Related papers: Beyond Turing Test: Can GPT-4 Sway Experts' Decisi…

200 papers

Peer review is the cornerstone of academic publishing, yet the process is increasingly strained by rising submission volumes, reviewer overload, and expertise mismatches. Large language models (LLMs) are now being used as "reviewer aids,"…

Computers and Society · Computer Science 2025-09-15 Changjia Zhu , Junjie Xiong , Renkai Ma , Zhicong Lu , Yao Liu , Lingyao Li

Large Language Models (LLMs) possess an extraordinary capability to produce text that is not only coherent and contextually relevant but also strikingly similar to human writing. They adapt to various styles and genres, producing content…

Computation and Language · Computer Science 2025-07-08 Chinnappa Guggilla , Budhaditya Roy , Trupti Ramdas Chavan , Abdul Rahman , Edward Bowen

Generative artificial intelligences, particularly large language models (LLMs), play an increasingly prominent role in human decision-making contexts, necessitating transparency about their capabilities. While prior studies have shown…

Computation and Language · Computer Science 2026-01-30 Lydia Uhler , Verena Jordan , Jürgen Buder , Markus Huff , Frank Papenmeier

Ever since Large Language Models (LLMs) and related applications have become broadly available, several studies investigated their potential for assisting educators and supporting students in higher education. LLMs such as Codex, GPT-3.5,…

Artificial Intelligence · Computer Science 2024-07-08 Imen Azaiz , Natalie Kiesler , Sven Strickroth

This study comprehensively evaluates the translation quality of Large Language Models (LLMs), specifically GPT-4, against human translators of varying expertise levels across multiple language pairs and domains. Through carefully designed…

Computation and Language · Computer Science 2024-07-08 Jianhao Yan , Pingchuan Yan , Yulong Chen , Judy Li , Xianchao Zhu , Yue Zhang

Large language models (LLMs) are increasingly capable and prevalent, and can be used to produce creative content. The quality of content is influenced by the prompt used, with more specific prompts that incorporate examples generally…

Computation and Language · Computer Science 2023-08-28 Samuel Rhys Cox , Ashraf Abdul , Wei Tsang Ooi

Modelling users' online decision-making and opinion change is a complex issue that needs to consider users' personal determinants, the nature of the topic and the information retrieval activities. Furthermore, generative-AIbased products…

Human-Computer Interaction · Computer Science 2026-01-14 Shangqian Li , Tianwa Chen , Gianluca Demartini

This paper studies recent developments in large language models' (LLM) abilities to pass assessments in introductory and intermediate Python programming courses at the postsecondary level. The emergence of ChatGPT resulted in heated debates…

Computers and Society · Computer Science 2023-10-05 Jaromir Savelka , Arav Agarwal , Marshall An , Chris Bogart , Majd Sakr

Although capable of generating creative text, Large Language Models (LLMs) are poor judges of what constitutes "creativity". In this work, we show that we can leverage this knowledge of how to write creatively in order to better judge what…

Computation and Language · Computer Science 2024-12-10 Matthew Lyle Olson , Neale Ratzlaff , Musashi Hinck , Shao-yen Tseng , Vasudev Lal

Automatic systems are increasingly used to assess the originality of responses in creative tasks. They offer a potential solution to key limitations of human assessment (cost, fatigue, and subjectivity), but there is preliminary evidence of…

Human-Computer Interaction · Computer Science 2026-04-24 Umberto Domanti , Moritz Mock , Sergio Agnoli , Antonella De Angeli

Large Language Models (LLMs) have been widely used to support ideation in the writing process. However, whether generating ideas with the help of LLMs leads to idea fixation or idea expansion is unclear. This study examines how different…

Human-Computer Interaction · Computer Science 2025-05-06 Peinuan Qin , Chi-Lan Yang , Jingshu Li , Jing Wen , Yi-Chieh Lee

Large Language Models (LLMs) have demonstrated exceptional natural language understanding abilities and have excelled in a variety of natural language processing (NLP)tasks in recent years. Despite the fact that most LLMs are trained…

Computation and Language · Computer Science 2023-10-25 Xiang Zhang , Senyu Li , Bradley Hauer , Ning Shi , Grzegorz Kondrak

Large language models (LLMs) play a key role in generating evidence-based and stylistic counter-arguments, yet their effectiveness in real-world applications has been underexplored. Previous research often neglects the balance between…

Computation and Language · Computer Science 2025-05-26 Preetika Verma , Kokil Jaidka , Svetlana Churina

In this paper, we explore the challenges inherent to Large Language Models (LLMs) like GPT-4, particularly their propensity for hallucinations, logic mistakes, and incorrect conclusions when tasked with answering complex questions. The…

Computation and Language · Computer Science 2023-12-22 Xiang Li , Haoran Tang , Siyu Chen , Ziwei Wang , Anurag Maravi , Marcin Abram

Large Language Models (LLMs) are now capable of generating highly fluent, human-like text. They enable many applications, but also raise concerns such as large scale spam, phishing, or academic misuse. While much work has focused on…

Computation and Language · Computer Science 2026-04-16 Swati Rallapalli , Shannon Gallagher , Ronald Yurko , Tyler Brooks , Chuck Loughin , Michele Sezgin , Violet Turri

In this work, we establish a baseline potential for how modern model-generated text explanations of movie recommendations may help users, and explore what different components of these text explanations that users like or dislike,…

Artificial Intelligence · Computer Science 2023-09-19 Joyce Zhou , Thorsten Joachims

Reading comprehension tests are used in a variety of applications, reaching from education to assessing the comprehensibility of simplified texts. However, creating such tests manually and ensuring their quality is difficult and…

Computation and Language · Computer Science 2024-05-22 Andreas Säuberli , Simon Clematide

To enhance the quality of generated stories, recent story generation models have been investigating the utilization of higher-level attributes like plots or commonsense knowledge. The application of prompt-based learning with large language…

Computation and Language · Computer Science 2023-07-25 Zhuohan Xie , Trevor Cohn , Jey Han Lau

Cancer clinical trials often face challenges in recruitment and engagement due to a lack of participant-facing informational and educational resources. This study investigated the potential of Large Language Models (LLMs), specifically…

As Large Language Models (LLMs) become increasingly integrated into our everyday lives, understanding their ability to comprehend human mental states becomes critical for ensuring effective interactions. However, despite the recent attempts…

Computation and Language · Computer Science 2023-12-06 Kanishk Gandhi , Jan-Philipp Fränken , Tobias Gerstenberg , Noah D. Goodman