English
Related papers

Related papers: Do LLMs Agree on the Creativity Evaluation of Alte…

200 papers

Large Language Models (LLMs) have become essential for offensive language detection, yet their ability to handle annotation disagreement remains underexplored. Disagreement samples, which arise from subjective interpretations, pose a unique…

Computation and Language · Computer Science 2025-05-20 Junyu Lu , Kai Ma , Kaichun Wang , Kelaiti Xiao , Roy Ka-Wei Lee , Bo Xu , Liang Yang , Hongfei Lin

Large language models (LLMs) are increasingly used to support the analysis of complex financial disclosures, yet their reliability, behavioral consistency, and transparency remain insufficiently understood in high-stakes settings. This…

Computation and Language · Computer Science 2026-01-21 Md Talha Mohsin

Multi-purpose Large Language Models (LLMs), a subset of generative Artificial Intelligence (AI), have recently made significant progress. While expectations for LLMs to assist systems engineering (SE) tasks are paramount; the…

Computation and Language · Computer Science 2025-02-17 Taylan G. Topcu , Mohammed Husain , Max Ofsa , Paul Wach

Recent advancements in large language models (LLMs) have sparked optimism about their potential to accelerate scientific discovery, with a growing number of works proposing research agents that autonomously generate and validate new ideas.…

Computation and Language · Computer Science 2024-09-09 Chenglei Si , Diyi Yang , Tatsunori Hashimoto

This paper examines if large language models (LLMs) can help people write constructive comments on divisive social issues due to the difficulty of expressing constructive disagreement online. Through controlled experiments with 600…

Human-Computer Interaction · Computer Science 2025-07-31 Farhana Shahid , Maximilian Dittgen , Mor Naaman , Aditya Vashistha

Purpose: Despite the importance of peer review for grant funding decisions, academics are often reluctant to conduct it. This can lead to long delays between submission and the final decision as well as the risk of substandard reviews from…

Digital Libraries · Computer Science 2026-03-17 Ulf Sandström , Mike Thelwall

The use of Large Language Models (LLMs) has become ubiquitous, with abundant applications in computational creativity. One such application is fictional story generation. Fiction is a narrative that occurs in a story world that is slightly…

Computation and Language · Computer Science 2024-08-16 Aisha Khatun , Daniel G. Brown

Large language models (LLMs) are increasingly used in decision-making tasks like r\'esum\'e screening and content moderation, giving them the power to amplify or suppress certain perspectives. While previous research has identified…

Computation and Language · Computer Science 2025-05-28 Naba Rizvi , Harper Strickland , Saleha Ahmedi , Aekta Kallepalli , Isha Khirwadkar , William Wu , Imani N. S. Munyaka , Nedjma Ousidhoum

Purpose: Artificial intelligence (AI), and in particular large language models (LLMs), are increasingly being explored as tools to support life cycle assessment (LCA). While demonstrations exist across environmental and social domains,…

Computation and Language · Computer Science 2025-10-24 Artur Donaldson , Bharathan Balaji , Cajetan Oriekezie , Manish Kumar , Laure Patouillard

Creative problem-solving requires combining multiple cognitive abilities, including logical reasoning, lateral thinking, analogy-making, and commonsense knowledge, to discover insights that connect seemingly unrelated pieces of information.…

Computation and Language · Computer Science 2026-04-07 Mete Ismayilzada , Renqing Cuomao , Daniil Yurshevich , Anna Sotnikova , Lonneke van der Plas , Antoine Bosselut

Work on instruction-tuned Large Language Models (LLMs) has used automatic methods based on text overlap and LLM judgments as cost-effective alternatives to human evaluation. In this paper, we perform a meta-evaluation of such methods and…

Computation and Language · Computer Science 2024-10-03 Ehsan Doostmohammadi , Oskar Holmström , Marco Kuhlmann

This paper discusses and contains offensive content. Language models (LMs) are used in decision-making systems and as interactive assistants. However, how well do these models making judgements align with the diversity of human values,…

Computation and Language · Computer Science 2025-04-17 Michael Galarnyk , Agam Shah , Dipanwita Guhathakurta , Poojitha Nandigam , Sudheer Chava

Large Language Models (LLMs) are promising analytical tools. They can augment human epistemic, cognitive and reasoning abilities, and support 'sensemaking', making sense of a complex environment or subject by analysing large volumes of data…

Computers and Society · Computer Science 2024-09-19 Awais Hameed Khan , Hiruni Kegalle , Rhea D'Silva , Ned Watt , Daniel Whelan-Shamy , Lida Ghahremanlou , Liam Magee

Large Language Models (LLMs) have shown significant limitations in understanding creative content, as demonstrated by Hessel et al. (2023)'s influential work on the New Yorker Cartoon Caption Contest (NYCCC). Their study exposed a…

Computation and Language · Computer Science 2025-02-28 Kuan Lok Zhou , Jiayi Chen , Siddharth Suresh , Reuben Narad , Timothy T. Rogers , Lalit K Jain , Robert D Nowak , Bob Mankoff , Jifan Zhang

Large Language Models (LLMs) have demonstrated impressive performance across diverse domains, yet they still encounter challenges such as insufficient domain-specific knowledge, biases, and hallucinations. This underscores the need for…

Computation and Language · Computer Science 2025-04-07 Hongliu Cao , Ilias Driouich , Robin Singh , Eoin Thomas

Creativity is fundamentally human. As AI takes on more of the generative work that once required human imagination, despite documented limitations in creative ability, a critical question emerges: How does GenAI affect users' creativity?…

Human-Computer Interaction · Computer Science 2026-05-14 Zeinabsadat Saghi , Run Huang , Souti Chattopadhyay

This study investigates the efficacy of Large Language Models (LLMs) in interactive language therapy for high-functioning autistic adolescents. With the rapid advancement of artificial intelligence, particularly in natural language…

Human-Computer Interaction · Computer Science 2023-11-17 Yujin Cho , Mingeon Kim , Seojin Kim , Oyun Kwon , Ryan Donghan Kwon , Yoonha Lee , Dohyun Lim

Research on the 'cultural alignment' of Large Language Models (LLMs) has emerged in response to growing interest in understanding representation across diverse stakeholders. Current approaches to evaluating cultural alignment through…

Computers and Society · Computer Science 2025-04-10 Ariba Khan , Stephen Casper , Dylan Hadfield-Menell

Recent developments in large language models (LLMs) have been impressive. However, these models sometimes show inconsistencies and problematic behavior, such as hallucinating facts, generating flawed code, or creating offensive and toxic…

Computation and Language · Computer Science 2024-02-22 Zhibin Gou , Zhihong Shao , Yeyun Gong , Yelong Shen , Yujiu Yang , Nan Duan , Weizhu Chen

By providing external information to large language models (LLMs), tool augmentation (including retrieval augmentation) has emerged as a promising solution for addressing the limitations of LLMs' static parametric memory. However, how…

Computation and Language · Computer Science 2024-02-28 Jian Xie , Kai Zhang , Jiangjie Chen , Renze Lou , Yu Su