English
Related papers

Related papers: Assessing the Creativity of Large Language Models:…

200 papers

Human decision-making belongs to the foundation of our society and civilization, but we are on the verge of a future where much of it will be delegated to artificial intelligence. The arrival of Large Language Models (LLMs) has transformed…

Artificial Intelligence · Computer Science 2025-06-23 Hao Li , Gengrui Zhang , Petter Holme , Shuyue Hu , Zhen Wang

Large language models (LLMs) bring unprecedented flexibility in defining and executing complex, creative natural language generation (NLG) tasks. Yet, this flexibility brings new challenges, as it introduces new degrees of freedom in…

Computation and Language · Computer Science 2024-07-08 Furkan Şahinuç , Ilia Kuznetsov , Yufang Hou , Iryna Gurevych

Large language models (LLMs) exhibit logically inconsistent hallucinations that appear coherent yet violate reasoning principles, with recent research suggesting an inverse relationship between causal reasoning capabilities and such…

Computation and Language · Computer Science 2025-11-13 Yuangang Li , Yiqing Shen , Yi Nian , Jiechao Gao , Ziyi Wang , Chenxiao Yu , Shawn Li , Jie Wang , Xiyang Hu , Yue Zhao

As large language models (LLMs) are increasingly used for ideation and scientific discovery, it is important to evaluate their ability to generate novel output. Prior work evaluates novelty as originality with respect to model training…

Computation and Language · Computer Science 2025-10-08 Vishakh Padmakumar , Chen Yueh-Han , Jane Pan , Valerie Chen , He He

Large-scale pre-trained language models have contributed significantly to natural language processing by demonstrating remarkable abilities as few-shot learners. However, their effectiveness depends mainly on scaling the model parameters…

Computation and Language · Computer Science 2023-01-26 Ningyu Zhang , Luoqiu Li , Xiang Chen , Shumin Deng , Zhen Bi , Chuanqi Tan , Fei Huang , Huajun Chen

Correct answers do not necessarily reflect cultural understanding. We introduce CRaFT, an explanation-based multilingual evaluation framework designed to assess how large language models (LLMs) reason across cultural contexts. Rather than…

Computation and Language · Computer Science 2025-10-17 Shehenaz Hossain , Haithem Afli

Adversarial training for LLMs is one of the most promising methods to reliably improve robustness against adversaries. However, despite significant progress, models remain vulnerable to simple in-distribution exploits, such as rewriting…

Machine Learning · Computer Science 2026-02-19 Chengzhi Hu , Jonas Dornbusch , David Lüdke , Stephan Günnemann , Leo Schwinn

The pace of scientific research, vital for improving human life, is complex, slow, and needs specialized expertise. Meanwhile, novel, impactful research often stems from both a deep understanding of prior work, and a cross-pollination of…

Computation and Language · Computer Science 2025-02-11 Jinheon Baek , Sujay Kumar Jauhar , Silviu Cucerzan , Sung Ju Hwang

Although artificial intelligence (AI) now matches or exceeds human performance across numerous cognitive tasks, creativity remains a highly contested frontier. As AI systems based on large language models (LLMs) are increasingly adopted in…

Computation and Language · Computer Science 2026-05-19 Tiancheng Hu , Yixuan Jiang , Haotian Li , José Hernández-Orallo , Xing Xie , Nigel Collier , David Stillwell , Luning Sun

This paper investigates the capabilities of large language models (LLMs) in formulating and solving decision-making problems using mathematical programming. We first conduct a systematic review and meta-analysis of recent literature to…

Artificial Intelligence · Computer Science 2025-08-26 Mohammad J. Abdel-Rahman , Yasmeen Alslman , Dania Refai , Amro Saleh , Malik A. Abu Loha , Mohammad Yahya Hamed

The mathematical capabilities of AI systems are complex and multifaceted. Most existing research has predominantly focused on the correctness of AI-generated solutions to mathematical problems. In this work, we argue that beyond producing…

Computation and Language · Computer Science 2024-10-25 Junyi Ye , Jingyi Gu , Xinyun Zhao , Wenpeng Yin , Guiling Wang

Large Language Models (LLMs) are increasingly described as possessing strong reasoning capabilities, supported by high performance on mathematical, logical, and planning benchmarks. However, most existing evaluations rely on aggregate…

Computation and Language · Computer Science 2026-04-16 Md. Fahad Ullah Utsho , Mohd. Ruhul Ameen , Akif Islam , Md. Golam Rashed , Dipankar Das

Personalization is a critical task in modern intelligent systems, with applications spanning diverse domains, including interactions with large language models (LLMs). Recent advances in reasoning capabilities have significantly enhanced…

Computation and Language · Computer Science 2025-05-26 Sichun Luo , Guanzhi Deng , Jian Xu , Xiaojie Zhang , Hanxu Hou , Linqi Song

State-of-the-art large language model (LLM) pipelines rely on bootstrapped reasoning loops: sampling diverse chains of thought and reinforcing the highest-scoring ones, mainly optimizing correctness. We analyze how this design choice is…

Machine Learning · Computer Science 2026-01-05 Max Ruiz Luyten , Mihaela van der Schaar

Large Language Models (LLMs) exhibit substantial parameter redundancy, particularly in Feed-Forward Networks (FFNs). Existing pruning methods suffer from two primary limitations. First, reliance on dataset-specific calibration introduces…

Computation and Language · Computer Science 2026-02-02 Abhishek Tyagi , Yunuo Cen , Shrey Dhorajiya , Bharadwaj Veeravalli , Xuanyao Fong

Mainstream LLM research has primarily focused on enhancing their generative capabilities. However, even the most advanced LLMs experience uncertainty in their outputs, often producing varied results on different runs or when faced with…

Computation and Language · Computer Science 2024-07-17 Jihyun Janice Ahn , Ryo Kamoi , Lu Cheng , Rui Zhang , Wenpeng Yin

While the potential of deep learning (DL) for automating simple tasks is already well explored, recent research has started investigating the use of deep learning for creative design, both for complete artifact creation and supporting…

Artificial Intelligence · Computer Science 2024-02-13 Marcus Basalla , Johannes Schneider , Jan vom Brocke

Architectural Decision Records (ADRs) play a central role in maintaining software architecture quality, yet many decision violations go unnoticed because projects lack both systematic documentation and automated detection mechanisms. Recent…

Software Engineering · Computer Science 2026-02-10 Ruoyu Su , Alexander Bakhtin , Noman Ahmad , Matteo Esposito , Valentina Lenarduzzi , Davide Taibi

Understanding the world through models is a fundamental goal of scientific research. While large language model (LLM) based approaches show promise in automating scientific discovery, they often overlook the importance of criticizing…

Machine Learning · Computer Science 2024-11-12 Michael Y. Li , Vivek Vajipey , Noah D. Goodman , Emily B. Fox

LLMs show strong performance in code generation, but their outputs lack correctness guarantees. Sample-based uncertainty estimators address this by generating multiple candidate programs and measuring their disagreement. However, existing…

Software Engineering · Computer Science 2026-05-12 Weilin He , Arindam Sharma , Cristina David