中文
相关论文

相关论文: Beyond Divergent Creativity: A Human-Based Evaluat…

200 篇论文

We investigate whether Large Language Models (LLMs) exhibit human-like cognitive patterns under four established frameworks from psychology: Thematic Apperception Test (TAT), Framing Bias, Moral Foundations Theory (MFT), and Cognitive…

人工智能 · 计算机科学 2025-12-12 Akash Kundu , Rishika Goswami

While Large Language Models (LLMs) have made significant strides in replicating human-like abilities, there are concerns about a reduction in the linguistic diversity of their outputs. This results in the homogenization of viewpoints and…

计算与语言 · 计算机科学 2024-12-05 Long Mai , Julie Carson-Berndsen

The ubiquitous adoption of Large Language Generation Models (LLMs) in programming has underscored the importance of differentiating between human-written code and code generated by intelligent models. This paper specifically aims to…

软件工程 · 计算机科学 2023-07-06 Li Ke , Hong Sheng , Fu Cai , Zhang Yunhe , Liu Ming

While language models (LMs) can sometimes generate factually correct text and estimate truth values of individual claims, these generally do not reflect a globally coherent, manipulable model of the world. As a consequence, current LMs also…

计算与语言 · 计算机科学 2024-06-28 Afra Feyza Akyürek , Ekin Akyürek , Leshem Choshen , Derry Wijaya , Jacob Andreas

In this paper, we evaluate the creative fiction writing abilities of a fine-tuned small language model (SLM), BART-large, and compare its performance to human writers and two large language models (LLMs): GPT-3.5 and GPT-4o. Our evaluation…

计算与语言 · 计算机科学 2025-06-05 Guillermo Marco , Luz Rello , Julio Gonzalo

Large Language Models (LLMs) like GPT-4o can help automate text classification tasks at low cost and scale. However, there are major concerns about the validity and reliability of LLM outputs. By contrast, human coding is generally more…

计算与语言 · 计算机科学 2025-01-17 Conrad Borchers , Danielle R. Thomas , Jionghao Lin , Ralph Abboud , Kenneth R. Koedinger

Agentic Reinforcement Learning (ARL) trains large language models to interleave reasoning with external tool execution to solve complex tasks. Most existing ARL methods train a single set of parameters to support both reasoning and tool-use…

人工智能 · 计算机科学 2026-05-29 Yu Li , Mingyang Yi , Xiuyu Li , Ju Fan , Fuxin Jiang , Binbin Chen , Peng Li , Jie Song , Tieying Zhang

Language models have demonstrated remarkable capabilities on standard benchmarks, yet they struggle increasingly from mode collapse, the inability to generate diverse and novel outputs. Our work introduces NoveltyBench, a benchmark…

计算与语言 · 计算机科学 2025-08-12 Yiming Zhang , Harshita Diddee , Susan Holm , Hanchen Liu , Xinyue Liu , Vinay Samuel , Barry Wang , Daphne Ippolito

As large language models (LLMs) advance in linguistic competence, their reasoning abilities are gaining increasing attention. In humans, reasoning often performs well in domain specific settings, particularly in normative rather than purely…

计算与语言 · 计算机科学 2026-03-09 Hirohiko Abe , Kentaro Ozeki , Risako Ando , Takanobu Morishita , Koji Mineshima , Mitsuhiro Okada

Annotated data plays a critical role in Natural Language Processing (NLP) in training models and evaluating their performance. Given recent developments in Large Language Models (LLMs), models such as ChatGPT demonstrate zero-shot…

计算与语言 · 计算机科学 2024-03-18 Minzhi Li , Taiwei Shi , Caleb Ziems , Min-Yen Kan , Nancy F. Chen , Zhengyuan Liu , Diyi Yang

Conventional continual pretraining (CPT) for large language model (LLM) domain adaptation often suffers from catastrophic forgetting and limited domain capacity. Existing strategies adopt layer expansion, introducing additional trainable…

机器学习 · 计算机科学 2025-10-14 Jinyang Zhang , Yue Fang , Hongxin Ding , Weibin Liao , Muyang Ye , Xu Chu , Junfeng Zhao , Yasha Wang

This article analyzes the use of Large Language Models (LLMs) as support for the conceptual modeling of relational databases through the automatic generation of Entity-Relationship (ER) diagrams from natural language requirements. The…

AI-based creativity support tools (CSTs) are evaluated through domain-specific metrics, limiting cross-domain comparison of creative processes. Embedding-based protocol analysis offers a potential domain-agnostic analytical layer. However,…

人机交互 · 计算机科学 2026-03-10 Seung Won Lee , Semin Jin , Kyung Hoon Hyun

Large language models (LLMs) can be used to generate text data for training and evaluating other models. However, creating high-quality datasets with LLMs can be challenging. In this work, we explore human-AI partnerships to facilitate high…

计算与语言 · 计算机科学 2023-08-11 John Joon Young Chung , Ece Kamar , Saleema Amershi

Present Large Language Models (LLM) self-training methods always under-sample on challenging queries, leading to inadequate learning on difficult problems which limits LLMs' ability. Therefore, this work proposes a difficulty-aware…

计算与语言 · 计算机科学 2025-03-13 Boyang Xue , Qi Zhu , Hongru Wang , Rui Wang , Sheng Wang , Hongling Xu , Fei Mi , Yasheng Wang , Lifeng Shang , Qun Liu , Kam-Fai Wong

Conflict-Driven Clause Learning (CDCL) is the mainstream framework for solving the Satisfiability problem (SAT), and CDCL solvers typically rely on various heuristics, which have a significant impact on their performance. Modern CDCL…

人工智能 · 计算机科学 2024-11-14 Yiwen Sun , Furong Ye , Xianyin Zhang , Shiyu Huang , Bingzhen Zhang , Ke Wei , Shaowei Cai

Analyzing the reasoning patterns of students in science classrooms is critical for understanding knowledge construction mechanism and improving instructional practice to maximize cognitive engagement, yet manual coding of classroom…

计算与语言 · 计算机科学 2026-05-08 Jiho Noh , Mukhesh Raghava Katragadda , Raymond Carl , Soon Lee

Large language models (LLMs) tuned for safety often avoid acknowledging demographic differences, even when such acknowledgment is factually correct (e.g., ancestry-based disease incidence) or contextually justified (e.g., religious hiring…

计算与语言 · 计算机科学 2026-04-21 Ziwen Pan , Zihan Liang , Jad Kabbara , Ali Emami

Machine learning approaches now achieve impressive generation capabilities in numerous domains such as image, audio or video. However, most training \& evaluation frameworks revolve around the idea of strictly modelling the original data…

机器学习 · 计算机科学 2022-11-17 Axel Chemla--Romeu-Santos , Philippe Esling

New Large Language Models (LLMs) become available every few weeks, and modern application developers confronted with the unenviable task of having to decide if they should switch to a new model. While human evaluation remains the gold…

人工智能 · 计算机科学 2025-12-25 Suryaansh Jain , Umair Z. Ahmed , Shubham Sahai , Ben Leong