English
Related papers

Related papers: GPT Struct Me: Probing GPT Models on Narrative Ent…

200 papers

Recently, ChatGPT has attracted great attention, as it can generate fluent and high-quality responses to human inquiries. Several prior studies have shown that ChatGPT attains remarkable generation ability compared with existing models.…

Computation and Language · Computer Science 2023-03-03 Qihuang Zhong , Liang Ding , Juhua Liu , Bo Du , Dacheng Tao

Generative AI systems such as ChatGPT and Claude are built upon language models that are typically evaluated for accuracy on curated benchmark datasets. Such evaluation paradigms measure predictive and reasoning capabilities of language…

Human-Computer Interaction · Computer Science 2025-03-03 Shreya Rajagopal , Jae Ho Sohn , Hari Subramonyam , Shiwali Mohan

Human communication is often executed in the form of a narrative, an account of connected events composed of characters, actions, and settings. A coherent narrative structure is therefore a requisite for a well-formulated narrative -- be it…

Computation and Language · Computer Science 2020-03-02 Semi Min , Juyong Park

Large language models (LLMs) such as ChatGPT can produce coherent, cohesive, relevant, and fluent answers for various natural language processing (NLP) tasks. Taking document-level machine translation (MT) as a testbed, this paper provides…

Computation and Language · Computer Science 2023-10-25 Longyue Wang , Chenyang Lyu , Tianbo Ji , Zhirui Zhang , Dian Yu , Shuming Shi , Zhaopeng Tu

Recently, ChatGPT has attracted great attention from both industry and academia due to its surprising abilities in natural language understanding and generation. We are particularly curious about whether it can achieve promising performance…

Computation and Language · Computer Science 2023-10-11 Xiancai Xu , Jia-Dong Zhang , Rongchang Xiao , Lei Xiong

The recent success of prompting large language models like GPT-3 has led to a paradigm shift in NLP research. In this paper, we study its impact on text summarization, focusing on the classic benchmark domain of news summarization. First,…

Computation and Language · Computer Science 2023-05-25 Tanya Goyal , Junyi Jessy Li , Greg Durrett

Language exhibits inherent structures, a property that explains both language acquisition and language change. Given this characteristic, we expect language models to manifest their own internal structures as well. While interpretability…

Computation and Language · Computer Science 2026-05-19 Haruki Sakajo , Frederikus Hudi , Yusuke Sakai , Hidetaka Kamigaito , Taro Watanabe

Named Entity Recognition systems achieve remarkable performance on domains such as English news. It is natural to ask: What are these models actually learning to achieve this? Are they merely memorizing the names themselves? Or are they…

Computation and Language · Computer Science 2021-01-05 Oshin Agarwal , Yinfei Yang , Byron C. Wallace , Ani Nenkova

Generative models, like the one in ChatGPT, are powered by their training data. The models are simply next-word predictors, based on patterns learned from vast amounts of pre-existing text. Since the first generation of GPT, it is striking…

Computation and Language · Computer Science 2026-03-03 Edwin Roland , Richard Jean So

The advent of natural language processing and large language models (LLMs) has revolutionized the extraction of data from unstructured scholarly papers. However, ensuring data trustworthiness remains a significant challenge. In this paper,…

Materials Science · Physics 2024-08-06 Chinedu Ekuma

When solving decision-making tasks, humans typically depend on information from two key sources: (1) Historical policy data, which provides interaction replay from the environment, and (2) Analytical insights in natural language form,…

Machine Learning · Computer Science 2023-12-22 Xidong Feng , Yicheng Luo , Ziyan Wang , Hongrui Tang , Mengyue Yang , Kun Shao , David Mguni , Yali Du , Jun Wang

Process extraction from text is an important task of process discovery, for which various approaches have been developed in recent years. However, in contrast to other information extraction tasks, there is a lack of gold-standard corpora…

Computation and Language · Computer Science 2025-07-22 Patrizio Bellan , Han van der Aa , Mauro Dragoni , Chiara Ghidini , Simone Paolo Ponzetto

Conversation systems accommodate diverse users with unique personalities and distinct writing styles. Within the domain of multi-turn dialogue modeling, this work studies the impact of varied utterance lengths on the quality of subsequent…

Computation and Language · Computer Science 2024-02-02 Yufei Tao , Tiernan Mines , Ameeta Agrawal

The increasing number of scientific publications in acoustics, in general, presents difficulties in conducting traditional literature surveys. This work explores the use of a generative pre-trained transformer (GPT) model to automate a…

We investigate the extent to which modern, neural language models are susceptible to structural priming, the phenomenon whereby the structure of a sentence makes the same structure more probable in a follow-up sentence. We explore how…

Computation and Language · Computer Science 2022-06-30 Arabella Sinclair , Jaap Jumelet , Willem Zuidema , Raquel Fernández

Argument structure extraction (ASE) aims to identify the discourse structure of arguments within documents. Previous research has demonstrated that contextual information is crucial for developing an effective ASE model. However, we observe…

Computation and Language · Computer Science 2023-10-10 Yun Luo , Zhen Yang , Fandong Meng , Yingjie Li , Jie Zhou , Yue Zhang

Large Language Models (LLMs) play a pivotal role in generating vast arrays of narratives, facilitating a systematic exploration of their effectiveness for communicating life events in narrative form. In this study, we employ a zero-shot…

Using a text description as prompt to guide the generation of text or images (e.g., GPT-3 or DALLE-2) has drawn wide attention recently. Beyond text and image generation, in this work, we explore the possibility of utilizing text…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-23 Zhifang Guo , Yichong Leng , Yihan Wu , Sheng Zhao , Xu Tan

This paper presents a comprehensive survey of ChatGPT-related (GPT-3.5 and GPT-4) research, state-of-the-art large language models (LLM) from the GPT series, and their prospective applications across diverse domains. Indeed, key innovations…

It remains debated how well any LM understands natural language or generates reliable metalinguistic judgments. Moreover, relatively little work has demonstrated that LMs can represent and respect subtle relationships between form and…

Computation and Language · Computer Science 2025-05-15 Nicole Cuneo , Eleanor Graves , Supantho Rakshit , Adele E. Goldberg