English
Related papers

Related papers: Evaluating Text Summaries Generated by Large Langu…

200 papers

Large language models are increasingly capable of generating fluent-appearing text with relatively little task-specific supervision. But can these models accurately explain classification decisions? We consider the task of generating…

Computation and Language · Computer Science 2022-05-06 Sarah Wiegreffe , Jack Hessel , Swabha Swayamdipta , Mark Riedl , Yejin Choi

Artificial intelligence is making spectacular progress, and one of the best examples is the development of large language models (LLMs) such as OpenAI's GPT series. In these lectures, written for readers with a background in mathematics or…

Computation and Language · Computer Science 2023-10-09 Michael R. Douglas

ChatGPT is a conversational artificial intelligence that is a member of the generative pre-trained transformer of the large language model family. This text generative model was fine-tuned by both supervised learning and reinforcement…

Computation and Language · Computer Science 2023-06-06 Niful Islam , Debopom Sutradhar , Humaira Noor , Jarin Tasnim Raya , Monowara Tabassum Maisha , Dewan Md Farid

The use of machine learning (ML) models to assess and score textual data has become increasingly pervasive in an array of contexts including natural language processing, information retrieval, search and recommendation, and credibility…

Computation and Language · Computer Science 2023-09-27 Marialena Bevilacqua , Kezia Oketch , Ruiyang Qin , Will Stamey , Xinyuan Zhang , Yi Gan , Kai Yang , Ahmed Abbasi

This paper presents a novel approach for detecting ChatGPT-generated vs. human-written text using language models. To this end, we first collected and released a pre-processed dataset named OpenGPTText, which consists of rephrased content…

Computation and Language · Computer Science 2023-05-19 Yutian Chen , Hao Kang , Vivian Zhai , Liangze Li , Rita Singh , Bhiksha Raj

This paper discusses OpenAIs ChatGPT, a generative pre-trained transformer, which uses natural language processing to fulfill text-based user requests (i.e., a chatbot). The history and principles behind ChatGPT and similar models are…

Computation and Language · Computer Science 2023-04-03 Brady Lund , Ting Wang , Nishith Reddy Mannuru , Bing Nie , Somipam Shimray , Ziang Wang

This study investigates the effectiveness of Large Language Models (LLMs) in interpreting existing literature through a systematic review of the relationship between Environmental, Social, and Governance (ESG) factors and financial…

Computation and Language · Computer Science 2024-10-29 Aaditya Shah , Shridhar Mehendale , Siddha Kanthi

Large language models, particularly GPT-3, are able to produce high quality summaries of general domain news articles in few- and zero-shot settings. However, it is unclear if such models are similarly capable in more specialized,…

Computation and Language · Computer Science 2023-05-12 Chantal Shaib , Millicent L. Li , Sebastian Joseph , Iain J. Marshall , Junyi Jessy Li , Byron C. Wallace

ChatGPT is a large language model developed by OpenAI. Despite its impressive performance across various tasks, no prior work has investigated its capability in the biomedical domain yet. To this end, this paper aims to evaluate the…

Computation and Language · Computer Science 2023-08-25 Israt Jahan , Md Tahmid Rahman Laskar , Chun Peng , Jimmy Huang

Plain language summaries (PLSs) are essential for facilitating effective communication between clinicians and patients by making complex medical information easier for laypeople to understand and act upon. Large language models (LLMs) have…

Computation and Language · Computer Science 2025-05-16 Yue Guo , Jae Ho Sohn , Gondy Leroy , Trevor Cohen

Generative search systems are increasingly replacing link-based retrieval with AI-generated summaries, yet little is known about how these systems differ in sources, language, and fidelity to cited material. We examine responses to 11,000…

Information Retrieval · Computer Science 2026-03-18 Michelle Huang , Agam Goyal , Koustuv Saha , Eshwar Chandrasekharan

The widespread usage of computer-based assessments and individualized learning platforms has resulted in an increased demand for the rapid production of high-quality items. Automated item generation (AIG), the process of using item models…

Computation and Language · Computer Science 2023-04-11 Ummugul Bezirhan , Matthias von Davier

Reliable methods for automatic readability assessment have the potential to impact a variety of fields, ranging from machine translation to self-informed learning. Recently, large language models for the German language (such as GBERT and…

Computation and Language · Computer Science 2022-09-12 Patrick Gustav Blaneck , Tobias Bornheim , Niklas Grieger , Stephan Bialonski

Mobile app users commonly rely on app store ratings and reviews to find apps that suit their needs. However, the sheer volume of reviews available on app stores can lead to information overload, thus impeding users' ability to make informed…

Software Engineering · Computer Science 2025-06-18 Shristi Shrestha , Anas Mahmoud

Large Language Models (LLMs), typified by OpenAI's GPT, have marked a significant advancement in artificial intelligence. Trained on vast amounts of text data, LLMs are capable of understanding and generating human-like text across a…

Artificial Intelligence · Computer Science 2024-10-29 Haochen Zhang , Yuyang Dong , Chuan Xiao , Masafumi Oyamada

The manual assessment and grading of student writing is a time-consuming yet critical task for teachers. Recent developments in generative AI, such as large language models, offer potential solutions to facilitate essay-scoring tasks for…

Computation and Language · Computer Science 2024-11-26 Kathrin Seßler , Maurice Fürstenberg , Babette Bühler , Enkelejda Kasneci

With the advent of Deep Learning based Artificial Neural Networks models, Natural Language Processing (NLP) has witnessed significant improvements in textual data processing in terms of its efficiency and accuracy. However, the research is…

Computation and Language · Computer Science 2023-10-05 Mubashir Munaf , Hammad Afzal , Naima Iltaf , Khawir Mahmood

The amount of text data available online is increasing at a very fast pace hence text summarization has become essential. Most of the modern recommender and text classification systems require going through a huge amount of data. Manually…

Computation and Language · Computer Science 2021-08-03 Anushka Gupta , Diksha Chugh , Anjum , Rahul Katarya

Large language models (LLMs) have demonstrated remarkable performance in abstractive summarization tasks. However, their ability to precisely control summary attributes (e.g., length or topic) remains underexplored, limiting their…

Computation and Language · Computer Science 2026-01-08 Sangwon Ryu , Heejin Do , Daehee Kim , Hwanjo Yu , Dongwoo Kim , Yunsu Kim , Gary Geunbae Lee , Jungseul Ok

Given the recent introduction of multiple language models and the ongoing demand for improved Natural Language Processing tasks, particularly summarization, this work provides a comprehensive benchmarking of 20 recent language models,…

Computation and Language · Computer Science 2025-01-31 Abdurrahman Odabaşı , Göksel Biricik