English
Related papers

Related papers: Evaluating LLMs and Pre-trained Models for Text Su…

200 papers

Recent efforts have evaluated large language models (LLMs) in areas such as commonsense reasoning, mathematical reasoning, and code generation. However, to the best of our knowledge, no work has specifically investigated the performance of…

Computation and Language · Computer Science 2024-05-17 Xuanfan Ni , Piji Li

Large Language Models (LLMs) have garnered considerable interest within both academic and industrial. Yet, the application of LLMs to graph data remains under-explored. In this study, we evaluate the capabilities of four LLMs in addressing…

Artificial Intelligence · Computer Science 2023-09-12 Chang Liu , Bo Wu

Large language models (LLMs) are becoming increasingly better at a wide range of Natural Language Processing tasks (NLP), such as text generation and understanding. Recently, these models have extended their capabilities to coding tasks,…

Machine Learning · Computer Science 2024-10-23 Nishat Raihan , Mohammed Latif Siddiq , Joanna C. S. Santos , Marcos Zampieri

This study aims to explore the performance improvement method of large language models based on GPT-4 under the multi-task learning framework and conducts experiments on two tasks: text classification and automatic summary generation.…

Computation and Language · Computer Science 2024-12-10 Zhen Qi , Jiajing Chen , Shuo Wang , Bingying Liu , Hongye Zheng , Chihang Wang

The rapid integration of Large Language Models (LLMs) into various domains raises concerns about societal inequalities and information bias. This study examines biases in LLMs related to background, gender, and age, with a focus on their…

Computation and Language · Computer Science 2025-09-15 Willem Huijzer , Jieying Chen

The exponential increase in video content poses significant challenges in terms of efficient navigation, search, and retrieval, thus requiring advanced video summarization techniques. Existing video summarization methods, which heavily rely…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Min Jung Lee , Dayoung Gong , Minsu Cho

Text summarization, a key natural language generation (NLG) task, is vital in various domains. However, the high cost of inaccurate summaries in risk-critical applications, particularly those involving human-in-the-loop decision-making,…

Computation and Language · Computer Science 2024-10-10 Jianfeng He , Runing Yang , Linlin Yu , Changbin Li , Ruoxi Jia , Feng Chen , Ming Jin , Chang-Tien Lu

The exponential growth of unstructured text data presents a fundamental challenge in modern data management and information retrieval. While Large Language Models (LLMs) have shown remarkable capabilities in natural language processing,…

Artificial Intelligence · Computer Science 2025-05-06 William Brach , Kristián Košťál , Michal Ries

Detecting life-threatening language is essential for safeguarding individuals in distress, promoting mental health and well-being, and preventing potential harm and loss of life. This paper presents an effective approach to identifying…

Computation and Language · Computer Science 2025-06-13 Thanh Thi Nguyen , Campbell Wilson , Janis Dalins

Traditional evaluation metrics like BLEU and ROUGE fall short when capturing the nuanced qualities of generated text, particularly when there is no single ground truth. In this paper, we explore the potential of Large Language Models…

Computation and Language · Computer Science 2024-12-13 Manav Chaudhary , Harshit Gupta , Savita Bhat , Vasudeva Varma

Online reviews play a pivotal role in influencing consumer decisions across various domains, from purchasing products to selecting hotels or restaurants. However, the sheer volume of reviews -- often containing repetitive or irrelevant…

Computation and Language · Computer Science 2024-10-18 Mir Tafseer Nayeem , Davood Rafiei

Despite the rapid growth of context length of large language models (LLMs) , LLMs still perform poorly in long document summarization. An important reason for this is that relevant information about an event is scattered throughout long…

Computation and Language · Computer Science 2025-02-04 Taiji Li , Hao Chen , Fei Yu , Yin Zhang

Modern transportation systems face pressing challenges due to increasing demand, dynamic environments, and heterogeneous information integration. The rapid evolution of Large Language Models (LLMs) offers transformative potential to address…

Artificial Intelligence · Computer Science 2025-06-24 Tong Nie , Jian Sun , Wei Ma

In this study, we present the first comprehensive evaluation of modern LLMs - including GPT-4, GPT-4o, GPT-3.5-Turbo, Gemini 1.5 Pro, DeepSeek-V3, Llama 3.2, and BERT - across three core social media analytics tasks on a Twitter (X)…

Computation and Language · Computer Science 2026-04-22 Ramtin Davoudi , Kartik Thakkar , Nazanin Donyapour , Tyler Derr , Hamid Karimi

Large language models (LLMs), typically designed as a function of next-word prediction, have excelled across extensive NLP tasks. Despite the generality, next-word prediction is often not an efficient formulation for many of the tasks,…

Computation and Language · Computer Science 2023-11-03 Yuheng Zha , Yichi Yang , Ruichen Li , Zhiting Hu

The evolution of Neural Machine Translation (NMT) has been significantly influenced by six core challenges (Koehn and Knowles, 2017), which have acted as benchmarks for progress in this field. This study revisits these challenges, offering…

Computation and Language · Computer Science 2024-12-16 Jianhui Pang , Fanghua Ye , Longyue Wang , Dian Yu , Derek F. Wong , Shuming Shi , Zhaopeng Tu

Biomedical literature often uses complex language and inaccessible professional terminologies. That is why simplification plays an important role in improving public health literacy. Applying Natural Language Processing (NLP) models to…

Computation and Language · Computer Science 2024-03-19 Zihao Li , Samuel Belkadi , Nicolo Micheletti , Lifeng Han , Matthew Shardlow , Goran Nenadic

Code summarization facilitates program comprehension and software maintenance by converting code snippets into natural-language descriptions. Over the years, numerous methods have been developed for this task, but a key challenge remains:…

Software Engineering · Computer Science 2024-12-03 Yang Wu , Yao Wan , Zhaoyang Chu , Wenting Zhao , Ye Liu , Hongyu Zhang , Xuanhua Shi , Philip S. Yu

This article provides a systematic up-to-date survey of automatic summarization techniques, datasets, models, and evaluation methods in the legal domain. Through specific source selection criteria, we thoroughly review over 120 papers…

Computation and Language · Computer Science 2025-01-31 Mousumi Akter , Erion Çano , Erik Weber , Dennis Dobler , Ivan Habernal

In recent years, automatic text summarization has witnessed significant advancement, particularly with the development of transformer-based models. However, the challenge of controlling the readability level of generated summaries remains…

Computation and Language · Computer Science 2025-03-17 Mehmet Samet Duran , Tevfik Aytekin