English
Related papers

Related papers: Evaluating Small Language Models for News Summariz…

200 papers

Large Language Models (LLMs) demonstrate capabilities in code generation, potentially boosting developer productivity. However, their adoption remains limited by high computational costs, among other factors. Small Language Models (SLMs)…

Software Engineering · Computer Science 2025-09-23 Débora Souza , Rohit Gheyi , Lucas Albuquerque , Gustavo Soares , Márcio Ribeiro

Small language models (SLMs) offer promising and efficient alternatives to large language models (LLMs). However, SLMs' limited capacity restricts their reasoning capabilities and makes them sensitive to prompt variations. To address these…

Enterprise LLM applications require consistently high quality and reliable performance across diverse scenarios, demanding robustness to minor variations. Existing research shows that even small prompt changes can lead to substantial…

Machine Learning · Computer Science 2026-01-13 Tara Bogavelli , Oluwanifemi Bamgbose , Gabrielle Gauthier Melançon , Fanny Riols , Roshnee Sharma

Recent studies have used both automatic metrics and human evaluations to assess the simplification abilities of LLMs. However, the suitability of existing evaluation methodologies for LLMs remains in question. First, the suitability of…

Computation and Language · Computer Science 2025-07-15 Xuanxin Wu , Yuki Arase

Large Language Models (LLMs) have demonstrated remarkable performance across various Natural Language Processing (NLP) tasks, largely due to their generalisability and ability to perform tasks without additional training. However, their…

Computation and Language · Computer Science 2025-08-15 Kurt Micallef , Claudia Borg

This work focuses on the task of query-based meeting summarization in which the summary of a context (meeting transcript) is generated in response to a specific query. When using Large Language Models (LLMs) for this task, usually a new…

Computation and Language · Computer Science 2024-10-22 Md Tahmid Rahman Laskar , Elena Khasanova , Xue-Yong Fu , Cheng Chen , Shashi Bhushan TN

Large Language Model (LLM) agents significantly extend the capabilities of standalone LLMs, empowering them to interact with external tools (e.g., APIs, functions) and complete various tasks in a self-directed fashion. The challenge of tool…

Artificial Intelligence · Computer Science 2024-02-19 Weizhou Shen , Chenliang Li , Hongzhan Chen , Ming Yan , Xiaojun Quan , Hehong Chen , Ji Zhang , Fei Huang

The The use of Large language models (LLMs) to summarise parliamentary proceedings presents a promising means of increasing the accessibility of democratic participation. However, as these systems increasingly mediate access to political…

Computers and Society · Computer Science 2026-04-03 Eoghan Cunningham , James Cross , Derek Greene

Recent advances in test-time scaling have shown promising results in improving Large Language Model (LLM) performance through strategic computation allocation during inference. While this approach has demonstrated strong improvements in…

Computation and Language · Computer Science 2025-05-21 Juntai Cao , Xiang Zhang , Raymond Li , Chuyuan Li , Chenyu You , Shafiq Joty , Giuseppe Carenini

Small Language Models (SLMs) are increasingly being deployed in resource-constrained environments, yet their behavioral robustness to data contamination during instruction tuning remains poorly understood. We systematically investigate the…

Computation and Language · Computer Science 2025-11-11 Nicy Scaria , Silvester John Joseph Kennedy , Deepak Subramani

In this paper, we explore the potential of Large Language Models (LLMs) with assertions to mitigate imbalances in educational datasets. Traditional models often fall short in such contexts, particularly due to the complexity and nuanced…

Computers and Society · Computer Science 2024-07-03 Jeanne McClure , Machi Shimmei , Noboru Matsuda , Shiyan Jiang

Text summarization has been a crucial problem in natural language processing (NLP) for several decades. It aims to condense lengthy documents into shorter versions while retaining the most critical information. Various methods have been…

Computation and Language · Computer Science 2023-02-17 Xianjun Yang , Yan Li , Xinlu Zhang , Haifeng Chen , Wei Cheng

Traditional interventions for academic procrastination often fail to capture the nuanced, individual-specific factors that underlie them. Large language models (LLMs) hold immense potential for addressing this gap by permitting open-ended…

As educational systems evolve, ensuring that assessment items remain aligned with content standards is essential for maintaining fairness and instructional relevance. Traditional human alignment reviews are accurate but slow and…

Artificial Intelligence · Computer Science 2025-11-26 Farzan Karimi-Malekabadi , Pooya Razavi , Sonya Powers

We explore how large language models (LLMs) can enhance the proposal selection process at large user facilities, offering a scalable, consistent, and cost-effective alternative to traditional human review. Proposal selection depends on…

Artificial Intelligence · Computer Science 2025-12-12 Lijie Ding , Janell Thomson , Jon Taylor , Changwoo Do

The development of highly fluent large language models (LLMs) has prompted increased interest in assessing their reasoning and problem-solving capabilities. We investigate whether several LLMs can solve a classic type of deductive reasoning…

Computation and Language · Computer Science 2024-04-16 Spencer M. Seals , Valerie L. Shalin

Systematic literature reviews (SLRs) are essential but labor-intensive due to high publication volumes and inefficient keyword-based filtering. To streamline this process, we evaluate Large Language Models (LLMs) for enhancing efficiency…

Machine Learning · Computer Science 2025-06-17 Lucas Joos , Daniel A. Keim , Maximilian T. Fischer

Predicting future events is an important activity with applications across multiple fields and domains. For example, the capacity to foresee stock market trends, natural disasters, business developments, or political events can facilitate…

Computation and Language · Computer Science 2025-01-13 Petraq Nako , Adam Jatowt

Large Language Models (LLMs) have revolutionized many areas of artificial intelligence (AI), but their substantial resource requirements limit their deployment on mobile and edge devices. This survey paper provides a comprehensive overview…

Machine Learning · Computer Science 2025-09-03 Sanjay Surendranath Girija , Shashank Kapoor , Lakshit Arora , Dipen Pradhan , Aman Raj , Ankit Shetgaonkar

Dialogue summarization is a challenging task with significant practical value in customer service, meeting analysis, and conversational AI. Although large language models (LLMs) have achieved substantial progress in summarization tasks, the…

Computation and Language · Computer Science 2025-07-04 Keyan Jin , Yapeng Wang , Leonel Santos , Tao Fang , Xu Yang , Sio Kei Im , Hugo Gonçalo Oliveira