English
Related papers

Related papers: Attribute Structuring Improves LLM-Based Evaluatio…

200 papers

Explaining reinforcement learning agents is challenging because policies emerge from complex reward structures and neural representations that are difficult for humans to interpret. Existing approaches often rely on curated demonstrations…

Machine Learning · Computer Science 2026-01-09 Sahar Admoni , Assaf Hallak , Yftah Ziser , Omer Ben-Porat , Ofra Amir

Remarkable advances in large language models (LLMs) have enabled high-quality text summarization. However, this capability is currently accessible only through LLMs of substantial size or proprietary LLMs with usage fees. In response,…

Computation and Language · Computer Science 2024-11-20 Sangwon Ryu , Heejin Do , Yunsu Kim , Gary Geunbae Lee , Jungseul Ok

Europe's healthcare systems require enhanced interoperability and digitalization, driving a demand for innovative solutions to process legacy clinical data. This paper presents the results of our project, which aims to leverage Large…

Computation and Language · Computer Science 2025-07-09 Aynur Guluzade , Naguib Heiba , Zeyd Boukhers , Florim Hamiti , Jahid Hasan Polash , Yehya Mohamad , Carlos A Velasco

Structured data offers a sophisticated mechanism for the organization of information. Existing methodologies for the text-serialization of structured data in the context of large language models fail to adequately address the heterogeneity…

Computation and Language · Computer Science 2024-02-20 YiQiu Guo , Yuchen Yang , Ya Zhang , Yu Wang , Yanfeng Wang

The application of Artificial Intelligence (AI) in healthcare has been revolutionary, especially with the recent advancements in transformer-based Large Language Models (LLMs). However, the task of understanding unstructured electronic…

Computation and Language · Computer Science 2023-08-08 Shivani Shekhar , Simran Tiwari , T. C. Rensink , Ramy Eskander , Wael Salloum

Modern natural language generation systems with Large Language Models (LLMs) exhibit the capability to generate a plausible summary of multiple documents; however, it is uncertain if they truly possess the capability of information…

Computation and Language · Computer Science 2024-06-05 Miao Li , Jey Han Lau , Eduard Hovy

Large Language Models (LLMs) continue to advance natural language processing with their ability to generate human-like text across a range of tasks. Despite the remarkable success of LLMs in Natural Language Processing (NLP), their…

Computation and Language · Computer Science 2025-07-08 Walid Mohamed Aly , Taysir Hassan A. Soliman , Amr Mohamed AbdelAziz

Clinical notes contain valuable, context-rich information, but their unstructured format introduces several challenges, including unintended biases (e.g., gender or racial bias), and poor generalization across clinical settings (e.g.,…

Computation and Language · Computer Science 2025-11-18 Karthikeyan K , Raghuveer Thirukovalluru , David Carlson

Large Language Models (LLMs) have achieved remarkable success in various domains. However, when handling long-form text modification tasks, they still face two major problems: (1) producing undesired modifications by inappropriately…

Computation and Language · Computer Science 2025-06-02 Yuntao Shi , Yi Luo , Yeyun Gong , Chen Lin

Large language models (LLMs) are increasingly used in modern search and answer systems to synthesize multiple, sometimes conflicting, texts into a single response, yet current pipelines offer weak incentives for sources to be accurate and…

Computation and Language · Computer Science 2026-02-26 Yanchen Jiang , Zhe Feng , Aranyak Mehta

Large Language Models (LLMs) have revolutionized various Natural Language Generation (NLG) tasks, including Argument Summarization (ArgSum), a key subfield of Argument Mining. This paper investigates the integration of state-of-the-art LLMs…

Computation and Language · Computer Science 2025-10-10 Moritz Altemeyer , Steffen Eger , Johannes Daxenberger , Yanran Chen , Tim Altendorf , Philipp Cimiano , Benjamin Schiller

Aspect-based summarization has attracted significant attention for its ability to generate more fine-grained and user-aligned summaries. While most existing approaches assume a set of predefined aspects as input, real-world scenarios often…

Computation and Language · Computer Science 2025-10-09 Yong-En Tian , Yu-Chien Tang , An-Zi Yen , Wen-Chih Peng

The Achilles heel of Large Language Models (LLMs) is hallucination, which has drastic consequences for the clinical domain. This is particularly important with regards to automatically generating discharge summaries (a lengthy medical…

Computation and Language · Computer Science 2025-06-18 Paul Landes , Sitara Rao , Aaron Jeremy Chaise , Barbara Di Eugenio

Rapid advancements in large language models have unlocked remarkable capabilities when it comes to processing and summarizing unstructured text data. This has implications for the analysis of rich, open-ended datasets, such as survey…

The field of healthcare has increasingly turned its focus towards Large Language Models (LLMs) due to their remarkable performance. However, their performance in actual clinical applications has been underexplored. Traditional evaluations…

Large Language Models (LLMs) have demonstrated superior performance in listwise passage reranking task. However, directly applying them to rank long-form documents introduces both effectiveness and efficiency issues due to the substantially…

Information Retrieval · Computer Science 2026-03-26 Jincheng Feng , Wenhan Liu , Zhicheng Dou

The quality of meeting summaries generated by natural language generation (NLG) systems is hard to measure automatically. Established metrics such as ROUGE and BERTScore have a relatively low correlation with human judgments and fail to…

Computation and Language · Computer Science 2025-02-19 Frederic Kirstein , Terry Ruas , Bela Gipp

This study introduces an ensemble framework for unstructured text categorization using large language models (LLMs). By integrating multiple models, the ensemble large language model (eLLM) framework addresses common weaknesses of…

Artificial Intelligence · Computer Science 2025-11-21 Ariel Kamen , Yakov Kamen

The practice of evidence-based medicine (EBM) urges medical practitioners to utilise the latest research evidence when making clinical decisions. Because of the massive and growing volume of published research on various medical topics,…

Computation and Language · Computer Science 2017-06-27 Abeed Sarker , Diego Molla , Cecile Paris

Large Language Models (LLMs) have spurred interest in automatic evaluation methods for summarization, offering a faster, more cost-effective alternative to human evaluation. However, existing methods often fall short when applied to complex…

Computation and Language · Computer Science 2024-09-18 Ziwei Gong , Lin Ai , Harshsaiprasad Deshpande , Alexander Johnson , Emmy Phung , Zehui Wu , Ahmad Emami , Julia Hirschberg