English
Related papers

Related papers: MedCite: Can Language Models Generate Verifiable T…

200 papers

While recent Large Language Models (LLMs) have proven useful in answering user queries, they are prone to hallucination, and their responses often lack credibility due to missing references to reliable sources. An intuitive solution to…

Computation and Language · Computer Science 2024-09-04 Chengyu Huang , Zeqiu Wu , Yushi Hu , Wenya Wang

Evaluating LLM-generated text has become a key challenge, especially in domain-specific contexts like the medical field. This work introduces a novel evaluation methodology for LLM-generated medical explanatory arguments, relying on Proxy…

Computation and Language · Computer Science 2024-10-01 Iker De la Iglesia , Iakes Goenaga , Johanna Ramirez-Romero , Jose Maria Villa-Gonzalez , Josu Goikoetxea , Ander Barrena

Modern natural language generation systems with Large Language Models (LLMs) exhibit the capability to generate a plausible summary of multiple documents; however, it is uncertain if they truly possess the capability of information…

Computation and Language · Computer Science 2024-06-05 Miao Li , Jey Han Lau , Eduard Hovy

Large Language Models (LLMs) have been widely adopted across various domains, yet their application in the medical field poses unique challenges, particularly concerning the generation of hallucinations. Hallucinations in open-ended long…

Computation and Language · Computer Science 2025-01-22 Zenan Huang , Mingwei Li , Zheng Zhou , Youxin Jiang

Large Language Models (LLMs) with reasoning capabilities have recently demonstrated strong potential in medical Question Answering (QA). Existing approaches are largely English-focused and primarily rely on distillation from general-purpose…

Computation and Language · Computer Science 2026-03-31 Pietro Ferrazzi , Aitor Soroa , Rodrigo Agerri

Recent surge in the accessibility of large language models (LLMs) to the general population can lead to untrackable use of such models for medical-related recommendations. Language generation via LLMs models has two key problems: firstly,…

Computation and Language · Computer Science 2024-07-24 Ioana Buhnila , Aman Sinha , Mathieu Constant

We introduce a novel evaluation framework for Large Language Models (LLMs) such as \textsc{Llama-2} and \textsc{Mistral}, focusing on importing Precision and Recall metrics from image generation to text generation. This approach allows for…

Computation and Language · Computer Science 2024-06-05 Florian Le Bronnec , Alexandre Verine , Benjamin Negrevergne , Yann Chevaleyre , Alexandre Allauzen

The advent of Large Language Models (LLMs) has shown the potential to improve relevance and provide direct answers in web searches. However, challenges arise in validating the reliability of generated results and the credibility of…

Information Retrieval · Computer Science 2023-10-20 Xiang Shi , Jiawei Liu , Yinpeng Liu , Qikai Cheng , Wei Lu

Large language models (LLMs) have demonstrated impressive capabilities in natural language generation. However, their output quality can be inconsistent, posing challenges for generating natural language from logical forms (LFs). This task…

Computation and Language · Computer Science 2023-09-22 Levon Haroutunian , Zhuang Li , Lucian Galescu , Philip Cohen , Raj Tumuluri , Gholamreza Haffari

Trustworthy Large Language Models (LLMs) must cite human-verifiable sources in high-stakes domains such as healthcare, law, academia, and finance, where even small errors can have severe consequences. Practitioners and researchers face a…

Computation and Language · Computer Science 2025-12-19 Yash Saxena , Raviteja Bommireddy , Ankur Padia , Manas Gaur

Deploying Large Language Models (LLMs) in medical applications requires fact-checking capabilities to ensure patient safety and regulatory compliance. We introduce MedFact, a challenging Chinese medical fact-checking benchmark with 2,116…

Computation and Language · Computer Science 2025-11-18 Jiayi He , Yangmin Huang , Qianyun Du , Xiangying Zhou , Zhiyang He , Jiaxue Hu , Xiaodong Tao , Lixian Lai

Predicting highly-cited papers is a long-standing challenge due to the complex interactions of research content, scholarly communities, and temporal dynamics. Recent advances in large language models (LLMs) raise the question of whether…

Applications · Statistics 2026-01-21 Zhanshuo Ye , Yiming Hou , Rui Pan , Tianchen Gao , Hansheng Wang

Medical systematic reviews play a vital role in healthcare decision making and policy. However, their production is time-consuming, limiting the availability of high-quality and up-to-date evidence summaries. Recent advancements in large…

Computation and Language · Computer Science 2023-10-19 Hye Sun Yun , Iain J. Marshall , Thomas A. Trikalinos , Byron C. Wallace

Large language models (LLMs) generate fluent text across a wide range of tasks, but the fabrication of non-existent academic citations remains a critical and well-documented failure mode. Building on prior work that frames hallucination and…

Computation and Language · Computer Science 2026-05-06 Junichiro Niimi

The generative capabilities of LLM models offer opportunities for accelerating tasks but raise concerns about the authenticity of the knowledge they produce. To address these concerns, we present a computational approach that evaluates the…

Artificial Intelligence · Computer Science 2025-03-25 Ahmed Abdeen Hamed , Alessandro Crimi , Magdalena M. Misiak , Byung Suk Lee

Safe and trustworthy use of Large Language Models (LLM) in the processing of healthcare documents and scientific papers could substantially help clinicians, scientists and policymakers in overcoming information overload and focusing on the…

Effective patient care in digital healthcare requires large language models (LLMs) that not only answer questions but also actively gather critical information through well-crafted inquiries. This paper introduces HealthQ, a novel framework…

Computation and Language · Computer Science 2025-02-26 Ziyu Wang , Hao Li , Di Huang , Hye-Sung Kim , Chae-Won Shin , Amir M. Rahmani

Assessing the quality of scientific research is essential for scholarly communication, yet widely used approaches face limitations in scalability, subjectivity, and time delay. Recent advances in large language models (LLMs) offer new…

Information Retrieval · Computer Science 2026-04-21 Mengjia Wu , Yi Zhang , Robin Haunschild , Lutz Bornmann

Empowered by vast internal knowledge reservoir, the new generation of large language models (LLMs) demonstrate untapped potential to tackle medical tasks. However, there is insufficient effort made towards summoning up a synergic effect…

Computation and Language · Computer Science 2025-05-23 Kexin Shang , Chia-Hsuan Chang , Christopher C. Yang

LongRecall. The completeness of machine-generated text, ensuring that it captures all relevant information, is crucial in domains such as medicine and law and in tasks like list-based question answering (QA), where omissions can have…

Computation and Language · Computer Science 2025-08-22 MohamamdJavad Ardestani , Ehsan Kamalloo , Davood Rafiei