English
Related papers

Related papers: ClinicalMamba: A Generative Clinical Language Mode…

200 papers

We introduce BlaBla, an open-source Python library for extracting linguistic features with proven clinical relevance to neurological and psychiatric diseases across many languages. BlaBla is a unifying framework for accelerating and…

Computation and Language · Computer Science 2020-05-21 Abhishek Shivkumar , Jack Weston , Raphael Lenain , Emil Fristed

Reasoning Large Language Models (LLMs) with enhanced accuracy and explainability are increasingly being adopted in the medical domain, as the life-critical nature of clinical decision-making demands reliable support. Despite these…

Computation and Language · Computer Science 2025-11-12 Sung-Min Lee , Siyoon Lee , Juyeon Kim , Kyoungmin Roh

Large language models (LLMs) such as GPT-4o and o1 have demonstrated strong performance on clinical natural language processing (NLP) tasks across multiple medical benchmarks. Nonetheless, two high-impact NLP tasks - structured tabular…

With the explosive growth of data, long-sequence modeling has become increasingly important in tasks such as natural language processing and bioinformatics. However, existing methods face inherent trade-offs between efficiency and memory.…

Machine Learning · Computer Science 2025-10-07 Youjin Wang , Yangjingyi Chen , Jiahao Yan , Jiaxuan Lu , Xiao Sun

Transformer and its derivatives have achieved success in diverse tasks across computer vision, natural language processing, and speech processing. To reduce the complexity of computations within the multi-head self-attention mechanism in…

Audio and Speech Processing · Electrical Eng. & Systems 2025-04-29 Xiangyu Zhang , Qiquan Zhang , Hexin Liu , Tianyi Xiao , Xinyuan Qian , Beena Ahmed , Eliathamby Ambikairajah , Haizhou Li , Julien Epps

Large Language Models (LLMs) are increasingly used in everyday life and research. One of the most common use cases is conversational interactions, enabled by the language generation capabilities of LLMs. Just as between two humans, a…

Computation and Language · Computer Science 2024-11-12 Jingyao Zheng , Xian Wang , Simo Hosio , Xiaoxian Xu , Lik-Hang Lee

Longitudinal information in radiology reports refers to the sequential tracking of findings across multiple examinations over time, which is crucial for monitoring disease progression and guiding clinical decisions. Many recent automated…

Computation and Language · Computer Science 2026-01-26 Xinyi Wang , Grazziela Figueredo , Ruizhe Li , Xin Chen

Clinical diagnosis prediction models, when provided with a patient's medical history, aim to detect potential diseases early, facilitating timely intervention and improving prognostic outcomes. However, the inherent scarcity of patient data…

Computation and Language · Computer Science 2025-01-30 Mingyu Derek Ma , Xiaoxuan Wang , Yijia Xiao , Anthony Cuturrufo , Vijay S Nori , Eran Halperin , Wei Wang

Clinical reasoning in medicine is a hypothesis-driven process where physicians refine diagnoses from limited information through targeted history, physical examination, and diagnostic investigations. In contrast, current medical benchmarks…

Machine Learning · Computer Science 2025-10-14 Christopher Chiu , Silviu Pitis , Mihaela van der Schaar

The development of open-source, multilingual medical language models can benefit a wide, linguistically diverse audience from different regions. To promote this domain, we present contributions from the following: First, we construct a…

Computation and Language · Computer Science 2024-06-04 Pengcheng Qiu , Chaoyi Wu , Xiaoman Zhang , Weixiong Lin , Haicheng Wang , Ya Zhang , Yanfeng Wang , Weidi Xie

High-throughput phenotyping, the automated mapping of patient signs and symptoms to standardized ontology concepts, is essential to gaining value from electronic health records (EHR) in the support of precision medicine. Despite…

Artificial Intelligence · Computer Science 2024-06-24 Syed I. Munzir , Daniel B. Hier , Chelsea Oommen , Michael D. Carrithers

Large Language Models (LLMs) demonstrate remarkable versatility in various NLP tasks but encounter distinct challenges in biomedical due to the complexities of language and data scarcity. This paper investigates LLMs application in the…

Computation and Language · Computer Science 2024-07-12 Masoud Monajatipoor , Jiaxin Yang , Joel Stremmel , Melika Emami , Fazlolah Mohaghegh , Mozhdeh Rouhsedaghat , Kai-Wei Chang

The exponential growth of text-based data in domains such as healthcare, education, and social sciences has outpaced the capacity of traditional qualitative analysis methods, which are time-intensive and prone to subjectivity. Large…

Understanding how individuals with Parkinson's disease (PD) describe cognitive experiences in their daily lives can offer valuable insights into disease-related cognitive and emotional changes. However, extracting such information from…

Computation and Language · Computer Science 2025-11-13 Varada Khanna , Nilay Bhatt , Ikgyu Shin , Sule Tinaz , Yang Ren , Hua Xu , Vipina K. Keloth

Large language models (LLMs) can capture rich representations of concepts that are useful for real-world tasks. However, language alone is limited. While existing LLMs excel at text-based inferences, health applications require that models…

Computation and Language · Computer Science 2023-05-26 Xin Liu , Daniel McDuff , Geza Kovacs , Isaac Galatzer-Levy , Jacob Sunshine , Jiening Zhan , Ming-Zher Poh , Shun Liao , Paolo Di Achille , Shwetak Patel

The field of natural language processing (NLP) has recently seen a large change towards using pre-trained language models for solving almost any task. Despite showing great improvements in benchmark datasets for various tasks, these models…

Computation and Language · Computer Science 2022-05-24 Lukas Lange , Heike Adel , Jannik Strötgen , Dietrich Klakow

The domain of Natural Language Processing (NLP) has experienced notable progress in the evolution of Bangla Question Answering (QA) systems. This paper presents a comprehensive review of seven research articles that contribute to the…

Computation and Language · Computer Science 2024-12-17 Md Iftekhar Islam Tashik , Abdullah Khondoker , Enam Ahmed Taufik , Antara Firoz Parsa , S M Ishtiak Mahmud

Extracting structured medical insights from unstructured clinical text using Natural Language Processing (NLP) remains an open challenge in healthcare, particularly in non-English contexts where resources are scarce. This study presents a…

Artificial Intelligence · Computer Science 2025-11-21 Paulina Tworek , Miłosz Bargieł , Yousef Khan , Tomasz Pełech-Pilichowski , Marek Mikołajczyk , Roman Lewandowski , Jose Sousa

Clinical decision support systems require models that are not only highly accurate but also equitable and sensitive to the implications of missed diagnoses. In this study, we introduce a knowledge-guided in-context learning (ICL) framework…

Machine Learning · Computer Science 2025-07-28 Fatemeh Nazary , Yashar Deldjoo , Tommaso Di Noia , Eugenio di Sciascio

While Transformer language models (LMs) are state-of-the-art for information extraction, long text introduces computational challenges requiring suboptimal preprocessing steps or alternative model architectures. Sparse attention LMs can…

Computation and Language · Computer Science 2022-12-01 Joel Stremmel , Brian L. Hill , Jeffrey Hertzberg , Jaime Murillo , Llewelyn Allotey , Eran Halperin