English
Related papers

Related papers: Multimodal data matters: language model pre-traini…

200 papers

Unstructured data in Electronic Health Records (EHRs) often contains critical information -- complementary to imaging -- that could inform radiologists' diagnoses. But the large volume of notes often associated with patients together with…

Computation and Language · Computer Science 2024-06-12 Hiba Ahsan , Denis Jered McInerney , Jisoo Kim , Christopher Potter , Geoffrey Young , Silvio Amir , Byron C. Wallace

Early prediction of mortality and length of stay(LOS) of a patient is vital for saving a patient's life and management of hospital resources. Availability of electronic health records(EHR) makes a huge impact on the healthcare domain and…

Machine Learning · Computer Science 2020-12-01 Batuhan Bardak , Mehmet Tan

Electronic health records (EHRs) contain patients' heterogeneous data that are collected from medical providers involved in the patient's care, including medical notes, clinical events, laboratory test results, symptoms, and diagnoses. In…

Artificial Intelligence · Computer Science 2024-11-12 Shuai Niu , Yunya Song , Qing Yin , Yike Guo , Xian Yang

Multimodal learning is a rapidly growing research field that has revolutionized multitasking and generative modeling in AI. While much of the research has focused on dealing with unstructured data (e.g., language, images, audio, or video),…

Artificial Intelligence · Computer Science 2024-03-11 Marco D Alessandro , Enrique Calabrés , Mikel Elkano

The breadth, scale, and temporal granularity of modern electronic health records (EHR) systems offers great potential for estimating personalized and contextual patient health trajectories using sequential deep learning. However, learning…

The widespread adoption of Electronic Health Record (EHR) systems in healthcare institutes has generated vast amounts of medical data, offering significant opportunities for improving healthcare services through deep learning techniques.…

Machine Learning · Computer Science 2024-01-23 Suhan Cui , Jiaqi Wang , Yuan Zhong , Han Liu , Ting Wang , Fenglong Ma

Multimodal representation learning has demonstrated remarkable potential in enabling models to process and integrate diverse data modalities, such as text and images, for improved understanding and performance. While the medical domain can…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Shuvendu Roy , Franklin Ogidi , Ali Etemad , Elham Dolatabadi , Arash Afkanpour

Tabular data is often hidden in text, particularly in medical diagnostic reports. Traditional machine learning (ML) models designed to work with tabular data, cannot effectively process information in such form. On the other hand, large…

Machine Learning · Computer Science 2023-06-09 Aleksa Bisercic , Mladen Nikolic , Mihaela van der Schaar , Boris Delibasic , Pietro Lio , Andrija Petrovic

Pre-trained language models (PLMs), such as BERT and GPT, have revolutionized the field of NLP, not only in the general domain but also in the biomedical domain. Most prior efforts in building biomedical PLMs have resorted simply to domain…

Computation and Language · Computer Science 2022-03-03 Quan Wang , Songtai Dai , Benfeng Xu , Yajuan Lyu , Yong Zhu , Hua Wu , Haifeng Wang

Patient similarity assessment, which identifies patients similar to a given patient, can help improve medical care. The assessment can be performed using Electronic Medical Records (EMRs). Patient similarity measurement requires converting…

Information Retrieval · Computer Science 2022-09-20 Hoda Memarzadeh , Nasser Ghadiri , Matthias Samwald , Maryam Lotfi Shahreza

Recent advances in natural language processing (NLP) owe their success to pre-training language models on large amounts of unstructured data. Still, there is an increasing effort to combine the unstructured nature of LMs with structured…

Computation and Language · Computer Science 2023-12-22 Juraj Vladika , Alexander Fichtl , Florian Matthes

Contemporary large language models (LLMs) may have utility for processing unstructured, narrative free-text clinical data contained in electronic health records (EHRs) -- a particularly important use-case for mental health where a majority…

Artificial Intelligence · Computer Science 2024-04-01 Niall Taylor , Andrey Kormilitzin , Isabelle Lorge , Alejo Nevado-Holgado , Dan W Joyce

Electronic Health Records (EHRs) contain rich yet complex information, and their automated analysis is critical for clinical decision-making. Despite recent advances of large language models (LLMs) in clinical workflows, their ability to…

Computation and Language · Computer Science 2025-11-26 Yusheng Liao , Chaoyi Wu , Junwei Liu , Shuyang Jiang , Pengcheng Qiu , Haowen Wang , Yun Yue , Shuai Zhen , Jian Wang , Qianrui Fan , Jinjie Gu , Ya Zhang , Yanfeng Wang , Yu Wang , Weidi Xie

Automatic medication mining from clinical and biomedical text has become a popular topic due to its real impact on healthcare applications and the recent development of powerful language models (LMs). However, fully-automatic extraction…

Computation and Language · Computer Science 2023-08-09 Haifa Alrdahi , Lifeng Han , Hendrik Šuvalov , Goran Nenadic

The overwhelming amount of biomedical scientific texts calls for the development of effective language models able to tackle a wide range of biomedical natural language processing (NLP) tasks. The most recent dominant approaches are…

Computation and Language · Computer Science 2021-04-21 Giacomo Miolo , Giulio Mantoan , Carlotta Orsenigo

Electronic health records (EHR) is an inherently multimodal register of the patient's health status characterized by static data and multivariate time series (MTS). While MTS are a valuable tool for clinical prediction, their fusion with…

Electronic Health Records (EHRs), which contain patients' medical histories in various multi-modal formats, often overlook the potential for joint reasoning across imaging and table modalities underexplored in current EHR Question Answering…

Computation and Language · Computer Science 2023-12-27 Seongsu Bae , Daeun Kyung , Jaehee Ryu , Eunbyeol Cho , Gyubok Lee , Sunjun Kweon , Jungwoo Oh , Lei Ji , Eric I-Chao Chang , Tackeun Kim , Edward Choi

In this study, we investigated the ability of the large language model (LLM) to enhance healthcare data interoperability. We leveraged the LLM to convert clinical texts into their corresponding FHIR resources. Our experiments, conducted on…

Computation and Language · Computer Science 2023-10-23 Yikuan Li , Hanyin Wang , Halid Yerebakan , Yoshihisa Shinagawa , Yuan Luo

Multimodal large language models (MLLMs) enhance the capabilities of standard large language models by integrating and processing data from multiple modalities, including text, vision, audio, video, and 3D environments. Data plays a pivotal…

Artificial Intelligence · Computer Science 2024-07-19 Tianyi Bai , Hao Liang , Binwang Wan , Yanran Xu , Xi Li , Shiyu Li , Ling Yang , Bozhou Li , Yifan Wang , Bin Cui , Ping Huang , Jiulong Shan , Conghui He , Binhang Yuan , Wentao Zhang

Word embeddings such as ELMo have recently been shown to model word semantics with greater efficacy through contextualized learning on large-scale language corpora, resulting in significant improvement in state of the art across many…

Computation and Language · Computer Science 2019-09-11 Shao-Yen Tseng , Panayiotis Georgiou , Shrikanth Narayanan