中文
相关论文

相关论文: Multimodal data matters: language model pre-traini…

200 篇论文

Unstructured data in Electronic Health Records (EHRs) often contains critical information -- complementary to imaging -- that could inform radiologists' diagnoses. But the large volume of notes often associated with patients together with…

计算与语言 · 计算机科学 2024-06-12 Hiba Ahsan , Denis Jered McInerney , Jisoo Kim , Christopher Potter , Geoffrey Young , Silvio Amir , Byron C. Wallace

Early prediction of mortality and length of stay(LOS) of a patient is vital for saving a patient's life and management of hospital resources. Availability of electronic health records(EHR) makes a huge impact on the healthcare domain and…

机器学习 · 计算机科学 2020-12-01 Batuhan Bardak , Mehmet Tan

Electronic health records (EHRs) contain patients' heterogeneous data that are collected from medical providers involved in the patient's care, including medical notes, clinical events, laboratory test results, symptoms, and diagnoses. In…

人工智能 · 计算机科学 2024-11-12 Shuai Niu , Yunya Song , Qing Yin , Yike Guo , Xian Yang

Multimodal learning is a rapidly growing research field that has revolutionized multitasking and generative modeling in AI. While much of the research has focused on dealing with unstructured data (e.g., language, images, audio, or video),…

人工智能 · 计算机科学 2024-03-11 Marco D Alessandro , Enrique Calabrés , Mikel Elkano

The breadth, scale, and temporal granularity of modern electronic health records (EHR) systems offers great potential for estimating personalized and contextual patient health trajectories using sequential deep learning. However, learning…

The widespread adoption of Electronic Health Record (EHR) systems in healthcare institutes has generated vast amounts of medical data, offering significant opportunities for improving healthcare services through deep learning techniques.…

机器学习 · 计算机科学 2024-01-23 Suhan Cui , Jiaqi Wang , Yuan Zhong , Han Liu , Ting Wang , Fenglong Ma

Multimodal representation learning has demonstrated remarkable potential in enabling models to process and integrate diverse data modalities, such as text and images, for improved understanding and performance. While the medical domain can…

计算机视觉与模式识别 · 计算机科学 2025-03-04 Shuvendu Roy , Franklin Ogidi , Ali Etemad , Elham Dolatabadi , Arash Afkanpour

Tabular data is often hidden in text, particularly in medical diagnostic reports. Traditional machine learning (ML) models designed to work with tabular data, cannot effectively process information in such form. On the other hand, large…

Pre-trained language models (PLMs), such as BERT and GPT, have revolutionized the field of NLP, not only in the general domain but also in the biomedical domain. Most prior efforts in building biomedical PLMs have resorted simply to domain…

计算与语言 · 计算机科学 2022-03-03 Quan Wang , Songtai Dai , Benfeng Xu , Yajuan Lyu , Yong Zhu , Hua Wu , Haifeng Wang

Patient similarity assessment, which identifies patients similar to a given patient, can help improve medical care. The assessment can be performed using Electronic Medical Records (EMRs). Patient similarity measurement requires converting…

信息检索 · 计算机科学 2022-09-20 Hoda Memarzadeh , Nasser Ghadiri , Matthias Samwald , Maryam Lotfi Shahreza

Recent advances in natural language processing (NLP) owe their success to pre-training language models on large amounts of unstructured data. Still, there is an increasing effort to combine the unstructured nature of LMs with structured…

计算与语言 · 计算机科学 2023-12-22 Juraj Vladika , Alexander Fichtl , Florian Matthes

Contemporary large language models (LLMs) may have utility for processing unstructured, narrative free-text clinical data contained in electronic health records (EHRs) -- a particularly important use-case for mental health where a majority…

人工智能 · 计算机科学 2024-04-01 Niall Taylor , Andrey Kormilitzin , Isabelle Lorge , Alejo Nevado-Holgado , Dan W Joyce

Electronic Health Records (EHRs) contain rich yet complex information, and their automated analysis is critical for clinical decision-making. Despite recent advances of large language models (LLMs) in clinical workflows, their ability to…

Automatic medication mining from clinical and biomedical text has become a popular topic due to its real impact on healthcare applications and the recent development of powerful language models (LMs). However, fully-automatic extraction…

计算与语言 · 计算机科学 2023-08-09 Haifa Alrdahi , Lifeng Han , Hendrik Šuvalov , Goran Nenadic

The overwhelming amount of biomedical scientific texts calls for the development of effective language models able to tackle a wide range of biomedical natural language processing (NLP) tasks. The most recent dominant approaches are…

计算与语言 · 计算机科学 2021-04-21 Giacomo Miolo , Giulio Mantoan , Carlotta Orsenigo

Electronic health records (EHR) is an inherently multimodal register of the patient's health status characterized by static data and multivariate time series (MTS). While MTS are a valuable tool for clinical prediction, their fusion with…

Electronic Health Records (EHRs), which contain patients' medical histories in various multi-modal formats, often overlook the potential for joint reasoning across imaging and table modalities underexplored in current EHR Question Answering…

In this study, we investigated the ability of the large language model (LLM) to enhance healthcare data interoperability. We leveraged the LLM to convert clinical texts into their corresponding FHIR resources. Our experiments, conducted on…

计算与语言 · 计算机科学 2023-10-23 Yikuan Li , Hanyin Wang , Halid Yerebakan , Yoshihisa Shinagawa , Yuan Luo

Multimodal large language models (MLLMs) enhance the capabilities of standard large language models by integrating and processing data from multiple modalities, including text, vision, audio, video, and 3D environments. Data plays a pivotal…

Word embeddings such as ELMo have recently been shown to model word semantics with greater efficacy through contextualized learning on large-scale language corpora, resulting in significant improvement in state of the art across many…

计算与语言 · 计算机科学 2019-09-11 Shao-Yen Tseng , Panayiotis Georgiou , Shrikanth Narayanan