English
Related papers

Related papers: Medical Concept Embedding with Time-Aware Attentio…

200 papers

Pretraining multimodal models on Electronic Health Records (EHRs) provides a means of learning representations that can transfer to downstream tasks with minimal supervision. Recent multimodal models induce soft local alignments between…

Machine Learning · Computer Science 2023-02-27 Denis Jered McInerney , Geoffrey Young , Jan-Willem van de Meent , Byron C. Wallace

In this work, we introduce the Multiple Embedding Model for EHR (MEME), an approach that serializes multimodal EHR tabular data into text using pseudo-notes, mimicking clinical text generation. This conversion not only preserves better…

Computation and Language · Computer Science 2025-07-08 Simon A. Lee , Sujay Jain , Alex Chen , Kyoka Ono , Jennifer Fang , Akos Rudas , Jeffrey N. Chiang

The inherent multimodality and heterogeneous temporal structures of medical data pose significant challenges for modeling. We propose MedM2T, a time-aware multimodal framework designed to address these complexities. MedM2T integrates: (i)…

Machine Learning · Computer Science 2026-03-26 Yu-Chen Kuo , Yi-Ju Tseng

Electronic health records (EHR) contain narrative notes that provide extensive details on the medical condition and management of patients. Natural language processing (NLP) of clinical notes can use observed frequencies of clinical terms…

Computation and Language · Computer Science 2023-07-04 Bryan Cai , Sihang Zeng , Yucong Lin , Zheng Yuan , Doudou Zhou , Lu Tian

We present a comprehensive analysis of deep learning approaches for Electronic Health Record (EHR) time-series imputation, examining how architectural and framework biases combine to influence model performance. Our investigation reveals…

Machine Learning · Computer Science 2025-02-05 Linglong Qian , Tao Wang , Jun Wang , Hugh Logan Ellis , Robin Mitra , Richard Dobson , Zina Ibrahim

Automatic analysis of biomedical time series such as electroencephalogram (EEG) and electrocardiographic (ECG) signals has attracted great interest in the community of biomedical engineering due to its important applications in medicine. In…

Machine Learning · Computer Science 2016-11-17 Jin Wang , Ping Liu , Mary F. H. She , Saeid Nahavandi , and Abbas Kouzani

Integrating multimodal Electronic Health Records (EHR) data, such as numerical time series and free-text clinical reports, has great potential in predicting clinical outcomes. However, prior work has primarily focused on capturing temporal…

Machine Learning · Computer Science 2025-11-10 Fuying Wang , Feng Wu , Yihan Tang , Lequan Yu

Electronic health records (EHR) are increasingly being used for constructing disease risk prediction models. Feature engineering in EHR data however is challenging due to their highly dimensional and heterogeneous nature. Low-dimensional…

Computation and Language · Computer Science 2018-11-29 Spiros Denaxas , Pontus Stenetorp , Sebastian Riedel , Maria Pikoula , Richard Dobson , Harry Hemingway

Medical text embedding models are foundational to a wide array of healthcare applications, ranging from clinical decision support and biomedical information retrieval to medical question answering, yet they remain hampered by two critical…

Computation and Language · Computer Science 2025-08-07 Mohammad Khodadad , Ali Shiraee Kasmaee , Mahdi Astaraki , Hamidreza Mahyar

Natural language processing techniques are being applied to increasingly diverse types of electronic health records, and can benefit from in-depth understanding of the distinguishing characteristics of medical document types. We present a…

Computation and Language · Computer Science 2019-10-02 Denis Newman-Griffis , Eric Fosler-Lussier

A promising application of AI to healthcare is the retrieval of information from electronic health records (EHRs), e.g. to aid clinicians in finding relevant information for a consultation or to recruit suitable patients for a study. This…

Computation and Language · Computer Science 2020-11-02 Claudia Schulz , Josh Levy-Kramer , Camille Van Assel , Miklos Kepes , Nils Hammerla

The clinical notes are usually typed into the system by physicians. They are typically required to be marked by standard medical codes, and each code represents a diagnosis or medical treatment procedure. Annotating these notes is time…

Machine Learning · Computer Science 2023-05-10 Guodong Liu

Electronic health record (EHR) data is sparse and irregular as it is recorded at irregular time intervals, and different clinical variables are measured at each observation point. In this work, we propose a multi-view features integration…

Machine Learning · Computer Science 2021-01-27 Yurim Lee , Eunji Jun , Heung-Il Suk

Neural network-based representations ("embeddings") have dramatically advanced natural language processing (NLP) tasks, including clinical NLP tasks such as concept extraction. Recently, however, more advanced embedding methods and…

Computation and Language · Computer Science 2019-08-15 Yuqi Si , Jingqi Wang , Hua Xu , Kirk Roberts

Electronic health records (EHRs) are designed to synthesize diverse data types, including unstructured clinical notes, structured lab tests, and time-series visit data. Physicians draw on these multimodal and temporal sources of EHR data to…

In video analysis, understanding the temporal context is crucial for recognizing object interactions, event patterns, and contextual changes over time. The proposed model leverages adjacency and semantic similarities between objects from…

Computer Vision and Pattern Recognition · Computer Science 2024-08-26 Ahnaf Farhan , M. Shahriar Hossain

Word embeddings are effective intermediate representations for capturing semantic regularities between words, when learning the representations of text sequences. We propose to view text classification as a label-word joint embedding…

Computation and Language · Computer Science 2018-05-14 Guoyin Wang , Chunyuan Li , Wenlin Wang , Yizhe Zhang , Dinghan Shen , Xinyuan Zhang , Ricardo Henao , Lawrence Carin

We propose a novel and interpretable embedding method to represent the international statistical classification codes of diseases and related health problems (i.e., ICD codes). This method considers a self-attention mechanism within the…

Applications · Statistics 2019-06-14 Dixin Luo , Hongteng Xu , Lawrence Carin

Accurate and interpretable mortality risk prediction in intensive care units (ICUs) remains a critical challenge due to the irregular temporal structure of electronic health records (EHRs), the complexity of longitudinal disease…

Machine Learning · Computer Science 2026-03-10 Zahra Jafari , Azadeh Zamanifar , Amirfarhad Farhadi

Text classification tasks which aim at harvesting and/or organizing information from electronic health records are pivotal to support clinical and translational research. However these present specific challenges compared to other…

Computation and Language · Computer Science 2020-05-15 Aurelie Mascio , Zeljko Kraljevic , Daniel Bean , Richard Dobson , Robert Stewart , Rebecca Bendayan , Angus Roberts