English
Related papers

Related papers: CardioEmbed: Domain-Specialized Text Embeddings fo…

200 papers

Text embedding models play a cornerstone role in AI applications, such as retrieval-augmented generation (RAG). While general-purpose text embedding models demonstrate strong performance on generic retrieval benchmarks, their effectiveness…

Information Retrieval · Computer Science 2025-10-22 Yubai Wei , Jiale Han , Yi Yang

Automatic extraction of clinical concepts is an essential step for turning the unstructured data within a clinical note into structured and actionable information. In this work, we propose a clinical concept extraction model for automatic…

Computation and Language · Computer Science 2018-11-28 Henghui Zhu , Ioannis Ch. Paschalidis , Amir Tahmasebi

Today, we are seeing an ever-increasing number of clinical notes that contain clinical results, images, and textual descriptions of patient's health state. All these data can be analyzed and employed to cater novel services that can help…

Computation and Language · Computer Science 2021-06-10 Danilo Dessi , Rim Helaoui , Vivek Kumar , Diego Reforgiato Recupero , Daniele Riboni

Automatic identification and expansion of ambiguous abbreviations are essential for biomedical natural language processing applications, such as information retrieval and question answering systems. In this paper, we present DEep…

Computation and Language · Computer Science 2019-06-11 Qiao Jin , Jinling Liu , Xinghua Lu

The recent surge of foundation models in computer vision and natural language processing opens up perspectives in utilizing multi-modal clinical data to train large models with strong generalizability. Yet pathological image datasets often…

Computer Vision and Pattern Recognition · Computer Science 2023-07-28 Yunkun Zhang , Jin Gao , Mu Zhou , Xiaosong Wang , Yu Qiao , Shaoting Zhang , Dequan Wang

We propose Medical Entity Definition-based Sentence Embedding (MED-SE), a novel unsupervised contrastive learning framework designed for clinical texts, which exploits the definitions of medical entities. To this end, we conduct an…

Machine Learning · Computer Science 2022-12-12 Hyeonbin Hwang , Haanju Yoo , Yera Choi

Substantial increase in the use of Electronic Health Records (EHRs) has opened new frontiers for predictive healthcare. However, while EHR systems are nearly ubiquitous, they lack a unified code system for representing medical concepts.…

Machine Learning · Computer Science 2022-03-21 Kyunghoon Hur , Jiyoung Lee , Jungwoo Oh , Wesley Price , Young-Hak Kim , Edward Choi

Contextualized word embeddings derived from pre-trained language models (LMs) show significant improvements on downstream NLP tasks. Pre-training on domain-specific corpora, such as biomedical articles, further improves their performance.…

Computation and Language · Computer Science 2019-04-05 Qiao Jin , Bhuwan Dhingra , William W. Cohen , Xinghua Lu

Retrieval-Augmented Generation (RAG) systems in chemistry heavily depend on accurate and relevant retrieval of chemical literature. However, general-purpose text embedding models frequently fail to adequately represent complex chemical…

BACKGROUND: In this study, we investigated the efficacy of current state-of-the-art neural sentence embedding models for semantic similarity estimation of sentences from biomedical literature. We trained different neural embedding models on…

Computation and Language · Computer Science 2021-11-01 Kathrin Blagec , Hong Xu , Asan Agibetov , Matthias Samwald

Biomedical knowledge resources often either preserve evidence as unstructured text or compress it into flat triples that omit study design, provenance, and quantitative support. Here we present EvidenceNet, a disease-specific dataset of…

Computational Engineering, Finance, and Science · Computer Science 2026-04-15 Chang Zong , Sicheng Lv , Si-tu Xue , Huilin Zheng , Jian Wan , Lei Zhang

Named entity disambiguation (NED), which involves mapping textual mentions to structured entities, is particularly challenging in the medical domain due to the presence of rare entities. Existing approaches are limited by the presence of…

Computation and Language · Computer Science 2021-10-18 Maya Varma , Laurel Orr , Sen Wu , Megan Leszczynski , Xiao Ling , Christopher Ré

EHR systems lack a unified code system forrepresenting medical concepts, which acts asa barrier for the deployment of deep learningmodels in large scale to multiple clinics and hos-pitals. To overcome this problem, we…

Computation and Language · Computer Science 2022-01-19 Kyunghoon Hur , Jiyoung Lee , Jungwoo Oh , Wesley Price , Young-Hak Kim , Edward Choi

Neural network-based representations ("embeddings") have dramatically advanced natural language processing (NLP) tasks, including clinical NLP tasks such as concept extraction. Recently, however, more advanced embedding methods and…

Computation and Language · Computer Science 2019-08-15 Yuqi Si , Jingqi Wang , Hua Xu , Kirk Roberts

In this work, we introduce the Qwen3 Embedding series, a significant advancement over its predecessor, the GTE-Qwen series, in text embedding and reranking capabilities, built upon the Qwen3 foundation models. Leveraging the Qwen3 LLMs'…

Computation and Language · Computer Science 2025-06-12 Yanzhao Zhang , Mingxin Li , Dingkun Long , Xin Zhang , Huan Lin , Baosong Yang , Pengjun Xie , An Yang , Dayiheng Liu , Junyang Lin , Fei Huang , Jingren Zhou

While deep networks have achieved broad success in analyzing natural images, when applied to medical scans, they often fail in unexcepted situations. We investigate this challenge and focus on model sensitivity to domain shifts, such as…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Yue Yang , Mona Gandhi , Yufei Wang , Yifan Wu , Michael S. Yao , Chris Callison-Burch , James C. Gee , Mark Yatskar

Embedding models have become essential for retrieval-augmented generation (RAG) tasks, semantic clustering, and text re-ranking. But despite their growing use, many of these come with notable limitations. For example, Jina fails to capture…

Information Retrieval · Computer Science 2025-05-21 Anand Selvadurai , Jasheen Shaik , Girish Chandrasekar , ShriRadhaKrishnan Balamurugan , Eswara Reddy

Foundation models are reshaping medical imaging, yet their application in echocardiography remains limited, hindered by a heavy reliance on private datasets that prevent reproducible comparison. Echocardiography poses unique challenges,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Darya Taratynova , Ahmed Aly , Numan Saeed , Mohammad Yaqub

While dense biomedical embeddings achieve strong performance, their black-box nature limits their utility in clinical decision-making. Recent question-based interpretable embeddings represent text as binary answers to natural-language…

Computation and Language · Computer Science 2026-03-04 Yixuan Tang , Zhenghong Lin , Yandong Sun , Wynne Hsu , Mong Li Lee , Anthony K. H. Tung

Deep learning models exhibit state-of-the-art performance for many predictive healthcare tasks using electronic health records (EHR) data, but these models typically require training data volume that exceeds the capacity of most healthcare…

Machine Learning · Computer Science 2018-10-24 Edward Choi , Cao Xiao , Walter F. Stewart , Jimeng Sun