English
Related papers

Related papers: Cohort Retrieval using Dense Passage Retrieval

200 papers

We apply deep learning-based language models to the task of patient cohort retrieval (CR) with the aim to assess their efficacy. The task of CR requires the extraction of relevant documents from the electronic health records (EHRs) on the…

Information Retrieval · Computer Science 2020-09-14 Sarvesh Soni , Kirk Roberts

Electronic Health Records (EHRs) are pivotal in clinical practices, yet their retrieval remains a challenge mainly due to semantic gap issues. Recent advancements in dense retrieval offer promising solutions but existing models, both…

Information Retrieval · Computer Science 2025-07-25 Zhengyun Zhao , Huaiyuan Ying , Yue Zhong , Sheng Yu

Identifying patient cohorts is fundamental to numerous healthcare tasks, including clinical trial recruitment and retrospective studies. Current cohort retrieval methods in healthcare organizations rely on automated queries of structured…

Cohort studies are of significant importance in the field of healthcare analysis. However, existing methods typically involve manual, labor-intensive, and expert-driven pattern definitions or rely on simplistic clustering techniques that…

Machine Learning · Computer Science 2024-06-21 Qingpeng Cai , Kaiping Zheng , H. V. Jagadish , Beng Chin Ooi , James Yip

Dense neural text retrieval has achieved promising results on open-domain Question Answering (QA), where latent representations of questions and passages are exploited for maximum inner product search in the retrieval process. However,…

Information Retrieval · Computer Science 2021-11-01 Ye Liu , Kazuma Hashimoto , Yingbo Zhou , Semih Yavuz , Caiming Xiong , Philip S. Yu

Electronic Health Records (EHR) are generated from clinical routine care recording valuable information of broad patient populations, which provide plentiful opportunities for improving patient management and intervention strategies in…

Machine Learning · Computer Science 2023-04-13 Changshuo Liu , Wenqiao Zhang , Beng Chin Ooi , James Wei Luen Yip , Lingze Zeng , Kaiping Zheng

Background: Widespread adoption of electronic health records (EHRs) has enabled secondary use of EHR data for clinical research and healthcare delivery. Natural language processing (NLP) techniques have shown promise in their capability to…

Information Retrieval · Computer Science 2021-06-15 Sijia Liu , Yanshan Wang , Andrew Wen , Liwei Wang , Na Hong , Feichen Shen , Steven Bedrick , William Hersh , Hongfang Liu

The paper presents a systematic review of state-of-the-art approaches to identify patient cohorts using electronic health records. It gives a comprehensive overview of the most commonly de-tected phenotypes and its underlying data sets.…

Machine Learning · Statistics 2017-07-25 Norman Hiob , Stefan Lessmann

Text retrieval using learned dense representations has recently emerged as a promising alternative to "traditional" text retrieval using sparse bag-of-words representations. One recent work that has garnered much attention is the dense…

Computation and Language · Computer Science 2021-04-14 Xueguang Ma , Kai Sun , Ronak Pradeep , Jimmy Lin

In this paper, we consider the extent to which the transformer-based Dense Passage Retrieval (DPR) algorithm, developed by (Karpukhin et. al. 2020), can be optimized without further pre-training. Our method involves two particular insights:…

Computation and Language · Computer Science 2023-06-29 William Yang , Noah Bergam , Arnav Jain , Nima Sheikhoslami

By leveraging a dual encoder architecture, Dense Passage Retrieval (DPR) has outperformed traditional sparse retrieval algorithms such as BM25 in terms of passage retrieval accuracy. Recently proposed methods have further enhanced DPR's…

Information Retrieval · Computer Science 2025-08-14 Shuai Chang

Most state-of-the-art open-domain question answering systems use a neural retrieval model to encode passages into continuous vectors and extract them from a knowledge source. However, such retrieval models often require large memory to run…

Computation and Language · Computer Science 2021-06-03 Ikuya Yamada , Akari Asai , Hannaneh Hajishirzi

Neural passage retrieval is a new and promising approach in open retrieval question answering. In this work, we stress-test the Dense Passage Retriever (DPR) -- a state-of-the-art (SOTA) open domain neural retrieval model -- on closed and…

Computation and Language · Computer Science 2022-04-21 Revanth Gangi Reddy , Bhavani Iyer , Md Arafat Sultan , Rong Zhang , Avirup Sil , Vittorio Castelli , Radu Florian , Salim Roukos

Passage retrieval is a fundamental task in information retrieval (IR) research, which has drawn much attention recently. In the English field, the availability of large-scale annotated dataset (e.g, MS MARCO) and the emergence of deep…

Information Retrieval · Computer Science 2022-04-26 Dingkun Long , Qiong Gao , Kuan Zou , Guangwei Xu , Pengjun Xie , Ruijie Guo , Jian Xu , Guanjun Jiang , Luxi Xing , Ping Yang

Patient representation learning refers to learning a dense mathematical representation of a patient that encodes meaningful information from Electronic Health Records (EHRs). This is generally performed using advanced deep learning methods.…

Machine Learning · Computer Science 2021-01-26 Yuqi Si , Jingcheng Du , Zhao Li , Xiaoqian Jiang , Timothy Miller , Fei Wang , W. Jim Zheng , Kirk Roberts

Evaluating the clinical similarities between pairwise patients is a fundamental problem in healthcare informatics. A proper patient similarity measure enables various downstream applications, such as cohort study and treatment comparative…

Machine Learning · Statistics 2019-02-12 Zihao Zhu , Changchang Yin , Buyue Qian , Yu Cheng , Jishang Wei , Fei Wang

Information retrieval systems have traditionally relied on exact term match methods such as BM25 for first-stage retrieval. However, recent advancements in neural network-based techniques have introduced a new method called dense retrieval.…

Information Retrieval · Computer Science 2025-03-25 Ahmed H. Salamah , Pierre McWhannel , Nicole Yan

Dynamic predictive modelling using electronic health record (EHR) data has gained significant attention in recent years. The reliability and trustworthiness of such models depend heavily on the quality of the underlying data, which is, in…

Despite their strong performance, Dense Passage Retrieval (DPR) models suffer from a lack of interpretability. In this work, we propose a novel interpretability framework that leverages Sparse Autoencoders (SAEs) to decompose previously…

Information Retrieval · Computer Science 2025-08-28 Seongwan Park , Taeklim Kim , Youngjoong Ko

Large scale electronic health records (EHRs) present an opportunity to quickly identify suitable individuals in order to directly invite them to participate in an observational study. EHRs can contain data from millions of individuals,…

Applications · Statistics 2019-03-18 James E. Barrett , Aylin Cakiroglu , Catey Bunce , Anoop Shah , Spiros Denaxas
‹ Prev 1 2 3 10 Next ›