English
Related papers

Related papers: Hierarchical Pretraining for Biomedical Term Embed…

200 papers

The overwhelming amount of biomedical scientific texts calls for the development of effective language models able to tackle a wide range of biomedical natural language processing (NLP) tasks. The most recent dominant approaches are…

Computation and Language · Computer Science 2021-04-21 Giacomo Miolo , Giulio Mantoan , Carlotta Orsenigo

Natural language text exhibits hierarchical structure in a variety of respects. Ideally, we could incorporate our prior knowledge of this hierarchical structure into unsupervised learning algorithms that work on text data. Recent work by…

Computation and Language · Computer Science 2018-06-13 Bhuwan Dhingra , Christopher J. Shallue , Mohammad Norouzi , Andrew M. Dai , George E. Dahl

Hierarchical knowledge structures are ubiquitous across real-world domains and play a vital role in organizing information from coarse to fine semantic levels. While such structures have been widely used in taxonomy systems, biomedical…

Machine Learning · Computer Science 2026-03-10 Yunhui Liu , Yongchao Liu , Yinfeng Chen , Chuntao Hong , Tao Zheng , Tieke He

Widespread adoption of electronic health records (EHRs) has fueled the development of using machine learning to build prediction models for various clinical outcomes. This process is often constrained by having a relatively small number of…

Computation and Language · Computer Science 2020-05-14 Ethan Steinberg , Ken Jung , Jason A. Fries , Conor K. Corbin , Stephen R. Pfohl , Nigam H. Shah

Image classification has been studied extensively but there has been limited work in the direction of using non-conventional, external guidance other than traditional image-label pairs to train such models. In this thesis we present a set…

Machine Learning · Computer Science 2020-04-14 Ankit Dhall

Today, despite decades of developments in medicine and the growing interest in precision healthcare, vast majority of diagnoses happen once patients begin to show noticeable signs of illness. Early indication and detection of diseases,…

Accurately predicting hospital readmission risks using electronic health records (EHRs) is critical for effective patient management and healthcare resource allocation. Patient populations in health systems are highly heterogeneous across…

Extracting detailed clinical information from free-text medical narratives remains a practical challenge for researchers and healthcare systems. Terminology for immune-mediated and infectious diseases is especially inconsistent across…

Computation and Language · Computer Science 2026-05-29 Veysel Kocaman , Gursev Pirge , Yigit Gul , Ace Vo , Zhenya Nargizyan , David Talby

Visual storytelling is a creative and challenging task, aiming to automatically generate a story-like description for a sequence of images. The descriptions generated by previous visual storytelling approaches lack coherence because they…

Computation and Language · Computer Science 2020-12-04 Jing Su , Qingyun Dai , Frank Guerin , Mian Zhou

An obstacle to scientific document understanding is the extensive use of acronyms which are shortened forms of long technical phrases. Acronym disambiguation aims to find the correct meaning of an ambiguous acronym in a given text. Recent…

Artificial Intelligence · Computer Science 2021-07-02 Qiwei Zhong , Guanxiong Zeng , Danqing Zhu , Yang Zhang , Wangli Lin , Ben Chen , Jiayu Tang

Representation learning on heterogeneous text-rich networks (HTRNs), which consist of multiple types of nodes and edges with each node associated with textual information, is essential for various real-world applications. Given the success…

Machine Learning · Computer Science 2025-01-23 Qiuyu Zhu , Liang Zhang , Qianxiong Xu , Cheng Long

Clinical notes contain an extensive record of a patient's health status, such as smoking status or the presence of heart conditions. However, this detail is not replicated within the structured data of electronic health systems.…

Computation and Language · Computer Science 2020-09-18 Andriy Mulyar , Elliot Schumacher , Masoud Rouhizadeh , Mark Dredze

In recent years, with the growing amount of biomedical documents, coupled with advancement in natural language processing algorithms, the research on biomedical named entity recognition (BioNER) has increased exponentially. However, BioNER…

Computation and Language · Computer Science 2020-09-22 Usman Naseem , Matloob Khushi , Vinay Reddy , Sakthivel Rajendran , Imran Razzak , Jinman Kim

Medication recommendations aim to generate safe and effective medication sets from health records. However, accurately recommending medications hinges on inferring a patient's latent clinical condition from sparse and noisy observations,…

Information Retrieval · Computer Science 2026-03-20 Xiangxu Zhang , Xiao Zhou , Hongteng Xu , Jianxun Lian

We show how to learn low-dimensional representations (embeddings) of patient visits from the corresponding electronic health record (EHR) where International Classification of Diseases (ICD) diagnosis codes are removed. We expect that these…

Computers and Society · Computer Science 2018-03-28 Jean-Baptiste Escudié , Alaa Saade , Alice Coucke , Marc Lelarge

Pre-trained language models like BERT have achieved great success in a wide variety of NLP tasks, while the superior performance comes with high demand in computational resources, which hinders the application in low-latency IR systems. We…

Information Retrieval · Computer Science 2020-02-18 Wenhao Lu , Jian Jiao , Ruofei Zhang

Conventional machine learning models, particularly tree-based approaches, have demonstrated promising performance across various clinical prediction tasks using electronic health record (EHR) data. Despite their strengths, these models…

Computation and Language · Computer Science 2025-05-26 Sara Ketabi , Dhanesh Ramachandram

Clinical notes are a rich source of information about patient state. However, using them to predict clinical events with machine learning models is challenging. They are very high dimensional, sparse and have complex structure. Furthermore,…

Machine Learning · Statistics 2018-08-20 Sebastien Dubois , Nathanael Romano , David C. Kale , Nigam Shah , Kenneth Jung

Automating the recognition of outcomes reported in clinical trials using machine learning has a huge potential of speeding up access to evidence necessary in healthcare decision-making. Prior research has however acknowledged inadequate…

Computation and Language · Computer Science 2022-03-15 Micheal Abaho , Danushka Bollegala , Paula R Williamson , Susanna Dodd

Efficient label acquisition processes are key to obtaining robust classifiers. However, data labeling is often challenging and subject to high levels of label noise. This can arise even when classification targets are well defined, if…

Artificial Intelligence · Computer Science 2018-08-22 Olivier Deiss , Siddharth Biswal , Jing Jin , Haoqi Sun , M. Brandon Westover , Jimeng Sun