English
Related papers

Related papers: Self-supervised Hierarchical Representation for Me…

200 papers

Hierarchies feature prominently in anatomical accounts of cortical organisation. An open question is which computational (algorithmic) processes are implemented by these hierarchies. One renowned hypothesis is that cortical hierarchies…

Neurons and Cognition · Quantitative Biology 2017-09-08 Andreea O. Diaconescu , Vladimir Litvak , Christoph Mathys , Lars Kasper , Karl J. Friston , Klaas E. Stephan

Pretraining has proven to be a powerful technique in natural language processing (NLP), exhibiting remarkable success in various NLP downstream tasks. However, in the medical domain, existing pretrained models on electronic health records…

Artificial Intelligence · Computer Science 2023-10-23 Xiaochen Wang , Junyu Luo , Jiaqi Wang , Ziyi Yin , Suhan Cui , Yuan Zhong , Yaqing Wang , Fenglong Ma

Hypergraphs have been becoming a popular choice to model complex, non-pairwise, and higher-order interactions for recommender system. However, compared with traditional graph-based methods, the constructed hypergraphs are usually much…

Social and Information Networks · Computer Science 2021-08-19 Yicong Li , Hongxu Chen , Xiangguo Sun , Zhenchao Sun , Lin Li , Lizhen Cui , Philip S. Yu , Guandong Xu

Hierarchical Text Classification (HTC) has recently gained traction given the ability to handle complex label hierarchy. This has found applications in domains like E- commerce, customer care and medicine industry among other real-world…

Computation and Language · Computer Science 2025-06-06 Neeraj Agrawal , Saurabh Kumar , Priyanka Bhatt , Tanishka Agarwal

Real-world knowledge is often organized as hierarchies such as product taxonomies, medical ontologies, and label trees, yet learning hierarchical representations is challenging due to asymmetric structure and noisy semantics. We introduce…

Machine Learning · Computer Science 2026-05-04 Sahil Mishra , Srinitish Srinivasan , Sourish Dasgupta , Tanmoy Chakraborty

Source code representation with deep learning techniques is an important research field. There have been many studies that learn sequential or structural information for code representation. But sequence-based models and non-sequence-models…

Software Engineering · Computer Science 2023-03-15 Kechi Zhang , Zhuo Li , Zhi Jin , Ge Li

As the global HIV pandemic enters its fourth decade, increasing numbers of surveillance sites have been established which allows countries to look into the epidemics at a finer scale, e.g. at sub-national level. However, the epidemic models…

Applications · Statistics 2014-11-18 Le Bao , Mary Mahy , Xiaoyue Niu , Tim Brown , Peter Ghys

Hierarchical classification aims to sort the object into a hierarchical structure of categories. For example, a bird can be categorized according to a three-level hierarchy of order, family, and species. Existing methods commonly address…

Computer Vision and Pattern Recognition · Computer Science 2023-11-01 Renzhen Wang , De cai , Kaiwen Xiao , Xixi Jia , Xiao Han , Deyu Meng

Vision-language models have shown promising results in radiology report generation. However, most existing methods generate reports as flat text and do not explicitly model the semantic dependency between the Findings and Impression…

Artificial Intelligence · Computer Science 2026-03-24 Bodong Du , Honglong Yang , Xiaomeng Li

We propose HyMoERec, a novel sequential recommendation framework that addresses the limitations of uniform Position-wise Feed-Forward Networks in existing models. Current approaches treat all user interactions and items equally, overlooking…

Information Retrieval · Computer Science 2025-11-11 Kunrong Li , Zhu Sun , Kwan Hui Lim

The complexities inherent to leukemia, multifaceted cancer affecting white blood cells, pose considerable diagnostic and treatment challenges, primarily due to reliance on laborious morphological analyses and expert judgment that are…

Image classification is central to the big data revolution in medicine. Improved information processing methods for diagnosis and classification of digital medical images have shown to be successful via deep learning approaches. As this…

Image and Video Processing · Electrical Eng. & Systems 2020-06-25 Kamran Kowsari , Rasoul Sali , Lubaina Ehsan , William Adorno , Asad Ali , Sean Moore , Beatrice Amadi , Paul Kelly , Sana Syed , Donald Brown

Substantial increase in the use of Electronic Health Records (EHRs) has opened new frontiers for predictive healthcare. However, while EHR systems are nearly ubiquitous, they lack a unified code system for representing medical concepts.…

Machine Learning · Computer Science 2022-03-21 Kyunghoon Hur , Jiyoung Lee , Jungwoo Oh , Wesley Price , Young-Hak Kim , Edward Choi

Most of the existing literature regarding hyperbolic embedding concentrate upon supervised learning, whereas the use of unsupervised hyperbolic embedding is less well explored. In this paper, we analyze how unsupervised tasks can benefit…

Machine Learning · Computer Science 2021-03-31 Jiwoong Park , Junho Cho , Hyung Jin Chang , Jin Young Choi

Natural language text exhibits hierarchical structure in a variety of respects. Ideally, we could incorporate our prior knowledge of this hierarchical structure into unsupervised learning algorithms that work on text data. Recent work by…

Computation and Language · Computer Science 2018-06-13 Bhuwan Dhingra , Christopher J. Shallue , Mohammad Norouzi , Andrew M. Dai , George E. Dahl

Image-text representation learning forms a cornerstone in vision-language models, where pairs of images and textual descriptions are contrastively aligned in a shared embedding space. Since visual and textual concepts are naturally…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Avik Pal , Max van Spengler , Guido Maria D'Amely di Melendugno , Alessandro Flaborea , Fabio Galasso , Pascal Mettes

Recent studies have shown that sequence-to-sequence (seq2seq) models struggle with compositional generalization (CG), i.e., the ability to systematically generalize to unseen compositions of seen components. There is mounting evidence that…

Computation and Language · Computer Science 2023-10-19 Lei Lin , Shuangtao Li , Yafang Zheng , Biao Fu , Shan Liu , Yidong Chen , Xiaodong Shi

Multimodal alignment of histopathology encoders with transcriptomic and genomic data has been shown to significantly improve performance in downstream diagnostic tasks. Hematological cytology is unique in that visual single-cell evaluation…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Muhammed Furkan Dasdelen , Fatih Ozlugedik , Ilaria Looser , Rao Muhammad Umer , Christian Pohlkamp , Carsten Marr

Automatic representation learning of key entities in electronic health record (EHR) data is a critical step for healthcare informatics that turns heterogeneous medical records into structured and actionable information. Here we propose…

Machine Learning · Computer Science 2019-10-08 Tong Wu , Yunlong Wang , Yue Wang , Emily Zhao , Yilian Yuan , Zhi Yang

A comprehensive pharmaceutical recommendation system was designed based on the patients and drugs features extracted from Drugs.com and Druglib.com. First, data from these databases were combined, and a dataset of patients and drug…