English
Related papers

Related papers: Hyperbolic Multimodal Representation Learning for …

200 papers

Hyperbolic space can naturally embed hierarchies, unlike Euclidean space. Hyperbolic Neural Networks (HNNs) exploit such representational power by lifting Euclidean features into hyperbolic space for classification, outperforming Euclidean…

Machine Learning · Computer Science 2022-05-17 Yunhui Guo , Xudong Wang , Yubei Chen , Stella X. Yu

Metric learning aims to learn a highly discriminative model encouraging the embeddings of similar classes to be close in the chosen metrics and pushed apart for dissimilar ones. The common recipe is to use an encoder to extract embeddings…

Computer Vision and Pattern Recognition · Computer Science 2022-03-23 Aleksandr Ermolov , Leyla Mirvakhabova , Valentin Khrulkov , Nicu Sebe , Ivan Oseledets

Biological sequence comparison is a key step in inferring the relatedness of various organisms and the functional similarity of their components. Thanks to the Next Generation Sequencing efforts, an abundance of sequence data is now…

Machine Learning · Computer Science 2016-09-13 Dhananjay Kimothi , Akshay Soni , Pravesh Biyani , James M. Hogan

Multimodal molecular representation learning, which jointly models molecular graphs and their textual descriptions, enhances predictive accuracy and interpretability by enabling more robust and reliable predictions of drug toxicity,…

Machine Learning · Computer Science 2025-10-21 Yingxu Wang , Kunyu Zhang , Jiaxin Huang , Nan Yin , Siwei Liu , Eran Segal

Multi-modal word semantics aims to enhance embeddings with perceptual input, assuming that human meaning representation is grounded in sensory experience. Most research focuses on evaluation involving direct visual input, however, visual…

Computation and Language · Computer Science 2021-10-07 Anita L. Verő , Ann Copestake

Structuring latent representations in a hierarchical manner enables models to learn patterns at multiple levels of abstraction. However, most prevalent image understanding models focus on visual similarity, and learning visual hierarchies…

Computer Vision and Pattern Recognition · Computer Science 2026-01-07 Ziwei Wang , Sameera Ramasinghe , Chenchen Xu , Julien Monteil , Loris Bazzani , Thalaiyasingam Ajanthan

Existing plant disease classification models have achieved remarkable performance in recognizing in-laboratory diseased images. However, their performance often significantly degrades in classifying in-the-wild images. Furthermore, we…

Computer Vision and Pattern Recognition · Computer Science 2024-08-07 Tianqi Wei , Zhi Chen , Zi Huang , Xin Yu

Networks are ubiquitous structure that describes complex relationships between different entities in the real world. As a critical component of prediction task over nodes in networks, learning the feature representation of nodes has become…

Machine Learning · Computer Science 2018-09-10 Hansheng Xue , Jiajie Peng , Xuequn Shang

We consider the task of representation learning for unsupervised segmentation of 3D voxel-grid biomedical images. We show that models that capture implicit hierarchical relationships between subvolumes are better suited for this task. To…

Computer Vision and Pattern Recognition · Computer Science 2021-10-27 Joy Hsu , Jeffrey Gu , Gong-Her Wu , Wah Chiu , Serena Yeung

Automatic identification of plant specimens from amateur photographs could improve species range maps, thus supporting ecosystems research as well as conservation efforts. However, classifying plant specimens based on image data alone is…

Computer Vision and Pattern Recognition · Computer Science 2021-10-06 Riccardo de Lutio , Yihang She , Stefano D'Aronco , Stefania Russo , Philipp Brun , Jan D. Wegner , Konrad Schindler

Hyperbolic representation learning has been widely used to extract implicit hierarchies within data, and recently it has found its way to the open-world classification task of Generalized Category Discovery (GCD). However, prior hyperbolic…

Machine Learning · Computer Science 2026-02-06 Mohamad Dalal , Thomas B. Moeslund , Joakim Bruslund Haurum

Medical anomaly detection has emerged as a promising solution to challenges in data availability and labeling constraints. Traditional methods extract features from different layers of pre-trained networks in Euclidean space; however,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-28 Alvaro Gonzalez-Jimenez , Simone Lionetti , Ludovic Amruthalingam , Philippe Gottfrois , Fabian Gröger , Marc Pouly , Alexander A. Navarini

Multimodal datasets contain an enormous amount of relational information, which grows exponentially with the introduction of new modalities. Learning representations in such a scenario is inherently complex due to the presence of multiple…

Machine Learning · Computer Science 2019-09-24 Devanshu Arya , Stevan Rudinac , Marcel Worring

Most of the existing literature regarding hyperbolic embedding concentrate upon supervised learning, whereas the use of unsupervised hyperbolic embedding is less well explored. In this paper, we analyze how unsupervised tasks can benefit…

Machine Learning · Computer Science 2021-03-31 Jiwoong Park , Junho Cho , Hyung Jin Chang , Jin Young Choi

For natural language understanding and generation, embedding concepts using an order-based representation is an essential task. Unlike traditional point vector based representation, an order-based representation imposes geometric…

Computation and Language · Computer Science 2024-04-18 Croix Gyurek , Niloy Talukder , Mohammad Al Hasan

Multi-level Hierarchical Classification (MLHC) tackles the challenge of categorizing items within a complex, multi-layered class structure. However, traditional MLHC classifiers often rely on a backbone model with independent output layers,…

Artificial Intelligence · Computer Science 2025-01-14 Shijing Chen , Mohamed Reda Bouadjenek , Shoaib Jameel , Usman Naseem , Basem Suleiman , Flora D. Salim , Hakim Hacid , Imran Razzak

Hyperbolic geometry has emerged as a powerful tool for modeling complex, structured data, particularly where hierarchical or tree-like relationships are present. By enabling embeddings with lower distortion, hyperbolic neural networks offer…

Machine Learning · Computer Science 2025-06-18 Pol Arévalo , Alexis Molina , Álvaro Ciudad

Deep learning methods have played a more and more important role in hyperspectral image classification. However, the general deep learning methods mainly take advantage of the information of sample itself or the pairwise information between…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Zhiqiang Gong , Weidong Hu , Xiaoyong Du , Ping Zhong , Panhe Hu

Classification using multimodal data arises in many machine learning applications. It is crucial not only to model cross-modal relationship effectively but also to ensure robustness against loss of part of data or modalities. In this paper,…

Machine Learning · Computer Science 2019-04-22 Jun-Ho Choi , Jong-Seok Lee

Learning unbiased node representations for imbalanced samples in the graph has become a more remarkable and important topic. For the graph, a significant challenge is that the topological properties of the nodes (e.g., locations, roles) are…

Machine Learning · Computer Science 2023-04-12 Xingcheng Fu , Yuecen Wei , Qingyun Sun , Haonan Yuan , Jia Wu , Hao Peng , Jianxin Li