English
Related papers

Related papers: HMSN: Hyperbolic Self-Supervised Learning by Clust…

200 papers

Learning accurate drug representations is essential for task such as computational drug repositioning. A drug hierarchy is a valuable source that encodes knowledge of relations among drugs in a tree-like structure where drugs that act on…

Biomolecules · Quantitative Biology 2022-08-15 Ke Yu , Shyam Visweswaran , Kayhan Batmanghelich

Hypergraphs have been becoming a popular choice to model complex, non-pairwise, and higher-order interactions for recommender system. However, compared with traditional graph-based methods, the constructed hypergraphs are usually much…

Social and Information Networks · Computer Science 2021-08-19 Yicong Li , Hongxu Chen , Xiangguo Sun , Zhenchao Sun , Lin Li , Lizhen Cui , Philip S. Yu , Guandong Xu

Self-supervised learning approaches leverage unlabeled samples to acquire generic knowledge about different concepts, hence allowing for annotation-efficient downstream task learning. In this paper, we propose a novel self-supervised method…

Computer Vision and Pattern Recognition · Computer Science 2020-10-27 Aiham Taleb , Christoph Lippert , Tassilo Klein , Moin Nabi

Natural language text exhibits hierarchical structure in a variety of respects. Ideally, we could incorporate our prior knowledge of this hierarchical structure into unsupervised learning algorithms that work on text data. Recent work by…

Computation and Language · Computer Science 2018-06-13 Bhuwan Dhingra , Christopher J. Shallue , Mohammad Norouzi , Andrew M. Dai , George E. Dahl

Binary Neural Network (BNN) converts full-precision weights and activations into their extreme 1-bit counterparts, making it particularly suitable for deployment on lightweight mobile devices. While binary neural networks are typically…

Machine Learning · Computer Science 2025-01-08 Jun Chen , Jingyang Xiang , Tianxin Huang , Xiangrui Zhao , Yong Liu

Hyperbolic neural networks (HNNs) have been proved effective in modeling complex data structures. However, previous works mainly focused on the Poincar\'e ball model and the hyperboloid model as coordinate representations of the hyperbolic…

Machine Learning · Computer Science 2024-10-23 Yidan Mao , Jing Gu , Marcus C. Werner , Dongmian Zou

Hyperbolic geometry, a Riemannian manifold endowed with constant sectional negative curvature, has been considered an alternative embedding space in many learning scenarios, \eg, natural language processing, graph learning, \etc, as a…

Computer Vision and Pattern Recognition · Computer Science 2023-04-24 Pengfei Fang , Mehrtash Harandi , Trung Le , Dinh Phung

Structuring latent representations in a hierarchical manner enables models to learn patterns at multiple levels of abstraction. However, most prevalent image understanding models focus on visual similarity, and learning visual hierarchies…

Computer Vision and Pattern Recognition · Computer Science 2026-01-07 Ziwei Wang , Sameera Ramasinghe , Chenchen Xu , Julien Monteil , Loris Bazzani , Thalaiyasingam Ajanthan

Pathology is essential for cancer diagnosis, with multiple instance learning (MIL) widely used for whole slide image (WSI) analysis. WSIs exhibit a natural hierarchy -- patches, regions, and slides -- with distinct semantic associations.…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Peixiang Huang , Yanyan Huang , Weiqin Zhao , Junjun He , Lequan Yu

For natural language understanding and generation, embedding concepts using an order-based representation is an essential task. Unlike traditional point vector based representation, an order-based representation imposes geometric…

Computation and Language · Computer Science 2024-04-18 Croix Gyurek , Niloy Talukder , Mohammad Al Hasan

Metric-based meta-learning is one of the de facto standards in few-shot learning. It composes of representation learning and metrics calculation designs. Previous works construct class representations in different ways, varying from mean…

Machine Learning · Computer Science 2022-11-11 Ning Ding , Yulin Chen , Ganqu Cui , Xiaobin Wang , Hai-Tao Zheng , Zhiyuan Liu , Pengjun Xie

Hyperbolic space is a geometry that is known to be well-suited for representation learning of data with an underlying hierarchical structure. In this paper, we present a novel hyperbolic distribution called \textit{pseudo-hyperbolic…

Machine Learning · Statistics 2019-05-13 Yoshihiro Nagano , Shoichiro Yamaguchi , Yasuhiro Fujita , Masanori Koyama

Unsupervised representation learning techniques, such as learning word embeddings, have had a significant impact on the field of natural language processing. Similar representation learning techniques have not yet become commonplace in the…

Computer Vision and Pattern Recognition · Computer Science 2021-02-09 Joël Bachmann , Kenneth Blomqvist , Julian Förster , Roland Siegwart

A recurring challenge in self-supervised learning is preventing representation collapse. Existing solutions typically rely on global regularization, such as maximizing distances, decorrelating dimensions or enforcing certain distributions.…

Computer Vision and Pattern Recognition · Computer Science 2026-01-30 Esteban Rodríguez-Betancourt , Edgar Casasola-Murillo

Object detection, for the most part, has been formulated in the euclidean space, where euclidean or spherical geodesic distances measure the similarity of an image region to an object class prototype. In this work, we study whether a…

Computer Vision and Pattern Recognition · Computer Science 2022-03-21 Christopher Lang , Alexander Braun , Abhinav Valada

In light of the inherent entailment relations between images and text, hyperbolic point vector embeddings, leveraging the hierarchical modeling advantages of hyperbolic space, have been utilized for visual semantic representation learning.…

Artificial Intelligence · Computer Science 2024-08-21 Zhi Qiao , Linbin Han , Xiantong Zhen , Jia-Hong Gao , Zhen Qian

Deep learning methods, which exploit auto-differentiation to compute derivatives without dispersion or dissipation errors, have recently emerged as a compelling alternative to classical mesh-based numerical schemes for solving hyperbolic…

Numerical Analysis · Mathematics 2025-03-18 Qi Sun , Zhenjiang Liu , Lili Ju , Xuejun Xu

This paper contributes to interpretable machine learning via visual knowledge discovery in parallel coordinates. The concepts of hypercubes and hyper-blocks are used as easily understandable by end-users in the visual form in parallel…

Machine Learning · Computer Science 2021-07-06 Boris Kovalerchuk , Dustin Hayes

Learning visual representations through self-supervision is an extremely challenging task as the network needs to sieve relevant patterns from spurious distractors without the active guidance provided by supervision. This is achieved…

Computer Vision and Pattern Recognition · Computer Science 2022-06-17 Fatemeh Saleh , Fuwen Tan , Adrian Bulat , Georgios Tzimiropoulos , Brais Martinez

Understanding the intricate mappings between visual stimuli and neural responses is a fundamental challenge in cognitive neuroscience. While current approaches predominantly align images and functional magnetic resonance imaging (fMRI)…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Zihan Ma , Tian Xia , Kexin Wang , Xiao Li , Xiaowei He , Yudan Ren