English
Related papers

Related papers: Semantic Alignment in Hyperbolic Space for Open-Vo…

200 papers

In this work, we explore the task of hierarchical distance-based speech separation defined on a hyperbolic manifold. Based on the recent advent of audio-related tasks performed in non-Euclidean spaces, we propose to make use of the…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-09 Darius Petermann , Minje Kim

Hierarchical semantic structures, naturally existing in real-world datasets, can assist in capturing the latent distribution of data to learn robust hash codes for retrieval systems. Although hierarchical semantic structures can be simply…

Computer Vision and Pattern Recognition · Computer Science 2024-03-04 Rukai Wei , Yu Liu , Jingkuan Song , Yanzhao Xie , Ke Zhou

Representation learning has become an invaluable approach for learning from symbolic data such as text and graphs. However, while complex symbolic datasets often exhibit a latent hierarchical structure, state-of-the-art methods typically…

Artificial Intelligence · Computer Science 2017-05-29 Maximilian Nickel , Douwe Kiela

Existing alignment techniques for Large Language Models (LLMs), such as Direct Preference Optimization (DPO), typically treat the model as a monolithic entity, applying uniform optimization pressure across all layers. This approach…

Computation and Language · Computer Science 2025-10-15 Yukun Zhang , Qi Dong

Accurate understanding of anatomical structures is essential for reliably staging certain dental diseases. A way of introducing this within semantic segmentation models is by utilising hierarchy-aware methodologies. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2026-02-20 Ryan Banks , Camila Lindoni Azevedo , Hongying Tang , Yunpeng Li

For image segmentation, the current standard is to perform pixel-level optimization and inference in Euclidean output embedding spaces through linear hyperplanes. In this work, we show that hyperbolic manifolds provide a valuable…

Computer Vision and Pattern Recognition · Computer Science 2022-03-14 Mina GhadimiAtigh , Julian Schoep , Erman Acar , Nanne van Noord , Pascal Mettes

Fine-grained emotion classification (FEC) is a challenging task. Specifically, FEC needs to handle subtle nuance between labels, which can be complex and confusing. Most existing models only address text classification problem in the…

Computation and Language · Computer Science 2023-06-27 Chih-Yao Chen , Tun-Min Hung , Yi-Li Hsu , Lun-Wei Ku

Contrastive Language-Image Pre-training (CLIP) exhibits strong zero-shot classification ability on various image-level tasks, leading to the research to adapt CLIP for pixel-level open-vocabulary semantic segmentation without additional…

Computer Vision and Pattern Recognition · Computer Science 2024-11-22 Lin Sun , Jiale Cao , Jin Xie , Xiaoheng Jiang , Yanwei Pang

Embedded topic models are able to learn interpretable topics even with large and heavy-tailed vocabularies. However, they generally hold the Euclidean embedding space assumption, leading to a basic limitation in capturing hierarchical…

Information Retrieval · Computer Science 2022-10-20 Yishi Xu , Dongsheng Wang , Bo Chen , Ruiying Lu , Zhibin Duan , Mingyuan Zhou

As a promising field, Multi-Query Image Retrieval (MQIR) aims at searching for the semantically relevant image given multiple region-specific text queries. Existing works mainly focus on a single-level similarity between image regions and…

Computer Vision and Pattern Recognition · Computer Science 2024-08-22 Zhong Ji , Zhihao Li , Yan Zhang , Haoran Wang , Yanwei Pang , Xuelong Li

Language models are increasingly applied to biological sequences like proteins and mRNA, yet their default Euclidean geometry may mismatch the hierarchical structures inherent to biological data. While hyperbolic geometry provides a better…

Machine Learning · Computer Science 2025-11-05 Max van Spengler , Artem Moskalev , Tommaso Mansi , Mangal Prakash , Rui Liao

Recognizing unknown objects is crucial for safety-critical applications such as autonomous driving and robotics. Open-Set Panoptic Segmentation (OPS) aims to segment known thing and stuff classes while identifying valid unknown objects as…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Yao Lu , Rohit Mohan , Florian Drews , Yakov Miron , Abhinav Valada

Speaker embedding learning based on Euclidean space has achieved significant progress, but it is still insufficient in modeling hierarchical information within speaker features. Hyperbolic space, with its negative curvature geometric…

Sound · Computer Science 2026-04-29 Zhihua Fang , Liang He

Most real-world datasets consist of a natural hierarchy between classes or an inherent label structure that is either already available or can be constructed cheaply. However, most existing representation learning methods ignore this…

Machine Learning · Computer Science 2024-12-03 Aditya Sinha , Siqi Zeng , Makoto Yamada , Han Zhao

Many high-dimensional and large-volume data sets of practical relevance have hierarchical structures induced by trees, graphs or time series. Such data sets are hard to process in Euclidean spaces and one often seeks low-dimensional…

Machine Learning · Computer Science 2021-09-16 Eli Chien , Chao Pan , Puoya Tabaghi , Olgica Milenkovic

The integration of structured hierarchical embeddings into transformer-based architectures introduces a refined approach to lexical representation, ensuring that multi-scale semantic relationships are preserved without compromising…

Many high-dimensional practical data sets have hierarchical structures induced by graphs or time series. Such data sets are hard to process in Euclidean spaces and one often seeks low-dimensional embeddings in other space forms to perform…

Machine Learning · Computer Science 2022-04-13 Chao Pan , Eli Chien , Puoya Tabaghi , Jianhao Peng , Olgica Milenkovic

In this paper, we propose ReSeg-CLIP, a new training-free Open-Vocabulary Semantic Segmentation method for remote sensing data. To compensate for the problems of vision language models, such as CLIP in semantic segmentation caused by…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Mohammadreza Heidarianbaei , Mareike Dorozynski , Hubert Kanyamahanga , Max Mehltretter , Franz Rottensteiner

Open-vocabulary semantic segmentation attempts to classify and outline objects in an image using arbitrary text labels, including those unseen during training. Self-supervised learning resolves numerous visual and linguistic processing…

Computer Vision and Pattern Recognition · Computer Science 2025-07-03 Muhammad Atta ur Rahman , Dooseop Choi , Seung-Ik Lee , KyoungWook Min

Hierarchical data is common in many domains like life sciences and e-commerce, and its embeddings often play a critical role. While hyperbolic embeddings offer a theoretically grounded approach to representing hierarchies in low-dimensional…

Machine Learning · Computer Science 2026-04-15 Hui Yang , Jiaoyan Chen