English
Related papers

Related papers: Joint Cluster Unary Loss for Efficient Cross-Modal…

200 papers

Hashing techniques have been applied broadly in retrieval tasks due to their low storage requirements and high speed of processing. Many hashing methods based on a single view have been extensively studied for information retrieval.…

Machine Learning · Computer Science 2020-01-07 Jun Yu , Xiao-Jun Wu , Josef Kittler

We investigate task clustering for deep-learning based multi-task and few-shot learning in a many-task setting. We propose a new method to measure task similarities with cross-task transfer performance matrix for the deep learning scenario.…

Machine Learning · Computer Science 2018-05-21 Mo Yu , Xiaoxiao Guo , Jinfeng Yi , Shiyu Chang , Saloni Potdar , Gerald Tesauro , Haoyu Wang , Bowen Zhou

Despite the remarkable success of Large Language Models (LLMs) in text understanding and generation, their potential for text clustering tasks remains underexplored. We observed that powerful closed-source LLMs provide good quality…

As medical diagnoses increasingly leverage multimodal data, machine learning models are expected to effectively fuse heterogeneous information while remaining robust to missing modalities. In this work, we propose a novel multimodal…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Yi Gu , Kuniaki Saito , Jiaxin Ma

Multimodal clustering is an unsupervised technique for mining interesting patterns in $n$-adic binary relations or $n$-mode networks. Among different types of such generalized patterns one can find biclusters and formal concepts (maximal…

Social and Information Networks · Computer Science 2017-03-01 Dmitry I. Ignatov , Alexander Semenov , Daria Komissarova , Dmitry V. Gnatyshak

DNN-based cross-modal retrieval is a research hotspot to retrieve across different modalities as image and text, but existing methods often face the challenge of insufficient cross-modal training data. In single-modal scenario, similar…

Multimedia · Computer Science 2017-06-27 Xin Huang , Yuxin Peng , Mingkuan Yuan

Zero-shot cross-modal retrieval (ZS-CMR) deals with the retrieval problem among heterogenous data from unseen classes. Typically, to guarantee generalization, the pre-defined class embeddings from natural language processing (NLP) models…

Machine Learning · Computer Science 2022-09-27 Yufeng Shi , Shujian Yu , Duanquan Xu , Xinge You

Limited availability of labeled data for machine learning on multimodal time-series extensively hampers progress in the field. Self-supervised learning (SSL) is a promising approach to learning data representations without relying on…

Machine Learning · Computer Science 2024-02-20 Shohreh Deldari , Dimitris Spathis , Mohammad Malekzadeh , Fahim Kawsar , Flora Salim , Akhil Mathur

Federated learning has attracted significant attention as a privacy-preserving framework for training personalised models on multi-source heterogeneous data. However, most existing approaches are unable to handle scenarios where subgroup…

Methodology · Statistics 2025-10-14 Changxin Yang , Zhongyi Zhu , Heng Lian

Unsupervised hashing has attracted much attention for binary representation learning due to the requirement of economical storage and efficiency of binary codes. It aims to encode high-dimensional features in the Hamming space with…

Computer Vision and Pattern Recognition · Computer Science 2022-09-01 Xiaoqin Wang , Chen Chen , Rushi Lan , Licheng Liu , Zhenbing Liu , Huiyu Zhou , Xiaonan Luo

Hashing method maps similar data to binary hashcodes with smaller hamming distance, and it has received a broad attention due to its low storage cost and fast retrieval speed. However, the existing limitations make the present algorithms…

Computer Vision and Pattern Recognition · Computer Science 2016-09-29 Shifeng Zhang , Jianmin Li , Jinma Guo , Bo Zhang

We propose a new constrained-optimization formulation for deep ordinal classification, in which uni-modality of the label distribution is enforced implicitly via a set of inequality constraints over all the pairs of adjacent labels. Based…

Machine Learning · Computer Science 2020-06-15 Soufiane Belharbi , Ismail Ben Ayed , Luke McCaffrey , Eric Granger

Deep learning models frequently encounter feature uncertainty in diverse learning scenarios, significantly impacting their performance and reliability. This challenge is particularly complex in multi-modal scenarios, where models must…

Machine Learning · Computer Science 2025-06-05 Jiahao Qin , Bei Peng , Feng Liu , Guangliang Cheng , Lu Zong

Addressing the challenge of balancing security and efficiency when deploying machine learning systems in untrusted environments, such as federated learning, remains a critical concern. A promising strategy to tackle this issue involves…

Cryptography and Security · Computer Science 2023-12-29 Dongfang Zhao

Recently, the cross-modal pretraining model has been employed to produce meaningful pseudo-labels to supervise the training of an image clustering model. However, numerous erroneous alignments in a cross-modal pre-training model could…

Computer Vision and Pattern Recognition · Computer Science 2024-01-23 Liping Qiu , Qin Zhang , Xiaojun Chen , Shaotian Cai

Existing data-dependent hashing methods usually learn hash functions from pairwise or triplet data relationships, which only capture the data similarity locally, and often suffer from low learning efficiency and low collision rate. In this…

Computer Vision and Pattern Recognition · Computer Science 2020-04-01 Li Yuan , Tao Wang , Xiaopeng Zhang , Francis EH Tay , Zequn Jie , Wei Liu , Jiashi Feng

Deep hashing enables image retrieval by end-to-end learning of deep representations and hash codes from training data with pairwise similarity information. Subject to the distribution skewness underlying the similarity information, most…

Computer Vision and Pattern Recognition · Computer Science 2018-09-06 Zhangjie Cao , Ziping Sun , Mingsheng Long , Jianmin Wang , Philip S. Yu

Unsupervised fine-grained image hashing aims to learn compact binary codes that preserve subtle visual differences among highly similar instances without manual annotations. However, most existing methods neglect collision resistance,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Anh-Kiet Duong , Petra Gomez-Krämer , Jean-Michel Carozza

This paper considers contrastive training for cross-modal 0-shot transfer wherein a pre-trained model in one modality is used for representation learning in another domain using pairwise data. The learnt models in the latter domain can then…

This paper proposes a novel ternary hash encoding for learning to hash methods, which provides a principled more efficient coding scheme with performances better than those of the state-of-the-art binary hashing counterparts. Two kinds of…

Artificial Intelligence · Computer Science 2021-03-22 Chang Liu , Lixin Fan , Kam Woh Ng , Yilun Jin , Ce Ju , Tianyu Zhang , Chee Seng Chan , Qiang Yang