English
Related papers

Related papers: MCA: 2D-3D Retrieval with Noisy Labels via Multi-l…

200 papers

Audio-text retrieval enables semantic alignment between audio content and natural language queries, supporting applications in multimedia search, accessibility, and surveillance. However, current state-of-the-art approaches struggle with…

Computation and Language · Computer Science 2026-04-28 Meizhu Liu , Matthew Rowe , Amit Agarwal , Michael Avendi , Yassi Abbasi , Hitesh Laxmichand Patel , Paul Li , Kyu J. Han , Tao Sheng , Sujith Ravi , Dan Roth

The heterogeneity gap problem is the main challenge in cross-modal retrieval. Because cross-modal data (e.g. audiovisual) have different distributions and representations that cannot be directly compared. To bridge the gap between…

Multimedia · Computer Science 2022-11-08 Donghuo Zeng , Yanan Wang , Jianming Wu , Kazushi Ikeda

Multi-modal learning has shown exceptional performance in various tasks, especially in medical applications, where it integrates diverse medical information for comprehensive diagnostic evidence. However, there still are several challenges…

Machine Learning · Computer Science 2024-11-19 Lin Fan , Yafei Ou , Cenyang Zheng , Pengyu Dai , Tamotsu Kamishima , Masayuki Ikebe , Kenji Suzuki , Xun Gong

Multi-label classification poses challenges due to imbalanced and noisy labels in training data. We propose a unified data augmentation method, named BalanceMix, to address these challenges. Our approach includes two samplers for imbalanced…

Machine Learning · Computer Science 2023-12-13 Hwanjun Song , Minseok Kim , Jae-Gil Lee

Noisy multi-label learning has garnered increasing attention due to the challenges posed by collecting large-scale accurate labels, making noisy labels a more practical alternative. Motivated by noisy multi-class learning, the introduction…

Machine Learning · Computer Science 2023-09-25 Shikun Li , Xiaobo Xia , Hansong Zhang , Shiming Ge , Tongliang Liu

Recent studies on learning with noisy labels have shown remarkable performance by exploiting a small clean dataset. In particular, model agnostic meta-learning-based label correction methods further improve performance by correcting noisy…

Machine Learning · Computer Science 2022-07-13 Seong Min Kye , Kwanghee Choi , Joonyoung Yi , Buru Chang

Mixed-Modal Image Retrieval (MMIR) as a flexible search paradigm has attracted wide attention. However, previous approaches always achieve limited performance, due to two critical factors are seriously overlooked. 1) The contribution of…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Fuxiang Huang , Lei Zhang , Xiaowei Fu , Suqi Song

Leveraging weak or noisy supervision for building effective machine learning models has long been an important research problem. Its importance has further increased recently due to the growing need for large-scale datasets to train deep…

Machine Learning · Computer Science 2021-08-09 Guoqing Zheng , Ahmed Hassan Awadallah , Susan Dumais

Cross-modal hashing (CMH) has appeared as a popular technique for cross-modal retrieval due to its low storage cost and high computational efficiency in large-scale data. Most existing methods implicitly assume that multi-modal data is…

Computer Vision and Pattern Recognition · Computer Science 2025-01-06 Ruitao Pu , Yuan Sun , Yang Qin , Zhenwen Ren , Xiaomin Song , Huiming Zheng , Dezhong Peng

Falsely annotated samples, also known as noisy labels, can significantly harm the performance of deep learning models. Two main approaches for learning with noisy labels are global noise estimation and data filtering. Global noise…

Machine Learning · Computer Science 2025-07-31 Yuval Grinberg , Nimrod Harel , Jacob Goldberger , Ofir Lindenbaum

As one of the most fundamental techniques in multimodal learning, cross-modal matching aims to project various sensory modalities into a shared feature space. To achieve this, massive and correctly aligned data pairs are required for model…

Computer Vision and Pattern Recognition · Computer Science 2023-06-09 Shuo Yang , Zhaopan Xu , Kai Wang , Yang You , Hongxun Yao , Tongliang Liu , Min Xu

A major challenge in multimodal learning is the presence of noise within individual modalities. This noise inherently affects the resulting multimodal representations, especially when these representations are obtained through explicit…

Computer Vision and Pattern Recognition · Computer Science 2025-08-25 Mohammad Zia Ur Rehman , Devraj Raghuvanshi , Umang Jain , Shubhi Bansal , Nagendra Kumar

Current image-text retrieval methods have demonstrated impressive performance in recent years. However, they still face two problems: the inter-modal matching missing problem and the intra-modal semantic loss problem. These problems can…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Hailang Huang , Zhijie Nie , Ziqiao Wang , Ziyu Shang

Cross-modal retrieval aims to align different modalities via semantic similarity. However, existing methods often assume that image-text pairs are perfectly aligned, overlooking Noisy Correspondences in real data. These misaligned pairs…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Zhuoyao Liu , Yang Liu , Wentao Feng , Shudong Huang

Learning with noisy labels (LNL) is essential for training deep neural networks with imperfect data. Meta-learning approaches have achieved success by using a clean unbiased labeled set to train a robust model. However, this approach…

Machine Learning · Computer Science 2025-07-17 Ruofan Hu , Dongyu Zhang , Huayi Zhang , Elke Rundensteiner

Training deep object detectors requires significant amount of human-annotated images with accurate object labels and bounding box coordinates, which are extremely expensive to acquire. Noisy annotations are much more easily accessible, but…

Computer Vision and Pattern Recognition · Computer Science 2020-03-04 Junnan Li , Caiming Xiong , Richard Socher , Steven Hoi

Noise in data appears to be inevitable in most real-world machine learning applications and would cause severe overfitting problems. Not only can data features contain noise, but labels are also prone to be noisy due to human input. In this…

Machine Learning · Computer Science 2025-05-09 Weipeng Huang , Qin Li , Yang Xiao , Cheng Qiao , Tie Cai , Junwei Liang , Neil J. Hurley , Guangyuan Piao

Recent deep neural networks (DNNs) can easily overfit to biased training data with noisy labels. Label correction strategy is commonly used to alleviate this issue by designing a method to identity suspected noisy labels and then correct…

Computer Vision and Pattern Recognition · Computer Science 2021-09-03 Yichen Wu , Jun Shu , Qi Xie , Qian Zhao , Deyu Meng

Multimodal multilabel classification (MMC) is a challenging task that aims to design a learning algorithm to handle two data sources, the image and text, and learn a comprehensive semantic feature presentation across the modalities. In this…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Yanming Guo

Noisy labels are inevitable in real-world scenarios. Due to the strong capacity of deep neural networks to memorize corrupted labels, these noisy labels can cause significant performance degradation. Existing research on mitigating the…

Machine Learning · Computer Science 2025-10-02 Xinlei Zhang , Fan Liu , Chuanyi Zhang , Fan Cheng , Yuhui Zheng