English
Related papers

Related papers: ConeSep: Cone-based Robust Noise-Unlearning Compos…

200 papers

In open-domain Question Answering (QA), dense retrieval is crucial for finding relevant passages for answer generation. Typically, contrastive learning is used to train a retrieval model that maps passages and queries to the same semantic…

Computation and Language · Computer Science 2024-01-17 Shiqi Wang , Yeqin Zhang , Cam-Tu Nguyen

Is it possible to recover an image from its noisy version using convolutional neural networks? This is an interesting problem as convolutional layers are generally used as feature detectors for tasks like classification, segmentation and…

Computer Vision and Pattern Recognition · Computer Science 2017-08-02 Nithish Divakar , R. Venkatesh Babu

Contrastive Learning (CL) has been proved to be a powerful self-supervised approach for a wide range of domains, including computer vision and graph representation learning. However, the incremental learning issue of CL has rarely been…

Machine Learning · Computer Science 2023-01-31 Cheng Ji , Jianxin Li , Hao Peng , Jia Wu , Xingcheng Fu , Qingyun Sun , Phillip S. Yu

Convolutional neural networks (CNNs) have had great success in many real-world applications and have also been used to model visual processing in the brain. However, these networks are quite brittle - small changes in the input image can…

Neurons and Cognition · Quantitative Biology 2018-10-30 Brian Hu , Stefan Mihalas

Coherent noise regularly plagues seismic recordings, causing artefacts and uncertainties in products derived from down-the-line processing and imaging tasks. The outstanding capabilities of deep learning in denoising of natural and medical…

Geophysics · Physics 2022-06-02 Sixiu Liu , Claire Birnie , Tariq Alkhalifah

Cross-modal retrieval maps data under different modality via semantic relevance. Existing approaches implicitly assume that data pairs are well-aligned and ignore the widely existing annotation noise, i.e., noisy correspondence (NC).…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Shuai Lyu , Zijing Tian , Zhonghong Ou , Yifan Zhu , Xiao Zhang , Qiankun Ha , Haoran Luo , Meina Song

This paper presents Contrastive Reconstruction, ConRec - a self-supervised learning algorithm that obtains image representations by jointly optimizing a contrastive and a self-reconstruction loss. We showcase that state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2022-02-23 Jonas Dippel , Steffen Vogler , Johannes Höhne

Cross-modal retrieval relies on well-matched large-scale datasets that are laborious in practice. Recently, to alleviate expensive data collection, co-occurring pairs from the Internet are automatically harvested for training. However, it…

Machine Learning · Computer Science 2023-12-29 Zhuohang Dang , Minnan Luo , Chengyou Jia , Guang Dai , Xiaojun Chang , Jingdong Wang

In this paper, we study the problem of learning image classification models in the presence of label noise. We revisit a simple compression regularization named Nested Dropout. We find that Nested Dropout, though originally proposed to…

Computer Vision and Pattern Recognition · Computer Science 2021-04-29 Yingyi Chen , Xi Shen , Shell Xu Hu , Johan A. K. Suykens

Named entity recognition (NER) models often struggle with noisy inputs, such as those with spelling mistakes or errors generated by Optical Character Recognition processes, and learning a robust NER model is challenging. Existing robust NER…

Computation and Language · Computer Science 2024-07-29 Chaoyi Ai , Yong Jiang , Shen Huang , Pengjun Xie , Kewei Tu

Many parametric statistical models are not properly normalised and only specified up to an intractable partition function, which renders parameter estimation difficult. Examples of unnormalised models are Gibbs distributions, Markov random…

Machine Learning · Statistics 2018-06-12 Ciwan Ceylan , Michael U. Gutmann

Contrastive representation learning has proven to be an effective self-supervised learning method for images and videos. Most successful approaches are based on Noise Contrastive Estimation (NCE) and use different views of an instance as…

Computer Vision and Pattern Recognition · Computer Science 2023-09-27 Julien Denize , Jaonary Rabarisoa , Astrid Orcesi , Romain Hérault

Presence of noise in the labels of large scale facial expression datasets has been a key challenge towards Facial Expression Recognition (FER) in the wild. During early learning stage, deep networks fit on clean data. Then, eventually, they…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Darshan Gera , S. Balasubramanian

Recent studies have shown that Convolutional Neural Networks (CNNs) are vulnerable to a small perturbation of input called "adversarial examples". In this work, we propose a new feedforward CNN that improves robustness in the presence of…

Machine Learning · Computer Science 2016-02-26 Jonghoon Jin , Aysegul Dundar , Eugenio Culurciello

Many applications of computer vision require the ability to adapt to novel data distributions after deployment. Adaptation requires algorithms capable of continual learning (CL). Continual learners must be plastic to adapt to novel tasks…

Machine Learning · Computer Science 2025-04-24 Edison Mucllari , Aswin Raghavan , Zachary Alan Daniels

Despite their exceptional performance in vision tasks, deep learning models often struggle when faced with domain shifts during testing. Test-Time Training (TTT) methods have recently gained popularity by their ability to enhance the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-15 David Osowiechi , Gustavo A. Vargas Hakim , Mehrdad Noori , Milad Cheraghalikhani , Ali Bahri , Moslem Yazdanpanah , Ismail Ben Ayed , Christian Desrosiers

Cross-modal retrieval is crucial in understanding latent correspondences across modalities. However, existing methods implicitly assume well-matched training data, which is impractical as real-world data inevitably involves imperfect…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Zhuohang Dang , Minnan Luo , Jihong Wang , Chengyou Jia , Haochen Han , Herun Wan , Guang Dai , Xiaojun Chang , Jingdong Wang

Learning with noisy labels (LNL) has been extensively studied, with existing approaches typically following a framework that alternates between clean sample selection and semi-supervised learning (SSL). However, this approach has a…

Computer Vision and Pattern Recognition · Computer Science 2023-10-25 Qing Miao , Xiaohe Wu , Chao Xu , Yanli Ji , Wangmeng Zuo , Yiwen Guo , Zhaopeng Meng

Neural Machine Translation (NMT) has achieved significant breakthrough in performance but is known to suffer vulnerability to input perturbations. As real input noise is difficult to predict during training, robustness is a big issue for…

Computation and Language · Computer Science 2021-04-21 Weiwen Xu , Ai Ti Aw , Yang Ding , Kui Wu , Shafiq Joty

Learning the similarity between remote sensing (RS) images forms the foundation for content-based RS image retrieval (CBIR). Recently, deep metric learning approaches that map the semantic similarity of images into an embedding (metric)…

Computer Vision and Pattern Recognition · Computer Science 2021-11-10 Gencer Sumbul , Mahdyar Ravanbakhsh , Begüm Demir