English
Related papers

Related papers: Dual Conditional Cross-Entropy Filtering of Noisy …

200 papers

Despite the success of multimodal learning in cross-modal retrieval task, the remarkable progress relies on the correct correspondence among multimedia data. However, collecting such ideal data is expensive and time-consuming. In practice,…

Computer Vision and Pattern Recognition · Computer Science 2023-04-14 Haochen Han , Kaiyao Miao , Qinghua Zheng , Minnan Luo

Many researchers collect data from the internet through crowd-sourcing or web crawling to alleviate the data-hungry challenge associated with cross-modal matching. Although such practice does not require expensive annotations, it inevitably…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Fan Liu , Chenwei Dong , Chuanyi Zhang , Hualiang Zhou , Jun Zhou

It is relatively easy to mine a large parallel corpus for any machine learning task, such as speech-to-text or speech-to-speech translation. Although these mined corpora are large in volume, their quality is questionable. This work shows…

Computation and Language · Computer Science 2024-02-06 Md Mahfuz Ibn Alam , Antonios Anastasopoulos

We propose a novel model architecture and training algorithm to learn bilingual sentence embeddings from a combination of parallel and monolingual data. Our method connects autoencoding and neural machine translation to force the source and…

Computation and Language · Computer Science 2019-06-06 Yunsu Kim , Hendrik Rosendahl , Nick Rossenbach , Jan Rosendahl , Shahram Khadivi , Hermann Ney

Machine Translation Quality Estimation (QE) is the task of evaluating translation output in the absence of human-written references. Due to the scarcity of human-labeled QE data, previous works attempted to utilize the abundant unlabeled…

Computation and Language · Computer Science 2022-12-21 Baopu Qiu , Liang Ding , Di Wu , Lin Shang , Yibing Zhan , Dacheng Tao

This paper describes our submission to the WMT20 sentence filtering task. We combine scores from (1) a custom LASER built for each source language, (2) a classifier built to distinguish positive and negative pairs by semantic alignment, and…

Computation and Language · Computer Science 2020-11-17 Muhammad N. ElNokrashy , Amr Hendy , Mohamed Abdelghaffar , Mohamed Afify , Ahmed Tawfik , Hany Hassan Awadalla

Deep neural networks can memorize corrupted labels, making data quality critical for model performance, yet real-world datasets are frequently compromised by both label noise and input noise. This paper proposes a mutual information-based…

Machine Learning · Computer Science 2025-08-12 Jinghan Yang , Jiayu Weng

Within the task of collaborative filtering two challenges for computing conditional probabilities exist. First, the amount of training data available is typically sparse with respect to the size of the domain. Thus, support for higher-order…

Information Retrieval · Computer Science 2012-07-19 Lawrence Zitnick , Takeo Kanade

Falsely annotated samples, also known as noisy labels, can significantly harm the performance of deep learning models. Two main approaches for learning with noisy labels are global noise estimation and data filtering. Global noise…

Machine Learning · Computer Science 2025-07-31 Yuval Grinberg , Nimrod Harel , Jacob Goldberger , Ofir Lindenbaum

Contrastive learning on graphs aims at extracting distinguishable high-level representations of nodes. In this paper, we theoretically illustrate that the entropy of a dataset can be approximated by maximizing the lower bound of the mutual…

Machine Learning · Computer Science 2023-07-27 Yixuan Ma , Xiaolin Zhang , Peng Zhang , Kun Zhan

The transition matrix, denoting the transition relationship from clean labels to noisy labels, is essential to build statistically consistent classifiers in label-noise learning. Existing methods for estimating the transition matrix rely…

Machine Learning · Computer Science 2021-06-24 Yu Yao , Tongliang Liu , Bo Han , Mingming Gong , Jiankang Deng , Gang Niu , Masashi Sugiyama

Machine translation has recently achieved impressive performance thanks to recent advances in deep learning and the availability of large-scale parallel corpora. There have been numerous attempts to extend these successes to low-resource…

Computation and Language · Computer Science 2018-04-16 Guillaume Lample , Alexis Conneau , Ludovic Denoyer , Marc'Aurelio Ranzato

In the realm of cross-modal retrieval, seamlessly integrating diverse modalities within multimedia remains a formidable challenge, especially given the complexities introduced by noisy correspondence learning (NCL). Such noise often stems…

Multimedia · Computer Science 2024-08-05 Yue Duan , Zhangxuan Gu , Zhenzhe Ying , Lei Qi , Changhua Meng , Yinghuan Shi

Either human annotation or rule based automatic labeling is an effective method to augment data for relation extraction. However, the inevitable wrong labeling problem for example by distant supervision may deteriorate the performance of…

Computation and Language · Computer Science 2020-04-30 Shanchan Wu , Kai Fan

Metrics for measuring the comparability of corpora or texts need to be developed and evaluated systematically. Applications based on a corpus, such as training Statistical MT systems in specialised narrow domains, require finding a…

Computation and Language · Computer Science 2014-04-16 Bogdan Babych , Anthony Hartley

Recent machine translation algorithms mainly rely on parallel corpora. However, since the availability of parallel corpora remains limited, only some resource-rich language pairs can benefit from them. We constructed a parallel corpus for…

Computation and Language · Computer Science 2020-03-17 Makoto Morishita , Jun Suzuki , Masaaki Nagata

Using noisy crowdsourced labels from multiple annotators, a deep learning-based end-to-end (E2E) system aims to learn the label correction mechanism and the neural classifier simultaneously. To this end, many E2E systems concatenate the…

Machine Learning · Computer Science 2023-06-07 Shahana Ibrahim , Tri Nguyen , Xiao Fu

We consider the problem of finding the $k^{th}$ highest element in a totally ordered set of $n$ elements (select), and partitioning a totally ordered set into the top $k$ and bottom $n-k$ elements (partition) using pairwise comparisons.…

Data Structures and Algorithms · Computer Science 2016-03-17 Mark Braverman , Jieming Mao , S. Matthew Weinberg

We introduce Multi-Frame Cross-Entropy training (MFCE) for convolutional neural network acoustic models. Recognizing that similar to RNNs, CNNs are in nature sequence models that take variable length inputs, we propose to take as input to…

Audio and Speech Processing · Electrical Eng. & Systems 2019-08-01 Tom Sercu , Neil Mallinar

Deep learning has made many remarkable achievements in many fields but suffers from noisy labels in datasets. The state-of-the-art learning with noisy label method Co-teaching and Co-teaching+ confronts the noisy label by mutual-information…

Computer Vision and Pattern Recognition · Computer Science 2022-08-16 Jiarun Liu , Daguang Jiang , Yukun Yang , Ruirui Li