English
Related papers

Related papers: Better Sampling of Negatives for Distantly Supervi…

200 papers

Distantly supervised models are very popular for relation extraction since we can obtain a large amount of training data using the distant supervision method without human annotation. In distant supervision, a sentence is considered as a…

Computation and Language · Computer Science 2021-08-24 Tapas Nayak , Navonil Majumder , Soujanya Poria

The performance of Dense retrieval (DR) is significantly influenced by the quality of negative sampling. Traditional DR methods primarily depend on naive negative sampling techniques or on mining hard negatives through external retriever…

Information Retrieval · Computer Science 2024-12-24 Xiaopeng Li , Xiangyang Li , Hao Zhang , Zhaocheng Du , Pengyue Jia , Yichao Wang , Xiangyu Zhao , Huifeng Guo , Ruiming Tang

In the case of an imbalance between positive and negative samples, hard negative mining strategies have been shown to help models learn more subtle differences between positive and negative samples, thus improving recognition performance.…

Computer Vision and Pattern Recognition · Computer Science 2023-03-13 Jiahan Zhang , Dayong Tian

Noisy labels can significantly affect the performance of deep neural networks (DNNs). In medical image segmentation tasks, annotations are error-prone due to the high demand in annotation time and in the annotators' expertise. Existing…

Image and Video Processing · Electrical Eng. & Systems 2023-08-08 Jiachen Yao , Yikai Zhang , Songzhu Zheng , Mayank Goswami , Prateek Prasanna , Chao Chen

Spoken language understanding (SLU) tasks involve mapping from speech audio signals to semantic labels. Given the complexity of such tasks, good performance might be expected to require large labeled datasets, which are difficult to collect…

Computation and Language · Computer Science 2022-07-12 Ankita Pasad , Felix Wu , Suwon Shon , Karen Livescu , Kyu J. Han

Contrastive learning has been widely studied in sentence representation learning. However, earlier works mainly focus on the construction of positive examples, while in-batch samples are often simply treated as negative examples. This…

Computation and Language · Computer Science 2023-05-18 Jinghao Deng , Fanqi Wan , Tao Yang , Xiaojun Quan , Rui Wang

Deep neural networks are being applied in many tasks with encouraging results, and have often reached human-level performance. However, deep neural networks are vulnerable to well-designed input samples called adversarial examples. In…

Computer Vision and Pattern Recognition · Computer Science 2019-08-06 Dang Duy Thang , Toshihiro Matsui

Automated ranking of pre-trained Deep Neural Networks (DNNs) reduces the required time for selecting optimal pre-trained DNN and boost the classification performance in transfer learning. In this paper, we introduce a novel algorithm to…

Machine Learning · Computer Science 2020-12-29 Mostafa Kalhor , Ahmad Kalhor , Mehdi Rahmani

Sampling proper negatives from a large document pool is vital to effectively train a dense retrieval model. However, existing negative sampling strategies suffer from the uninformative or false negative problem. In this work, we empirically…

Computation and Language · Computer Science 2022-10-25 Kun Zhou , Yeyun Gong , Xiao Liu , Wayne Xin Zhao , Yelong Shen , Anlei Dong , Jingwen Lu , Rangan Majumder , Ji-Rong Wen , Nan Duan , Weizhu Chen

Deep neural networks (DNNs) suffer from noisy-labeled data because of the risk of overfitting. To avoid the risk, in this paper, we propose a novel DNN training method with sample selection based on adaptive k-set selection, which selects k…

Machine Learning · Computer Science 2021-04-06 H. Song , N. Mitsuo , S. Uchida , D. Suehiro

Segmentation and classification of cell nuclei in histopathology images using deep neural networks (DNNs) can save pathologists' time for diagnosing various diseases, including cancers, by automating cell counting and morphometric…

Computer Vision and Pattern Recognition · Computer Science 2023-10-06 Amruta Parulekar , Utkarsh Kanwat , Ravi Kant Gupta , Medha Chippa , Thomas Jacob , Tripti Bameta , Swapnil Rane , Amit Sethi

Identifying named entities such as a person, location or organization, in documents can highlight key information to readers. Training Named Entity Recognition (NER) models requires an annotated data set, which can be a time-consuming…

Computation and Language · Computer Science 2022-12-20 Ting Wai Terence Au , Ingemar J. Cox , Vasileios Lampos

In the field of medical image analysis, deep learning models have demonstrated remarkable success in enhancing diagnostic accuracy and efficiency. However, the reliability of these models is heavily dependent on the quality of training…

Image and Video Processing · Electrical Eng. & Systems 2024-07-12 Maolin Li , Giacomo Tarroni

Named Entity Recognition (NER) frequently suffers from the problem of insufficient labeled data, particularly in fine-grained NER scenarios. Although $K$-shot learning techniques can be applied, their performance tends to saturate when the…

Computation and Language · Computer Science 2023-11-14 Su Ah Lee , Seokjin Oh , Woohwan Jung

Label noise in real-world datasets encodes wrong correlation patterns and impairs the generalization of deep neural networks (DNNs). It is critical to find efficient ways to detect corrupted patterns. Current methods primarily focus on…

Machine Learning · Computer Science 2022-06-22 Zhaowei Zhu , Zihao Dong , Yang Liu

Named entity recognition (NER), which focuses on the extraction of semantically meaningful named entities and their semantic classes from text, serves as an indispensable component for several down-stream natural language processing (NLP)…

Computation and Language · Computer Science 2018-10-23 Zhanming Jie , Aldrian Obaja Muis , Wei Lu

Learning the similarity between remote sensing (RS) images forms the foundation for content-based RS image retrieval (CBIR). Recently, deep metric learning approaches that map the semantic similarity of images into an embedding (metric)…

Computer Vision and Pattern Recognition · Computer Science 2021-11-10 Gencer Sumbul , Mahdyar Ravanbakhsh , Begüm Demir

Supervised named entity recognition (NER) in the biomedical domain depends on large sets of annotated texts with the given named entities. The creation of such datasets can be time-consuming and expensive, while extraction of new entities…

Computation and Language · Computer Science 2024-08-27 Miloš Košprdić , Nikola Prodanović , Adela Ljajić , Bojana Bašaragin , Nikola Milošević

Negative sampling methods are vital in implicit recommendation models as they allow us to obtain negative instances from massive unlabeled data. Most existing approaches focus on sampling hard negative samples in various ways. These studies…

Information Retrieval · Computer Science 2023-11-08 Fuyuan Lyu , Yaochen Hu , Xing Tang , Yingxue Zhang , Ruiming Tang , Xue Liu

We propose a meta-learning method for learning from multiple noisy annotators. In many applications such as crowdsourcing services, labels for supervised learning are given by multiple annotators. Since the annotators have different skills…

Machine Learning · Computer Science 2025-06-13 Atsutoshi Kumagai , Tomoharu Iwata , Taishi Nishiyama , Yasutoshi Ida , Yasuhiro Fujiwara