English
Related papers

Related papers: Revealing the Underlying Patterns: Investigating D…

200 papers

Most existing distance metric learning approaches use fully labeled data to learn the sample similarities in an embedding space. We present a self-training framework, SLADE, to improve retrieval performance by leveraging additional…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Jiali Duan , Yen-Liang Lin , Son Tran , Larry S. Davis , C. -C. Jay Kuo

Identifying and mitigating bias in deep learning algorithms has gained significant popularity in the past few years due to its impact on the society. Researchers argue that models trained on balanced datasets with good representation…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Puspita Majumdar , Surbhi Mittal , Richa Singh , Mayank Vatsa

This paper briefly reviews the connections between meta-learning and self-supervised learning. Meta-learning can be applied to improve model generalization capability and to construct general AI algorithms. Self-supervised learning utilizes…

Machine Learning · Computer Science 2021-11-17 Huimin Peng

The growing scale of datasets in deep learning has introduced significant computational challenges. Dataset pruning addresses this challenge by constructing a compact but informative coreset from the full dataset with comparable…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Furui Xu , Shaobo Wang , Jiajun Zhang , Chenghao Sun , Haixiang Tang , Linfeng Zhang

At its core, this thesis aims to enhance the practicality of deep learning by improving the label and training efficiency of deep learning models. To this end, we investigate data subset selection techniques, specifically active learning…

Machine Learning · Computer Science 2024-03-11 Andreas Kirsch

When a deep learning model is deployed in the wild, it can encounter test data drawn from distributions different from the training data distribution and suffer drop in performance. For safe deployment, it is essential to estimate the…

Machine Learning · Computer Science 2023-05-16 Jiefeng Chen , Frederick Liu , Besim Avci , Xi Wu , Yingyu Liang , Somesh Jha

Deep neural networks (DNNs) trained on large-scale datasets have exhibited significant performance in image classification. Many large-scale datasets are collected from websites, however they tend to contain inaccurate labels that are…

Computer Vision and Pattern Recognition · Computer Science 2019-04-23 Daiki Tanaka , Daiki Ikami , Toshihiko Yamasaki , Kiyoharu Aizawa

Domain generalization aims at training machine learning models to perform robustly across different and unseen domains. Several recent methods use multiple datasets to train models to extract domain-invariant features, hoping to generalize…

Machine Learning · Computer Science 2021-05-19 Mattia Segu , Alessio Tonioni , Federico Tombari

Metric Learning for visual similarity has mostly adopted binary supervision indicating whether a pair of images are of the same class or not. Such a binary indicator covers only a limited subset of image relations, and is not sufficient to…

Computer Vision and Pattern Recognition · Computer Science 2019-04-23 Sungyeon Kim , Minkyo Seo , Ivan Laptev , Minsu Cho , Suha Kwak

Deep learning perception models require a massive amount of labeled training data to achieve good performance. While unlabeled data is easy to acquire, the cost of labeling is prohibitive and could create a tremendous burden on companies or…

Computer Vision and Pattern Recognition · Computer Science 2021-11-19 Xinnan Du , William Zhang , Jose M. Alvarez

This paper proposes an introspective deep metric learning (IDML) framework for uncertainty-aware comparisons of images. Conventional deep metric learning methods focus on learning a discriminative embedding to describe the semantic features…

Computer Vision and Pattern Recognition · Computer Science 2023-09-20 Chengkun Wang , Wenzhao Zheng , Zheng Zhu , Jie Zhou , Jiwen Lu

Background: Deep learning models are typically trained using stochastic gradient descent or one of its variants. These methods update the weights using their gradient, estimated from a small fraction of the training data. It has been…

Machine Learning · Statistics 2018-01-03 Elad Hoffer , Itay Hubara , Daniel Soudry

Deep Learning heavily depends on large labeled datasets which limits further improvements. While unlabeled data is available in large amounts, in particular in image recognition, it does not fulfill the closed world assumption of…

Machine Learning · Computer Science 2020-12-24 Maximilian Augustin , Matthias Hein

State-of-the-art deep learning models are often trained with a large amount of costly labeled training data. However, requiring exhaustive manual annotations may degrade the model's generalizability in the limited-label regime.…

Computer Vision and Pattern Recognition · Computer Science 2022-08-25 Yanbei Chen , Massimiliano Mancini , Xiatian Zhu , Zeynep Akata

Understanding the generalization behaviour of deep neural networks is a topic of recent interest that has driven the production of many studies, notably the development and evaluation of generalization "explainability" measures that…

Machine Learning · Computer Science 2021-10-26 Jonathan Jaegerman , Khalil Damouni , Mahdi S. Hosseini , Konstantinos N. Plataniotis

Deep neural networks have gained tremendous success in a broad range of machine learning tasks due to its remarkable capability to learn semantic-rich features from high-dimensional data. However, they often require large-scale labelled…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Hu Wang , Guansong Pang , Chunhua Shen , Congbo Ma

This work studies deep metric learning under small to medium scale data as we believe that better generalization could be a contributing factor to the improvement of previous fine-grained image retrieval methods; it should be considered…

Computer Vision and Pattern Recognition · Computer Science 2018-12-11 Nam Vo , James Hays

Fairness has been a critical issue that affects the adoption of deep learning models in real practice. To improve model fairness, many existing methods have been proposed and evaluated to be effective in their own contexts. However, there…

Machine Learning · Computer Science 2024-03-26 Junjie Yang , Jiajun Jiang , Zeyu Sun , Junjie Chen

Despite the success of deep neural networks (DNNs) in image classification tasks, the human-level performance relies on massive training data with high-quality manual annotations, which are expensive and time-consuming to collect. There…

Machine Learning · Computer Science 2019-04-15 Junnan Li , Yongkang Wong , Qi Zhao , Mohan Kankanhalli

Recent advances in deep learning have relied on large, labelled datasets to train high-capacity models. However, collecting large datasets in a time- and cost-efficient manner often results in label noise. We present a method for learning…

Computer Vision and Pattern Recognition · Computer Science 2022-07-07 Ahmet Iscen , Jack Valmadre , Anurag Arnab , Cordelia Schmid