English
Related papers

Related papers: Improving Self-supervised Learning with Automated …

200 papers

The inability of deep learning models to handle data drawn from unseen distributions has sparked much interest in unsupervised out-of-distribution (U-OOD) detection, as it is crucial for reliable deep learning models. Despite considerable…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Lars Doorenbos , Raphael Sznitman , Pablo Márquez-Neila

For semi-supervised learning with imbalance classes, the long-tailed distribution of data will increase the model prediction bias toward dominant classes, undermining performance on less frequent classes. Existing methods also face…

Computer Vision and Pattern Recognition · Computer Science 2024-01-10 Kuo Yang , Duo Li , Menghan Hu , Guangtao Zhai , Xiaokang Yang , Xiao-Ping Zhang

Generalizing deep learning models to unknown target domain distribution with low latency has motivated research into test-time training/adaptation (TTT/TTA). Existing approaches often focus on improving test-time training performance under…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Yushu Li , Xun Xu , Yongyi Su , Kui Jia

Deep learning has become the method of choice to tackle real-world problems in different domains, partly because of its ability to learn from data and achieve impressive performance on a wide range of applications. However, its success…

Computer Vision and Pattern Recognition · Computer Science 2022-08-17 Xiaofeng Liu , Chaehwa Yoo , Fangxu Xing , Hyejin Oh , Georges El Fakhri , Je-Won Kang , Jonghye Woo

Recent research tries to extend image restoration capabilities from human perception to machine perception, thereby enhancing the performance of high-level vision tasks in degraded environments. These methods, primarily based on supervised…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Jiawei Wu , Zhi Jin

Prompt learning methods are gaining increasing attention due to their ability to customize large vision-language models to new domains using pre-trained contextual knowledge and minimal training data. However, existing works typically rely…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Duy M. H. Nguyen , An T. Le , Trung Q. Nguyen , Nghiem T. Diep , Tai Nguyen , Duy Duong-Tran , Jan Peters , Li Shen , Mathias Niepert , Daniel Sonntag

Recent unsupervised representation learning methods have shown to be effective in a range of vision tasks by learning representations invariant to data augmentations such as random cropping and color jittering. However, such invariance…

Machine Learning · Computer Science 2021-11-19 Hankook Lee , Kibok Lee , Kimin Lee , Honglak Lee , Jinwoo Shin

Detecting Out-of-Domain (OOD) or unknown intents from user queries is essential in a task-oriented dialog system. A key challenge of OOD detection is to learn discriminative semantic features. Traditional cross-entropy loss only focuses on…

Computation and Language · Computer Science 2021-06-01 Zhiyuan Zeng , Keqing He , Yuanmeng Yan , Zijun Liu , Yanan Wu , Hong Xu , Huixing Jiang , Weiran Xu

Few-shot learning aims to learn a new concept when only a few training examples are available, which has been extensively explored in recent years. However, most of the current works heavily rely on a large-scale labeled auxiliary set to…

Computer Vision and Pattern Recognition · Computer Science 2020-09-18 Tiexin Qin , Wenbin Li , Yinghuan Shi , Yang Gao

Neural network-based anomaly detection methods have shown to achieve high performance. However, they require a large amount of training data for each task. We propose a neural network-based meta-learning method for supervised anomaly…

Machine Learning · Statistics 2021-03-02 Tomoharu Iwata , Atsutoshi Kumagai

Given an unsupervised outlier detection (OD) task on a new dataset, how can we automatically select a good outlier detection method and its hyperparameter(s) (collectively called a model)? Thus far, model selection for OD has been a "black…

Machine Learning · Computer Science 2021-03-18 Yue Zhao , Ryan A. Rossi , Leman Akoglu

Recent studies have addressed the concern of detecting and rejecting the out-of-distribution (OOD) samples as a major challenge in the safe deployment of deep learning (DL) models. It is desired that the DL model should only be confident…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Umar Khalid , Ashkan Esmaeili , Nazmul Karim , Nazanin Rahnavard

We introduce a new paradigm to investigate unsupervised learning, reducing unsupervised learning to supervised learning. Specifically, we mitigate the subjectivity in unsupervised decision-making by leveraging knowledge acquired from prior,…

Machine Learning · Computer Science 2017-01-04 Vikas K. Garg , Adam Tauman Kalai

Active learning promises to alleviate the massive data needs of supervised machine learning: it has successfully improved sample efficiency by an order of magnitude on traditional tasks like topic classification and object recognition.…

Computation and Language · Computer Science 2021-07-07 Siddharth Karamcheti , Ranjay Krishna , Li Fei-Fei , Christopher D. Manning

Semi-supervised domain adaptation (SSDA) adapts a learner to a new domain by effectively utilizing source domain data and a few labeled target samples. It is a practical yet under-investigated research topic. In this paper, we analyze the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Wenqiao Zhang , Changshuo Liu , Can Cui , Beng Chin Ooi

In this study, we introduce an intelligent Test Time Augmentation (TTA) algorithm designed to enhance the robustness and accuracy of image classification models against viewpoint variations. Unlike traditional TTA methods that…

Image and Video Processing · Electrical Eng. & Systems 2024-06-14 Efe Ozturk , Mohit Prabhushankar , Ghassan AlRegib

Addressing the Out-of-Distribution (OoD) segmentation task is a prerequisite for perception systems operating in an open-world environment. Large foundational models are frequently used in downstream tasks, however, their potential for OoD…

Computer Vision and Pattern Recognition · Computer Science 2024-09-11 Nazir Nayal , Youssef Shoeb , Fatma Güney

Instance discriminative self-supervised representation learning has been attracted attention thanks to its unsupervised nature and informative feature representation for downstream tasks. In practice, it commonly uses a larger number of…

Machine Learning · Computer Science 2022-01-17 Kento Nozawa , Issei Sato

In the real world, a learning system could receive an input that is unlike anything it has seen during training. Unfortunately, out-of-distribution samples can lead to unpredictable behaviour. We need to know whether any given input belongs…

Machine Learning · Computer Science 2019-08-21 Alireza Shafaei , Mark Schmidt , James J. Little

Generative models can now produce photorealistic synthetic data which is virtually indistinguishable from the real data used to train it. This is a significant evolution over previous models which could produce reasonable facsimiles of the…

Machine Learning · Computer Science 2024-12-10 Debargha Ganguly , Warren Morningstar , Andrew Yu , Vipin Chaudhary