English
Related papers

Related papers: ProtoKD: Learning from Extremely Scarce Data for P…

200 papers

Deep Learning shows very good performance when trained on large labeled data sets. The problem of training a deep net on a few or one sample per class requires a different learning approach which can generalize to unseen classes using only…

Machine Learning · Computer Science 2018-08-23 Jinchao Liu , Stuart J. Gibson , Margarita Osadchy

Out-of-distribution (OOD) detection is essential for determining when a supervised model encounters inputs that differ meaningfully from its training distribution. While widely studied in classification, OOD detection for regression and…

Machine Learning · Statistics 2025-12-16 Min Lu , Hemant Ishwaran

How can we automatically select an out-of-distribution (OOD) detection model for various underlying tasks? This is crucial for maintaining the reliability of open-world applications by identifying data distribution shifts, particularly in…

Machine Learning · Computer Science 2025-03-03 Yuehan Qin , Yichi Zhang , Yi Nian , Xueying Ding , Yue Zhao

Deep learning has dramatically improved the performance in many application areas such as image classification, object detection, speech recognition, drug discovery and etc since 2012. Where deep learning algorithms promise to discover the…

Image and Video Processing · Electrical Eng. & Systems 2020-03-25 X. F. Xu , S. Talbot , T. Selvaraja

The application of machine learning in safety-critical systems requires a reliable assessment of uncertainty. However, deep neural networks are known to produce highly overconfident predictions on out-of-distribution (OOD) data. Even if…

Machine Learning · Computer Science 2022-10-19 Alexander Meinke , Julian Bitterwolf , Matthias Hein

Thyroid nodule classification using ultrasound imaging is essential for early diagnosis and clinical decision-making; however, despite promising performance on in-distribution data, existing deep learning methods often exhibit limited…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Yangmei Chen , Zhongyuan Zhang , Xikun Zhang , Xinyu Hao , Mingliang Hou , Renqiang Luo , Ziqi Xu

Knowledge distillation is an effective method for training small and efficient deep learning models. However, the efficacy of a single method can degenerate when transferring to other tasks, modalities, or even other architectures. To…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Roy Miles , Ismail Elezi , Jiankang Deng

Detecting rare objects from a few examples is an emerging problem. Prior works show meta-learning is a promising approach. But, fine-tuning techniques have drawn scant attention. We find that fine-tuning only the last layer of existing…

Computer Vision and Pattern Recognition · Computer Science 2020-03-17 Xin Wang , Thomas E. Huang , Trevor Darrell , Joseph E. Gonzalez , Fisher Yu

Recent years have seen rapid development in Information Extraction, as well as its subtask, Relation Extraction. Relation Extraction is able to detect semantic relations between entities in sentences. Currently, many efficient approaches…

Computation and Language · Computer Science 2024-03-19 Zhuang Li

The performance of object detection, to a great extent, depends on the availability of large annotated datasets. To alleviate the annotation cost, the research community has explored a number of ways to exploit unlabeled or weakly labeled…

Computer Vision and Pattern Recognition · Computer Science 2021-05-25 Shijie Fang , Yuhang Cao , Xinjiang Wang , Kai Chen , Dahua Lin , Wayne Zhang

Modern over-parameterized deep models are highly data-dependent, with large scale general-purpose and domain-specific datasets serving as the bedrock for rapid advancements. However, many datasets are proprietary or contain sensitive…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Hongyu Zhu , Sichu Liang , Wenwen Wang , Zhuomeng Zhang , Fangqi Li , Shi-Lin Wang

Many complicated real-world tasks can be broken down into smaller, more manageable parts, and planning with prior knowledge extracted from these simplified pieces is crucial for humans to make accurate decisions. However, replicating this…

Artificial Intelligence · Computer Science 2024-05-21 Jingqing Ruan , Kaishen Wang , Qingyang Zhang , Dengpeng Xing , Bo Xu

Next-generation sequencing technologies have enhanced the scope of Internet-of-Things (IoT) to include genomics for personalized medicine through the increased availability of an abundance of genome data collected from heterogeneous sources…

Out-of-Distribution (OOD) detection, i.e., identifying whether an input is sampled from a novel distribution other than the training distribution, is a critical task for safely deploying machine learning systems in the open world. Recently,…

Machine Learning · Computer Science 2023-01-13 Feng Xue , Zi He , Chuanlong Xie , Falong Tan , Zhenguo Li

Although the Prototypical Network (ProtoNet) has demonstrated effectiveness in few-shot biological event detection, two persistent issues remain. Firstly, there is difficulty in constructing a representative negative prototype due to the…

Sound · Computer Science 2024-09-24 Yaxiong Chen , Xueping Zhang , Yunfei Zi , Shengwu Xiong

Out-of-distribution (OOD) detection plays a crucial role in ensuring the safety and reliability of deep neural networks in various applications. While there has been a growing focus on OOD detection in visual data, the field of textual OOD…

Computation and Language · Computer Science 2024-04-10 Li-Ming Zhan , Bo Liu , Xiao-Ming Wu

Most of the existing recognition algorithms are proposed for closed set scenarios, where all categories are known beforehand. However, in practice, recognition is essentially an open set problem. There are categories we know called…

Computer Vision and Pattern Recognition · Computer Science 2020-01-14 Yu Shu , Yemin Shi , Yaowei Wang , Tiejun Huang , Yonghong Tian

We present Deeply Supervised Object Detector (DSOD), a framework that can learn object detectors from scratch. State-of-the-art object objectors rely heavily on the off-the-shelf networks pre-trained on large-scale classification datasets…

Computer Vision and Pattern Recognition · Computer Science 2018-05-01 Zhiqiang Shen , Zhuang Liu , Jianguo Li , Yu-Gang Jiang , Yurong Chen , Xiangyang Xue

Accurate segmentation of organelle instances, e.g., mitochondria, is essential for electron microscopy analysis. Despite the outstanding performance of fully supervised methods, they highly rely on sufficient per-pixel annotated data and…

Computer Vision and Pattern Recognition · Computer Science 2022-11-01 Dafei Qiu , Jiajin Yi , Jialin Peng

This paper tackles the problem of novel category discovery (NCD), which aims to discriminate unknown categories in large-scale image collections. The NCD task is challenging due to the closeness to the real-world scenarios, where we have…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Lu Zhang , Lu Qi , Xu Yang , Hong Qiao , Ming-Hsuan Yang , Zhiyong Liu