English
Related papers

Related papers: Forte : Finding Outliers with Representation Typic…

200 papers

Generative Adversarial Networks (GANs) have made great progress in synthesizing realistic images in recent years. However, they are often trained on image datasets with either too few samples or too many classes belonging to different data…

Machine Learning · Computer Science 2020-10-16 Shichang Tang

Anomaly detection plays a vital role in industrial manufacturing. Due to the scarcity of real defect images, unsupervised approaches that rely solely on normal images have been extensively studied. Recently, diffusion-based generative…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Sungho Kang , Hyunkyu Park , Yeonho Lee , Hanbyul Lee , Mijoo Jeong , YeongHyeon Park , Injae Lee , Juneho Yi

In this paper, we present a novel approach that combines deep metric learning and synthetic data generation using diffusion models for out-of-distribution (OOD) detection. One popular approach for OOD detection is outlier exposure, where…

Computer Vision and Pattern Recognition · Computer Science 2024-05-02 Assefa Seyoum Wahd

One of the challenges for neural networks in real-life applications is the overconfident errors these models make when the data is not from the original training distribution. Addressing this issue is known as Out-of-Distribution (OOD)…

Computer Vision and Pattern Recognition · Computer Science 2024-07-24 Sina Sharifi , Taha Entesari , Bardia Safaei , Vishal M. Patel , Mahyar Fazlyab

With generative models proliferating at a rapid rate, there is a growing need for general purpose fake image detectors. In this work, we first show that the existing paradigm, which consists of training a deep network for real-vs-fake…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Utkarsh Ojha , Yuheng Li , Yong Jae Lee

Edge detection is typically viewed as a pixel-level classification problem mainly addressed by discriminative methods. Recently, generative edge detection methods, especially diffusion model based solutions, are initialized in the edge…

Computer Vision and Pattern Recognition · Computer Science 2024-10-07 Caixia Zhou , Yaping Huang , Mochu Xiang , Jiahui Ren , Haibin Ling , Jing Zhang

Likelihood-based deep generative models such as score-based diffusion models and variational autoencoders are state-of-the-art machine learning models approximating high-dimensional distributions of data such as images, text, or audio. One…

Machine Learning · Statistics 2024-05-28 Sam Dauncey , Chris Holmes , Christopher Williams , Fabian Falck

We consider the problem of learning deep generative models from data. We formulate a method that generates an independent sample via a single feedforward pass through a multilayer perceptron, as in the recently proposed generative…

Machine Learning · Computer Science 2015-02-11 Yujia Li , Kevin Swersky , Richard Zemel

Machine learning algorithms typically assume independent and identically distributed samples in training and at test time. Much work has shown that high-performing ML classifiers can degrade significantly and provide overly-confident, wrong…

Computation and Language · Computer Science 2023-03-09 Jie Ren , Jiaming Luo , Yao Zhao , Kundan Krishna , Mohammad Saleh , Balaji Lakshminarayanan , Peter J. Liu

Our work reveals a structured shortcoming of the existing mainstream self-supervised learning methods. Whereas self-supervised learning frameworks usually take the prevailing perfect instance level invariance hypothesis for granted, we…

Machine Learning · Computer Science 2021-12-16 Yu Wang , Jingyang Lin , Jingjing Zou , Yingwei Pan , Ting Yao , Tao Mei

Change point detection (CPD) methods aim to identify abrupt shifts in the distribution of input data streams. Accurate estimators for this task are crucial across various real-world scenarios. Yet, traditional unsupervised CPD techniques…

Machine Learning · Computer Science 2024-12-04 Alexandra Bazarova , Evgenia Romanenkova , Alexey Zaytsev

Out-of-distribution (OOD) detection is crucial for ensuring the reliability of deep learning models in real-world applications. Existing methods typically focus on feature representations or output-space analysis, often assuming a…

Computer Vision and Pattern Recognition · Computer Science 2025-09-18 Mostafa ElAraby , Sabyasachi Sahoo , Yann Pequignot , Paul Novello , Liam Paull

An important and unsolved problem in computer vision is to ensure that the algorithms are robust to changes in image domains. We address this problem in the scenario where we have access to images from the target domains but no annotations.…

Computer Vision and Pattern Recognition · Computer Science 2025-02-10 Prakhar Kaushik , Adam Kortylewski , Alan Yuille

Large language models (LLMs) have achieved remarkable proficiency on solving diverse problems. However, their generalization ability is not always satisfying and the generalization problem is common for generative transformer models in…

Machine Learning · Computer Science 2024-08-20 Xingcheng Xu , Zihao Pan , Haipeng Zhang , Yanqing Yang

Out-of-distribution (OOD) detection plays a crucial role in ensuring the safety and reliability of deep neural networks in various applications. While there has been a growing focus on OOD detection in visual data, the field of textual OOD…

Computation and Language · Computer Science 2024-04-10 Li-Ming Zhan , Bo Liu , Xiao-Ming Wu

Out-of-distribution (OOD) detection is essential to handle the distribution shifts between training and test scenarios. For a new in-distribution (ID) dataset, existing methods require retraining to capture the dataset-specific feature…

Computer Vision and Pattern Recognition · Computer Science 2024-03-28 Meng Xing , Zhiyong Feng , Yong Su , Changjae Oh

Deep Learning models are easily disturbed by variations in the input images that were not observed during the training stage, resulting in unpredictable predictions. Detecting such Out-of-Distribution (OOD) images is particularly crucial in…

Computer Vision and Pattern Recognition · Computer Science 2023-07-31 Benjamin Lambert , Florence Forbes , Senan Doyle , Michel Dojat

Recognizing wild faces is extremely hard as they appear with all kinds of variations. Traditional methods either train with specifically annotated variation data from target domains, or by introducing unlabeled target variation data to…

Computer Vision and Pattern Recognition · Computer Science 2020-02-28 Yichun Shi , Xiang Yu , Kihyuk Sohn , Manmohan Chandraker , Anil K. Jain

Deep neural networks achieve superior performance for learning from independent and identically distributed (i.i.d.) data. However, their performance deteriorates significantly when handling out-of-distribution (OoD) data, where the…

Machine Learning · Computer Science 2023-07-25 Haoyue Bai , Ceyuan Yang , Yinghao Xu , S. -H. Gary Chan , Bolei Zhou

Detecting out-of-distribution (OOD) samples is a critical task for reliable machine learning. However, it becomes particularly challenging when the models are trained on long-tailed datasets, as the models often struggle to distinguish…

Machine Learning · Computer Science 2024-08-21 Dong Geun Shin , Hye Won Chung