English
Related papers

Related papers: TASTE: Task-Aware Out-of-Distribution Detection vi…

200 papers

As language models become more general purpose, increased attention needs to be paid to detecting out-of-distribution (OOD) instances, i.e., those not belonging to any of the distributions seen during training. Existing methods for…

Machine Learning · Computer Science 2024-07-19 Aryan Gulati , Xingjian Dong , Carlos Hurtado , Sarath Shekkizhar , Swabha Swayamdipta , Antonio Ortega

As machine learning models continue to achieve impressive performance across different tasks, the importance of effective anomaly detection for such models has increased as well. It is common knowledge that even well-trained models lose…

Machine Learning · Computer Science 2023-02-23 Ramneet Kaur , Xiayan Ji , Souradeep Dutta , Michele Caprio , Yahan Yang , Elena Bernardis , Oleg Sokolsky , Insup Lee

Density-based Out-of-distribution (OOD) detection has recently been shown unreliable for the task of detecting OOD images. Various density ratio based approaches achieve good empirical performance, however methods typically lack a…

Machine Learning · Statistics 2022-06-09 Mingtian Zhang , Andi Zhang , Tim Z. Xiao , Yitong Sun , Steven McDonagh

Classification tasks present challenges due to class imbalances and evolving data distributions. Addressing these issues requires a robust method to handle imbalances while effectively detecting out-of-distribution (OOD) samples not…

Machine Learning · Computer Science 2024-09-05 Priyanka Chudasama , Anil Surisetty , Aakarsh Malhotra , Alok Singh

Research around Spiking Neural Networks has ignited during the last years due to their advantages when compared to traditional neural networks, including their efficient processing and inherent ability to model complex temporal dynamics.…

Neural and Evolutionary Computing · Computer Science 2022-10-04 Aitor Martinez Seras , Javier Del Ser , Jesus L. Lobo , Pablo Garcia-Bringas , Nikola Kasabov

In the field of Machine Learning (ML) and data-driven applications, one of the significant challenge is the change in data distribution between the training and deployment stages, commonly known as distribution shift. This paper outlines…

Machine Learning · Computer Science 2025-07-30 Lakpa Tamang , Mohamed Reda Bouadjenek , Richard Dazeley , Sunil Aryal

We consider the problem of detecting OoD(Out-of-Distribution) input data when using deep neural networks, and we propose a simple yet effective way to improve the robustness of several popular OoD detection methods against label shift. Our…

Machine Learning · Computer Science 2022-07-04 Matteo Guarrera , Baihong Jin , Tung-Wei Lin , Maria Zuluaga , Yuxin Chen , Alberto Sangiovanni-Vincentelli

Current techniques for Out-of-Distribution (OoD) detection predominantly rely on quantifying predictive uncertainty and incorporating model regularization during the training phase, using either real or synthetic OoD samples. However,…

Machine Learning · Computer Science 2023-10-13 Xiaoyang Song , Wenbo Sun , Maher Nouiehed , Raed Al Kontar , Judy Jin

Out-of-Distribution (OoD) detection aims to justify whether a given sample is from the training distribution of the classifier-under-protection, i.e., In-Distribution (InD), or from OoD. Diffusion Models (DMs) are recently utilized in OoD…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Kun Fang , Qinghua Tao , Zuopeng Yang , Xiaolin Huang , Jie Yang

Numerous machine learning (ML) models have been developed, including those for software engineering (SE) tasks, under the assumption that training and testing data come from the same distribution. However, training and testing distributions…

Software Engineering · Computer Science 2025-03-04 Yanfu Yan , Viet Duong , Huajie Shao , Denys Poshyvanyk

Graph machine learning has witnessed rapid growth, driving advancements across diverse domains. However, the in-distribution assumption, where training and testing data share the same distribution, often breaks in real-world scenarios,…

Machine Learning · Computer Science 2025-02-13 Tingyi Cai , Yunliang Jiang , Yixin Liu , Ming Li , Changqin Huang , Shirui Pan

Outlier exposure (OE) is powerful in out-of-distribution (OOD) detection, enhancing detection capability via model fine-tuning with surrogate OOD data. However, surrogate data typically deviate from test OOD data. Thus, the performance of…

Machine Learning · Computer Science 2023-03-10 Qizhou Wang , Junjie Ye , Feng Liu , Quanyu Dai , Marcus Kalander , Tongliang Liu , Jianye Hao , Bo Han

The ability to detect objects that are not prevalent in the training set is a critical capability in many 3D applications, including autonomous driving. Machine learning methods for object recognition often assume that all object categories…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Zizhao Li , Xueyang Kang , Joseph West , Kourosh Khoshelham

To detect distribution shifts and improve model safety, many out-of-distribution (OOD) detection methods rely on the predictive uncertainty or features of supervised models trained on in-distribution data. In this paper, we critically…

Machine Learning · Computer Science 2025-07-03 Yucen Lily Li , Daohan Lu , Polina Kirichenko , Shikai Qiu , Tim G. J. Rudner , C. Bayan Bruss , Andrew Gordon Wilson

Out-of-distribution (OOD) detection has recently received much attention from the machine learning community due to its importance in deploying machine learning models in real-world applications. In this paper we propose an uncertainty…

Machine Learning · Computer Science 2022-06-28 Xiongjie Chen , Yunpeng Li , Yongxin Yang

We present simple methods for out-of-distribution detection using a trained generative model. These techniques, based on classical statistical tests, are model-agnostic in the sense that they can be applied to any differentiable generative…

Despite their recent success, deep neural networks continue to perform poorly when they encounter distribution shifts at test time. Many recently proposed approaches try to counter this by aligning the model to the new distribution prior to…

Computer Vision and Pattern Recognition · Computer Science 2022-09-26 Samarth Sinha , Peter Gehler , Francesco Locatello , Bernt Schiele

Detecting out-of-distribution (OOD) samples plays a key role in open-world and safety-critical applications such as autonomous systems and healthcare. Recently, self-supervised representation learning techniques (via contrastive learning…

Computer Vision and Pattern Recognition · Computer Science 2021-10-12 Sina Mohseni , Arash Vahdat , Jay Yadawa

Uncertainties in machine learning are a significant roadblock for its application in safety-critical cyber-physical systems (CPS). One source of uncertainty arises from distribution shifts in the input data between training and test…

Machine Learning · Computer Science 2021-08-02 Yeli Feng , Daniel Jun Xian Ng , Arvind Easwaran

When presented with Out-of-Distribution (OOD) examples, deep neural networks yield confident, incorrect predictions. Detecting OOD examples is challenging, and the potential risks are high. In this paper, we propose to detect OOD examples…

Machine Learning · Computer Science 2020-01-10 Chandramouli Shama Sastry , Sageev Oore