English
Related papers

Related papers: NADS: Neural Architecture Distribution Search for …

200 papers

Research around Spiking Neural Networks has ignited during the last years due to their advantages when compared to traditional neural networks, including their efficient processing and inherent ability to model complex temporal dynamics.…

Neural and Evolutionary Computing · Computer Science 2022-10-04 Aitor Martinez Seras , Javier Del Ser , Jesus L. Lobo , Pablo Garcia-Bringas , Nikola Kasabov

Out-of-distribution (OOD) detection is vital to safety-critical machine learning applications and has thus been extensively studied, with a plethora of methods developed in the literature. However, the field currently lacks a unified,…

Computer Vision and Pattern Recognition · Computer Science 2022-10-14 Jingkang Yang , Pengyun Wang , Dejian Zou , Zitang Zhou , Kunyuan Ding , Wenxuan Peng , Haoqi Wang , Guangyao Chen , Bo Li , Yiyou Sun , Xuefeng Du , Kaiyang Zhou , Wayne Zhang , Dan Hendrycks , Yixuan Li , Ziwei Liu

Machine learning algorithms often encounter different or "out-of-distribution" (OOD) data at deployment time, and OOD detection is frequently employed to detect these examples. While it works reasonably well in practice, existing…

Machine Learning · Computer Science 2025-01-16 Konstantin Garov , Kamalika Chaudhuri

Real-world machine learning applications often face simultaneous covariate and semantic shifts, challenging traditional domain generalization and out-of-distribution (OOD) detection methods. We introduce Meta-learned Across Domain…

Machine Learning · Computer Science 2024-11-06 Haoliang Wang , Chen Zhao , Feng Chen

In order to safely deploy Deep Neural Networks (DNNs) within the perception pipelines of real-time decision making systems, there is a need for safeguards that can detect out-of-training-distribution (OoD) inputs both efficiently and…

Machine Learning · Computer Science 2021-02-26 Apoorva Sharma , Navid Azizan , Marco Pavone

Deep neural networks (DNNs) have become the de facto learning mechanism in different domains. Their tendency to perform unreliably on out-of-distribution (OOD) inputs hinders their adoption in critical domains. Several approaches have been…

Machine Learning · Computer Science 2020-06-26 Vahdat Abdelzad , Krzysztof Czarnecki , Rick Salay

As machine learning models continue to achieve impressive performance across different tasks, the importance of effective anomaly detection for such models has increased as well. It is common knowledge that even well-trained models lose…

Machine Learning · Computer Science 2023-02-23 Ramneet Kaur , Xiayan Ji , Souradeep Dutta , Michele Caprio , Yahan Yang , Elena Bernardis , Oleg Sokolsky , Insup Lee

Out-of-distribution detection is an important capability that has long eluded vanilla neural networks. Deep Neural networks (DNNs) tend to generate over-confident predictions when presented with inputs that are significantly…

Machine Learning · Computer Science 2022-02-24 Sumedh A Sontakke , Buvaneswari Ramanan , Laurent Itti , Thomas Woo

Out-of-distribution (OOD) detection is essential for ensuring the reliability of deep learning models operating in open-world scenarios. Current OOD detectors mainly rely on statistical models to identify unusual patterns in the latent…

Machine Learning · Computer Science 2025-06-06 Konstantin Kirchheim , Frank Ortmeier

Detecting out-of-distribution (OOD) data is a critical challenge in machine learning due to model overconfidence, often without awareness of their epistemological limits. We hypothesize that ``neural collapse'', a phenomenon affecting…

Machine Learning · Statistics 2024-02-28 Mouïn Ben Ammar , Nacim Belkhir , Sebastian Popescu , Antoine Manzanera , Gianni Franchi

Deep Neural Networks for classification behave unpredictably when confronted with inputs not stemming from the training distribution. This motivates out-of-distribution detection (OOD) mechanisms. The usual lack of prior information on…

Machine Learning · Computer Science 2022-03-02 Konstantin Kirchheim , Tim Gonschorek , Frank Ortmeier

A crucial requirement for machine learning algorithms is not only to perform well, but also to show robustness and adaptability when encountering novel scenarios. One way to achieve these characteristics is to endow the deep learning models…

Computer Vision and Pattern Recognition · Computer Science 2025-02-26 Eduardo Aguilar , Bogdan Raducanu , Petia Radeva

We explore the utility of information contained within a dropout based Bayesian neural network (BNN) for the task of detecting out of distribution (OOD) data. We first show how previous attempts to leverage the randomized embeddings induced…

Machine Learning · Computer Science 2022-02-21 Andre T. Nguyen , Fred Lu , Gary Lopez Munoz , Edward Raff , Charles Nicholas , James Holt

Deep neural networks have attained remarkable performance when applied to data that comes from the same distribution as that of the training set, but can significantly degrade otherwise. Therefore, detecting whether an example is…

Computer Vision and Pattern Recognition · Computer Science 2020-04-02 Yen-Chang Hsu , Yilin Shen , Hongxia Jin , Zsolt Kira

We study the problem of Out-of-Distribution (OOD) detection, that is, detecting whether a learning algorithm's output can be trusted at inference time. While a number of tests for OOD detection have been proposed in prior work, a formal…

Machine Learning · Statistics 2023-09-19 Akshayaa Magesh , Venugopal V. Veeravalli , Anirban Roy , Susmit Jha

LiDAR-based perception is critical for autonomous driving due to its robustness to poor lighting and visibility conditions. Yet, current models operate under the closed-set assumption and often fail to recognize unexpected…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Zizhao Li , Zhengkang Xiang , Jiayang Ao , Feng Liu , Joseph West , Kourosh Khoshelham

The out-of-distribution (OOD) problem generally arises when neural networks encounter data that significantly deviates from the training data distribution, i.e., in-distribution (InD). In this paper, we study the OOD problem from a neuron…

Machine Learning · Computer Science 2024-03-12 Yibing Liu , Chris Xing Tian , Haoliang Li , Lei Ma , Shiqi Wang

Out-of-distribution (OOD) detection is critical for preventing deep learning models from making incorrect predictions to ensure the safety of artificial intelligence systems. Especially in safety-critical applications such as medical…

Machine Learning · Computer Science 2023-02-16 Mouxiao Huang , Yu Qiao

Detecting out-of-distribution (OOD) inputs is critical for safely deploying deep learning models in the real world. Existing approaches for detecting OOD examples work well when evaluated on benign in-distribution and OOD samples. However,…

Machine Learning · Computer Science 2021-12-10 Jiefeng Chen , Yixuan Li , Xi Wu , Yingyu Liang , Somesh Jha

Out-of-distribution detection (OOD) deals with anomalous input to neural networks. In the past, specialized methods have been proposed to reject predictions on anomalous input. Similarly, it was shown that feature extraction models in…

Machine Learning · Computer Science 2022-01-25 Jan Diers , Christian Pigorsch