English
Related papers

Related papers: Multiple Distribution Shift -- Aerial (MDS-A): A D…

200 papers

For autonomous vehicles to viably replace human drivers they must contend with inclement weather. Falling rain and snow introduce noise in LiDAR returns resulting in both false positive and false negative object detections. In this article…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Akhil Kurup , Jeremy Bos

Generalizing the application of machine learning models to situations where the statistical distribution of training and test data are different has been a complex problem. Our contributions in this paper are threefold: (1) we introduce an…

Machine Learning · Computer Science 2022-03-03 Hasan Asyari Arief , Peter James Thomas , Tomasz Wiktorski

Anomaly detection aims to identify samples that deviate from the nominal data distribution and is central to many safety-critical applications. However, developing effective anomaly detection methods for categorical, mixed-type, and…

Machine Learning · Computer Science 2026-05-29 Lixing Zhang , Yuchen Liang , Liyan Xie

The boom of DL technology leads to massive DL models built and shared, which facilitates the acquisition and reuse of DL models. For a given task, we encounter multiple DL models available with the same functionality, which are considered…

Software Engineering · Computer Science 2021-03-10 Linghan Meng , Yanhui Li , Lin Chen , Zhi Wang , Di Wu , Yuming Zhou , Baowen Xu

Decisions made by machine learning systems have increasing influence on the world, yet it is common for machine learning algorithms to assume that no such influence exists. An example is the use of the i.i.d. assumption in content…

Machine Learning · Computer Science 2020-09-22 David Krueger , Tegan Maharaj , Jan Leike

Cyber-physical systems (CPS) greatly benefit by using machine learning components that can handle the uncertainty and variability of the real-world. Typical components such as deep neural networks, however, introduce new types of hazards…

Machine Learning · Computer Science 2020-01-29 Feiyang Cai , Xenofon Koutsoukos

We categorize meta-learning evaluation into two settings: $\textit{in-distribution}$ [ID], in which the train and test tasks are sampled $\textit{iid}$ from the same underlying task distribution, and $\textit{out-of-distribution}$ [OOD], in…

Machine Learning · Computer Science 2021-10-29 Amrith Setlur , Oscar Li , Virginia Smith

Distance metric learning (DML) approaches learn a transformation to a representation space where distance is in correspondence with a predefined notion of similarity. While such models offer a number of compelling benefits, it has been…

Machine Learning · Statistics 2016-03-03 Oren Rippel , Manohar Paluri , Piotr Dollar , Lubomir Bourdev

Clouds play a key role in regulating climate change but are difficult to simulate within Earth system models (ESMs). Improving the representation of clouds is one of the key tasks towards more robust climate change projections. This study…

Atmospheric and Oceanic Physics · Physics 2024-10-28 A. Kaps , A. Lauer , G. Camps-Valls , P. Gentine , L. Gómez-Chova , V. Eyring

Laboratory experiments and theoretical modelling are conducted to determine the raindrop size distribution (DSD) resulting from distinct fragmentation processes under various upward airstreams. Since weather radar echoes are proportional to…

Materials property prediction models are usually evaluated using random splitting of datasets into training and test datasets, which not only leads to over-estimated performance due to inherent redundancy, typically existent in material…

Materials Science · Physics 2024-05-28 Jeffrey Hu , David Liu , Nihang Fu , Rongzhi Dong

Domain adaptation algorithms are useful when the distributions of the training and the test data are different. In this paper, we focus on the problem of instrumental variation and time-varying drift in the field of sensors and measurement,…

Computer Vision and Pattern Recognition · Computer Science 2017-06-23 Ke Yan , Lu Kou , David Zhang

Background: Machine learning (ML) methods often fail with data that deviates from their training distribution. This is a significant concern for ML-enabled devices in clinical settings, where data drift may cause unexpected performance that…

Artificial Intelligence · Computer Science 2024-02-14 Ghada Zamzmi , Kesavan Venkatesh , Brandon Nelson , Smriti Prathapan , Paul H. Yi , Berkman Sahiner , Jana G. Delfino

Online updating of time series forecasting models aims to tackle the challenge of concept drifting by adjusting forecasting models based on streaming data. While numerous algorithms have been developed, most of them focus on model design…

Machine Learning · Computer Science 2024-03-25 YiFan Zhang , Weiqi Chen , Zhaoyang Zhu , Dalin Qin , Liang Sun , Xue Wang , Qingsong Wen , Zhang Zhang , Liang Wang , Rong Jin

The generation of initial conditions via accurate data assimilation is crucial for weather forecasting and climate modeling. We propose DiffDA as a denoising diffusion model capable of assimilating atmospheric variables using predicted…

Computational Engineering, Finance, and Science · Computer Science 2024-06-11 Langwen Huang , Lukas Gianinazzi , Yuejiang Yu , Peter D. Dueben , Torsten Hoefler

The utility of aerial imagery (Satellite, Drones) has become an invaluable information source for cross-disciplinary applications, especially for crisis management. Most of the mapping and tracking efforts are manual which is…

Computer Vision and Pattern Recognition · Computer Science 2020-04-28 Ruchit Rawal , Prabhu Pradhan

We study the problem of out-of-distribution dynamics (OODD) detection, which involves detecting when the dynamics of a temporal process change compared to the training-distribution dynamics. This is relevant to applications in control,…

Machine Learning · Computer Science 2022-05-25 Mohamad H Danesh , Alan Fern

Recent remarkable success in the deep-learning industries has unprecedentedly increased the need for reliable model deployment. For example, the model should alert the user if the produced model outputs might not be reliable. Previous…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Dasol Choi , Dongbin Na

Out-of-distribution (OOD) detection methods perform well on multi-domain benchmarks, yet many practical systems are trained on single-domain data. We show that this regime induces a geometric failure mode, Domain-Sensitivity Collapse (DSC):…

Machine Learning · Computer Science 2026-03-13 Hong Yang , Devroop Kar , Qi Yu , Travis Desell , Alex Ororbia

Predictive uncertainty estimation is essential for safe deployment of Deep Neural Networks in real-world autonomous systems. However, disentangling the different types and sources of uncertainty is non trivial for most datasets, especially…

Computer Vision and Pattern Recognition · Computer Science 2022-10-10 Gianni Franchi , Xuanlong Yu , Andrei Bursuc , Angel Tena , Rémi Kazmierczak , Séverine Dubuisson , Emanuel Aldea , David Filliat