English
Related papers

Related papers: Analyzing Deviations from Monotonic Trends through…

200 papers

Out-of-Distribution (OOD) generalization, a cornerstone for building robust machine learning models capable of handling data diverging from the training set's distribution, is an ongoing challenge in deep learning. While significant…

Machine Learning · Computer Science 2023-12-05 Sergey Kolesnikov

This paper presents a novel evaluation framework for Out-of-Distribution (OOD) detection that aims to assess the performance of machine learning models in more realistic settings. We observed that the real-world requirements for testing OOD…

Computer Vision and Pattern Recognition · Computer Science 2023-09-01 Vahid Reza Khazaie , Anthony Wong , Mohammad Sabokrou

Small datasets are common in health research. However, the generalization performance of machine learning models is suboptimal when the training datasets are small. To address this, data augmentation is one solution. Augmentation increases…

Order dependencies (ODs) capture relationships between ordered domains of attributes. Approximate ODs (AODs) capture such relationships even when there exist exceptions in the data. During automated discovery of ODs, validation is the…

Databases · Computer Science 2021-01-07 Reza Karegar , Parke Godfrey , Lukasz Golab , Mehdi Kargar , Divesh Srivastava , Jaroslaw Szlichta

We propose a data aggregation-based algorithm with monotonic convergence to a global optimum for a generalized version of the L1-norm error fitting model with an assumption of the fitting function. The proposed algorithm generalizes the…

Machine Learning · Statistics 2021-04-15 Young Woong Park

Out-of-distribution (OOD) detection discerns OOD data where the predictor cannot make valid predictions as in-distribution (ID) data, thereby increasing the reliability of open-world classification. However, it is typically hard to collect…

Machine Learning · Computer Science 2023-12-06 Haotian Zheng , Qizhou Wang , Zhen Fang , Xiaobo Xia , Feng Liu , Tongliang Liu , Bo Han

We study the problem of Out-of-Distribution (OOD) detection, that is, detecting whether a learning algorithm's output can be trusted at inference time. While a number of tests for OOD detection have been proposed in prior work, a formal…

Machine Learning · Statistics 2023-09-19 Akshayaa Magesh , Venugopal V. Veeravalli , Anirban Roy , Susmit Jha

Accessing machine learning models through remote APIs has been gaining prevalence following the recent trend of scaling up model parameters for increased performance. Even though these models exhibit remarkable ability, detecting…

Machine Learning · Computer Science 2024-08-20 Heeyoung Lee , Hoyoon Byun , Changdae Oh , JinYeong Bak , Kyungwoo Song

Machine learning algorithms often encounter different or "out-of-distribution" (OOD) data at deployment time, and OOD detection is frequently employed to detect these examples. While it works reasonably well in practice, existing…

Machine Learning · Computer Science 2025-01-16 Konstantin Garov , Kamalika Chaudhuri

Datasets may include errors, and specifically violations of integrity constraints, for various reasons. Standard techniques for ``minimal-cost'' database repairing resolve these violations by aiming for minimum change in the data, and in…

Databases · Computer Science 2024-10-23 Yuxi Liu , Fangzhu Shen , Kushagra Ghosh , Amir Gilad , Benny Kimelfeld , Sudeepa Roy

Labeled data is a fundamental component in training supervised deep learning models for computer vision tasks. However, the labeling process, especially for ordinal image classification where class boundaries are often ambiguous, is prone…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Alireza Sedighi Moghaddam , Mohammad Reza Mohammadi

We propose an algorithm for detecting patterns exhibited by anomalous clusters in high dimensional discrete data. Unlike most anomaly detection (AD) methods, which detect individual anomalies, our proposed method detects groups (clusters)…

Machine Learning · Statistics 2016-05-23 Hossein Soleimani , David J. Miller

Various approaches have been proposed for out-of-distribution (OOD) detection by augmenting models, input examples, training sets, and optimization objectives. Deviating from existing work, we have a simple hypothesis that standard…

Machine Learning · Computer Science 2022-03-29 Xin Dong , Junfeng Guo , Ang Li , Wei-Te Ting , Cong Liu , H. T. Kung

Out-of-distribution (OOD) detection is vital to safety-critical machine learning applications and has thus been extensively studied, with a plethora of methods developed in the literature. However, the field currently lacks a unified,…

Computer Vision and Pattern Recognition · Computer Science 2022-10-14 Jingkang Yang , Pengyun Wang , Dejian Zou , Zitang Zhou , Kunyuan Ding , Wenxuan Peng , Haoqi Wang , Guangyao Chen , Bo Li , Yiyou Sun , Xuefeng Du , Kaiyang Zhou , Wayne Zhang , Dan Hendrycks , Yixuan Li , Ziwei Liu

Stochastic clearing theory has wide spread applications in the context of supply chain and service operations management. Historical application domains include bulk service queues, inventory control, and transportation planning (e.g.,…

Optimization and Control · Mathematics 2020-06-19 Bo Wei , Sila Cetinkaya , Daren B. H. Cline

Data assimilation refers to the problem of finding trajectories of a prescribed dynamical model in such a way that the output of the model (usually some function of the model states) follows a given time series of observations. Typically…

Atmospheric and Oceanic Physics · Physics 2015-05-30 Jochen Bröcker , Ivan G. Szendro

Machines of all kinds from vehicles to industrial equipment are increasingly instrumented with hundreds of sensors. Using such data to detect anomalous behaviour is critical for safety and efficient maintenance. However, anomalies occur…

Artificial Intelligence · Computer Science 2016-05-06 Mohit Yadav , Pankaj Malhotra , Lovekesh Vig , K Sriram , Gautam Shroff

Out-of-distribution (OOD) detection is essential for deploying machine learning models in open-world and safety-critical scenarios, where test inputs may deviate from the training distribution and overconfident predictions on unknown…

Machine Learning · Computer Science 2026-05-28 Fengqiang Wan , Qing-Yuan Jiang , Yang Yang

Functional dependencies (FDs) are basic constraints in relational databases and are used for many data management tasks. Most FD discovery algorithms find all valid dependencies, but this causes two problems. First, the computational cost…

Databases · Computer Science 2026-01-16 Xiaolong Wan , Xixian Han

Detecting out-of-distribution (OOD) samples is crucial to the safe deployment of a classifier in the real world. However, deep neural networks are known to be overconfident for abnormal data. Existing works directly design score function by…

Computer Vision and Pattern Recognition · Computer Science 2023-01-06 Wenyu Jiang , Yuxin Ge , Hao Cheng , Mingcai Chen , Shuai Feng , Chongjun Wang