English
Related papers

Related papers: Structure-Adaptive Conformal Inference for Large-S…

200 papers

We propose an importance sampling method for tractable and efficient estimation of counterfactual expressions in general settings, named Exogenous Matching. By minimizing a common upper bound of counterfactual estimators, we transform the…

Machine Learning · Computer Science 2025-02-14 Yikang Chen , Dehui Du , Lili Tian

Out-of-distribution (OOD) detection is a task that detects OOD samples during inference to ensure the safety of deployed models. However, conventional benchmarks have reached performance saturation, making it difficult to compare recent OOD…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Shiho Noda , Atsuyuki Miyai , Qing Yu , Go Irie , Kiyoharu Aizawa

Deep learning models are challenged by the distribution shift between the training data and test data. Recently, the large models pre-trained on diverse data have demonstrated unprecedented robustness to various distribution shifts.…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Yao Xiao , Ziyi Tang , Pengxu Wei , Cong Liu , Liang Lin

Distribution shifts between training and testing datasets significantly impair the model performance on graph learning. A commonly-taken causal view in graph invariant learning suggests that stable predictive features of graphs are causally…

Machine Learning · Computer Science 2025-12-10 Bohan Wang , Yurui Chang , Wei Jin , Lu Lin

Real-world deployment of computer vision systems, including in the discovery processes of biomedical research, requires causal representations that are invariant to contextual nuisances and generalize to new data. Leveraging the internal…

Computer Vision and Pattern Recognition · Computer Science 2023-06-22 Wolfgang M. Pernice , Michael Doron , Alex Quach , Aditya Pratapa , Sultan Kenjeyev , Nicholas De Veaux , Michio Hirano , Juan C. Caicedo

Despite their success, Machine Learning (ML) models do not generalize effectively to data not originating from the training distribution. To reliably employ ML models in real-world healthcare systems and avoid inaccurate predictions on…

Machine Learning · Computer Science 2023-09-29 Mohammad Azizmalayeri , Ameen Abu-Hanna , Giovanni Ciná

Stochastic nonlinear dynamical systems can undergo rapid transitions relative to the change in their forcing, for example due to the occurrence of multiple equilibrium solutions for a specific interval of parameters. In this paper, we…

Data Analysis, Statistics and Probability · Physics 2020-11-12 S. Baars , D. Castellana , F. W. Wubs , H. A. Dijkstra

Advancements in synthesized speech have created a growing threat of impersonation, making it crucial to develop deepfake algorithm recognition. One significant aspect is out-of-distribution (OOD) detection, which has gained notable…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-05 Renmingyue Du , Jixun Yao , Qiuqiang Kong , Yin Cao

Recognizing out-of-distribution (OOD) samples is critical for machine learning systems deployed in the open world. The vast majority of OOD detection methods are driven by a single modality (e.g., either vision or language), leaving the…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Yifei Ming , Ziyang Cai , Jiuxiang Gu , Yiyou Sun , Wei Li , Yixuan Li

A majority of recent work in AI assesses models' generalization capabilities through the lens of performance on out-of-distribution (OOD) datasets. Despite their practicality, such evaluations build upon a strong assumption: that OOD…

Computation and Language · Computer Science 2025-08-27 Michal Štefánik , Timothee Mickus , Marek Kadlčík , Michal Spiegel , Josef Kuchař

Machine learning models, while progressively advanced, rely heavily on the IID assumption, which is often unfulfilled in practice due to inevitable distribution shifts. This renders them susceptible and untrustworthy for deployment in…

Machine Learning · Computer Science 2024-03-05 Han Yu , Jiashuo Liu , Xingxuan Zhang , Jiayun Wu , Peng Cui

Machine learning algorithms typically assume independent and identically distributed samples in training and at test time. Much work has shown that high-performing ML classifiers can degrade significantly and provide overly-confident, wrong…

Computation and Language · Computer Science 2023-03-09 Jie Ren , Jiaming Luo , Yao Zhao , Kundan Krishna , Mohammad Saleh , Balaji Lakshminarayanan , Peter J. Liu

A split questionnaire design (SQD), an alternative to full questionnaires, can reduce the response burden and improve survey quality. One can design a split questionnaire to reduce the information loss from missing data induced by the split…

Methodology · Statistics 2022-03-10 Dae-Gyu Jang , Zhengyuan Zhu , Cindy Yu

Previous OOD detection systems only focus on the semantic gap between ID and OOD samples. Besides the semantic gap, we are faced with two additional gaps: the domain gap between source and target domains, and the class-imbalance gap between…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Xiang Fang , Arvind Easwaran , Blaise Genest , Ponnuthurai Nagaratnam Suganthan

Machine Learning (ML) models are trained on in-distribution (ID) data but often encounter out-of-distribution (OOD) inputs during deployment -- posing serious risks in safety-critical domains. Recent works have focused on designing scoring…

Machine Learning · Computer Science 2025-05-06 Daisuke Yamada , Harit Vishwakarma , Ramya Korlakai Vinayak

We present a new methodology for detecting out-of-distribution (OOD) images by utilizing norms of the score estimates at multiple noise scales. A score is defined to be the gradient of the log density with respect to the input data. Our…

Machine Learning · Computer Science 2021-03-24 Ahsan Mahmood , Junier Oliva , Martin Styner

In real world scenarios, out-of-distribution (OOD) datasets may have a large distributional shift from training datasets. This phenomena generally occurs when a trained classifier is deployed on varying dynamic environments, which causes a…

Image and Video Processing · Electrical Eng. & Systems 2022-09-08 Harshita Boonlia , Tanmoy Dam , Md Meftahul Ferdaus , Sreenatha G. Anavatti , Ankan Mullick

Test-time adaptation (TTA) refers to adjusting the model during the testing phase to cope with changes in sample distribution and enhance the model's adaptability to new environments. In real-world scenarios, models often encounter samples…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Ziqiong Liu , Yushun Tang , Junyang Ji , Zhihai He

Methods which utilize the outputs or feature representations of predictive models have emerged as promising approaches for out-of-distribution (OOD) detection of image inputs. However, these methods struggle to detect OOD inputs that share…

Machine Learning · Computer Science 2023-02-09 Lily H. Zhang , Rajesh Ranganath

Discovery of high-performance materials and molecules requires identifying extremes with property values that fall outside the known distribution. Therefore, the ability to extrapolate to out-of-distribution (OOD) property values is…

Machine Learning · Computer Science 2025-02-11 Nofit Segal , Aviv Netanyahu , Kevin P. Greenman , Pulkit Agrawal , Rafael Gomez-Bombarelli