English
Related papers

Related papers: X-GGM: Graph Generative Modeling for Out-of-Distri…

200 papers

We study the problem of lifelong graph learning in an open-world scenario, where a model needs to deal with new tasks and potentially unknown classes. We utilize Out-of-Distribution (OOD) detection methods to recognize new classes and adapt…

Machine Learning · Computer Science 2023-10-20 Marcel Hoffmann , Lukas Galke , Ansgar Scherp

Inferring objects and their relationships from an image in the form of a scene graph is useful in many applications at the intersection of vision and language. We consider a challenging problem of compositional generalization that emerges…

Computer Vision and Pattern Recognition · Computer Science 2021-10-04 Boris Knyazev , Harm de Vries , Cătălina Cangea , Graham W. Taylor , Aaron Courville , Eugene Belilovsky

Learning on molecule graphs has become an increasingly important topic in AI for science, which takes full advantage of AI to facilitate scientific discovery. Existing solutions on modeling molecules utilize Graph Neural Networks (GNNs) to…

Machine Learning · Computer Science 2025-05-13 Limin Li , Kuo Yang , Wenjie Du , Pengkun Wang , Zhengyang Zhou , Yang Wang

Conventional supervised learning methods, especially deep ones, are found to be sensitive to out-of-distribution (OOD) examples, largely because the learned representation mixes the semantic factor with the variation factor due to their…

Machine Learning · Statistics 2021-11-02 Chang Liu , Xinwei Sun , Jindong Wang , Haoyue Tang , Tao Li , Tao Qin , Wei Chen , Tie-Yan Liu

Out-of-distribution (OOD) generalization is a favorable yet challenging property for deep neural networks. The core challenges lie in the limited availability of source domains that help models learn an invariant representation from the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Yijiang Li , Sucheng Ren , Weipeng Deng , Yuzhi Xu , Ying Gao , Edith Ngai , Haohan Wang

In this paper, we study the OOD generalization of neural algorithmic reasoning tasks, where the goal is to learn an algorithm (e.g., sorting, breadth-first search, and depth-first search) from input-output pairs using deep neural networks.…

Machine Learning · Computer Science 2023-03-21 Sadegh Mahdavi , Kevin Swersky , Thomas Kipf , Milad Hashemi , Christos Thrampoulidis , Renjie Liao

Deep generative models have been demonstrated as problematic in the unsupervised out-of-distribution (OOD) detection task, where they tend to assign higher likelihoods to OOD samples. Previous studies on this issue are usually not…

Machine Learning · Computer Science 2024-01-04 Zezhen Zeng , Bin Liu

Zero-shot out-of-distribution (OOD) detection is a task that detects OOD images during inference with only in-distribution (ID) class names. Existing methods assume ID images contain a single, centered object, and do not consider the more…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Atsuyuki Miyai , Qing Yu , Go Irie , Kiyoharu Aizawa

Retrieval-augmented generation (RAG) with large language models (LLMs) plays a crucial role in question answering, as LLMs possess limited knowledge and are not updated with continuously growing information. Most recent work on RAG has…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Shichao Kan , Yuhai Deng , Jiale Fu , Lihui Cen , Zhe Qu , Linna Zhang , Yixiong Liang , Yigang Cen

Machine learning (ML) systems in natural language processing (NLP) face significant challenges in generalizing to out-of-distribution (OOD) data, where the test distribution differs from the training data distribution. This poses important…

Computation and Language · Computer Science 2023-05-24 Linyi Yang , Yaoxiao Song , Xuan Ren , Chenyang Lyu , Yidong Wang , Lingqiao Liu , Jindong Wang , Jennifer Foster , Yue Zhang

Unsupervised Out-of-Distribution (OOD) detection consists in identifying anomalous regions in images leveraging only models trained on images of healthy anatomy. An established approach is to tokenize images and model the distribution of…

Computer Vision and Pattern Recognition · Computer Science 2023-08-04 Sergio Naval Marimont , Vasilis Siomos , Giacomo Tarroni

Without loss of generality, existing machine learning techniques may learn spurious correlation dependent on the domain, which exacerbates the generalization of models in out-of-distribution (OOD) scenarios. To address this issue, recent…

Machine Learning · Computer Science 2024-06-18 Bin Qin , Jiangmeng Li , Yi Li , Xuesong Wu , Yupeng Wang , Wenwen Qiang , Jianwen Cao

Machine learning models struggle with generalization when encountering out-of-distribution (OOD) samples with unexpected distribution shifts. For vision tasks, recent studies have shown that test-time adaptation employing diffusion models…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Yun-Yun Tsai , Fu-Chen Chen , Albert Y. C. Chen , Junfeng Yang , Che-Chun Su , Min Sun , Cheng-Hao Kuo

With the progressive advancements in deep graph learning, out-of-distribution (OOD) detection for graph data has emerged as a critical challenge. While the efficacy of auxiliary datasets in enhancing OOD detection has been extensively…

Machine Learning · Computer Science 2024-08-01 Junwei He , Qianqian Xu , Yangbangyan Jiang , Zitai Wang , Yuchen Sun , Qingming Huang

Detecting an Out-of-Domain (OOD) utterance is crucial for a robust dialog system. Most dialog systems are trained on a pool of annotated OOD data to achieve this goal. However, collecting the annotated OOD data for a given domain is an…

Computation and Language · Computer Science 2021-04-07 Petr Marek , Vishal Ishwar Naik , Vincent Auvray , Anuj Goyal

Despite multiple efforts made towards robust machine learning (ML) models, their vulnerability to adversarial examples remains a challenging problem that calls for rethinking the defense strategy. In this paper, we take a step back and…

Machine Learning · Computer Science 2022-02-21 Abderrahmen Amich , Birhanu Eshete

In many cases, neural network classifiers are likely to be exposed to input data that is outside of their training distribution data. Samples from outside the distribution may be classified as an existing class with high probability by…

Machine Learning · Computer Science 2020-03-24 Guy Amit , Ishai Rosenberg , Moshe Levy , Ron Bitton , Asaf Shabtai , Yuval Elovici

Prediction models often fail if train and test data do not stem from the same distribution. Out-of-distribution (OOD) generalization to unseen, perturbed test data is a desirable but difficult-to-achieve property for prediction models and…

Methodology · Statistics 2022-05-25 Lucas Kook , Beate Sick , Peter Bühlmann

Large language models (LLMs) have achieved remarkable proficiency on solving diverse problems. However, their generalization ability is not always satisfying and the generalization problem is common for generative transformer models in…

Machine Learning · Computer Science 2024-08-20 Xingcheng Xu , Zihao Pan , Haipeng Zhang , Yanqing Yang

Recent advances in medical vision-language models (VLMs) demonstrate impressive performance in image classification tasks, driven by their strong zero-shot generalization capabilities. However, given the high variability and complexity…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Lie Ju , Sijin Zhou , Yukun Zhou , Huimin Lu , Zhuoting Zhu , Pearse A. Keane , Zongyuan Ge