English
Related papers

Related papers: Time-Series Forecasting for Out-of-Distribution Ge…

200 papers

Out-of-distribution (OOD) generalisation is challenging because it involves not only learning from empirical data, but also deciding among various notions of generalisation, e.g., optimising the average-case risk, worst-case risk, or…

Machine Learning · Computer Science 2024-05-31 Anurag Singh , Siu Lun Chau , Shahine Bouabid , Krikamol Muandet

While current generative models have achieved promising performances in time-series synthesis, they either make strong assumptions on the data format (e.g., regularities) or rely on pre-processing approaches (e.g., interpolations) to…

Machine Learning · Computer Science 2023-11-07 Yangming Li

Time-Series Forecasting based on Cumulative Data (TSFCD) is a crucial problem in decision-making across various industrial scenarios. However, existing time-series forecasting methods often overlook two important characteristics of…

Machine Learning · Computer Science 2023-09-26 Zhichao Chen , Leilei Ding , Zhixuan Chu , Yucheng Qi , Jianmin Huang , Hao Wang

Distribution shifts on graphs -- the data distribution discrepancies between training and testing a graph machine learning model, are often ubiquitous and unavoidable in real-world scenarios. Such shifts may severely deteriorate the…

Machine Learning · Computer Science 2024-02-20 Shuhan Liu , Kaize Ding

Machine learning models have made incredible progress, but they still struggle when applied to examples from unseen domains. This study focuses on a specific problem of domain generalization, where a model is trained on one source domain…

Computation and Language · Computer Science 2024-04-23 Tao Feng , Lizhen Qu , Zhuang Li , Haolan Zhan , Yuncheng Hua , Gholamreza Haffari

A widely recognized limitation of molecular prediction models is their reliance on structures observed in the training data, resulting in poor generalization to out-of-distribution compounds. Yet in drug discovery, the compounds most…

Machine Learning · Computer Science 2026-01-05 Jina Kim , Jeffrey Willette , Bruno Andreis , Sung Ju Hwang

The distribution shift in Time Series Forecasting (TSF), indicating series distribution changes over time, largely hinders the performance of TSF models. Existing works towards distribution shift in time series are mostly limited in the…

Machine Learning · Computer Science 2023-03-15 Wei Fan , Pengyang Wang , Dongkun Wang , Dongjie Wang , Yuanchun Zhou , Yanjie Fu

Molecular representation learning lays the foundation for drug discovery. However, existing methods suffer from poor out-of-distribution (OOD) generalization, particularly when data for training and testing originate from different…

Machine Learning · Computer Science 2023-10-24 Xiang Zhuang , Qiang Zhang , Keyan Ding , Yatao Bian , Xiao Wang , Jingsong Lv , Hongyang Chen , Huajun Chen

Out-of-distribution (OOD) generalization in the graph domain is challenging due to complex distribution shifts and a lack of environmental contexts. Recent methods attempt to enhance graph OOD generalization by generating flat environments.…

Machine Learning · Computer Science 2024-06-04 Yinhua Piao , Sangseon Lee , Yijingxiu Lu , Sun Kim

Out-of-distribution (OOD) detection identifies test samples that differ from the training data, which is critical to ensuring the safety and reliability of machine learning (ML) systems. While a plethora of methods have been developed to…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Viet Duong , Qiong Wu , Zhengyi Zhou , Eric Zavesky , Jiahe Chen , Xiangzhou Liu , Wen-Ling Hsu , Huajie Shao

The open-world assumption in model development suggests that a model might lack sufficient information to adequately handle data that is entirely distinct or out of distribution (OOD). While deep learning methods have shown promising…

Machine Learning · Computer Science 2025-05-21 Achmad Ginanjar , Xue Li , Priyanka Singh , Wen Hua

Prior research shows that differences in the early period of neural network training significantly impact the performance of in-distribution (ID) data of tasks. Yet, the implications of early learning dynamics on out-of-distribution (OOD)…

Machine Learning · Computer Science 2025-01-07 Chen Cecilia Liu , Iryna Gurevych

Learning on molecule graphs has become an increasingly important topic in AI for science, which takes full advantage of AI to facilitate scientific discovery. Existing solutions on modeling molecules utilize Graph Neural Networks (GNNs) to…

Machine Learning · Computer Science 2025-05-13 Limin Li , Kuo Yang , Wenjie Du , Pengkun Wang , Zhengyang Zhou , Yang Wang

Deep models often fail to generalize well in test domains when the data distribution differs from that in the training domain. Among numerous approaches to address this Out-of-Distribution (OOD) generalization problem, there has been a…

Machine Learning · Computer Science 2022-10-14 Qixun Wang , Yifei Wang , Hong Zhu , Yisen Wang

Process Model Forecasting (PMF) aims to predict how the control-flow structure of a process evolves over time by modeling the temporal dynamics of directly-follows (DF) relations, complementing predictive process monitoring that focuses on…

Machine Learning · Computer Science 2025-12-09 Yongbo Yu , Jari Peeperkorn , Johannes De Smedt , Jochen De Weerdt

Machine learning (ML) systems in natural language processing (NLP) face significant challenges in generalizing to out-of-distribution (OOD) data, where the test distribution differs from the training data distribution. This poses important…

Computation and Language · Computer Science 2023-05-24 Linyi Yang , Yaoxiao Song , Xuan Ren , Chenyang Lyu , Yidong Wang , Lingqiao Liu , Jindong Wang , Jennifer Foster , Yue Zhang

Diffusion models have emerged as powerful generative frameworks by progressively adding noise to data through a forward process and then reversing this process to generate realistic samples. While these models have achieved strong…

Machine Learning · Computer Science 2025-03-04 Xingzhuo Guo , Yu Zhang , Baixu Chen , Haoran Xu , Jianmin Wang , Mingsheng Long

Robustness to out-of-distribution (OOD) data is an important goal in building reliable machine learning systems. Especially in autonomous systems, wrong predictions for OOD inputs can cause safety critical situations. As a first step…

Machine Learning · Computer Science 2020-04-17 Andreas Sedlmeier , Thomas Gabor , Thomy Phan , Lenz Belzner , Claudia Linnhoff-Popien

Out-of-domain (OOD) generalization is a significant challenge for machine learning models. Many techniques have been proposed to overcome this challenge, often focused on learning models with certain invariance properties. In this work, we…

Machine Learning · Computer Science 2022-01-13 Yoav Wald , Amir Feder , Daniel Greenfeld , Uri Shalit

Modern deep learning techniques have illustrated their excellent capabilities in many areas, but relies on large training data. Optimization-based meta-learning train a model on a variety tasks, such that it can solve new learning tasks…

Machine Learning · Computer Science 2023-02-23 Penghao Jiang , Ke Xin , Zifeng Wang , Chunxi Li