English
Related papers

Related papers: Unlocking Out-of-Distribution Generalization in Dy…

200 papers

Automated 3D scene generation is pivotal for applications spanning virtual reality, digital content creation, and Embodied AI. While computer graphics prioritizes aesthetic layouts, vision and robotics demand scenes that mirror real-world…

Graphics · Computer Science 2026-03-31 Minzhang Li , Kuixiang Shao , Xuebing Li , Yuyang Jiao , Yinuo Bai , Hengan Zhou , Sixian Shen , Jiayuan Gu , Jingyi Yu

Graphs play a central role in modeling complex relationships in data, yet most graph learning methods falter when faced with cold-start nodes--new nodes lacking initial connections--due to their reliance on adjacency information. To tackle…

Machine Learning · Computer Science 2025-02-19 Yahel Jacobs , Reut Dayan , Uri Shaham

The large penetration of renewable resources has resulted in rapidly changing net loads, resulting in the characteristic "duck curve". The resulting ramping requirements of bulk system resources is an operational challenge. To address this,…

Optimization and Control · Mathematics 2022-02-03 Rabab Haider , Giulio Ferro , Michela Robba , Anuradha M. Annaswamy

High-fidelity full-field micro-mechanical modeling of the non-linear path-dependent materials demands a substantial computational effort. Recent trends in the field incorporates data-driven Artificial Neural Networks (ANNs) as surrogate…

Materials Science · Physics 2023-11-27 Hon Lam Cheung , Petter Uvdal , Mohsen Mirkhalaf

Modern foundation models exhibit remarkable out-of-distribution (OOD) generalization, solving tasks far beyond the support of their training data. However, the theoretical principles underpinning this phenomenon remain elusive. This paper…

Machine Learning · Statistics 2025-05-29 Jiawei Ge , Amanda Wang , Shange Tang , Chi Jin

The precise knowledge regarding the state of the power grid is important in order to ensure optimal and reliable grid operation. Specifically, knowing the state of the distribution grid becomes increasingly important as more renewable…

Systems and Control · Electrical Eng. & Systems 2020-02-18 Jonatan Ostrometzky , Konstantin Berestizshevsky , Andrey Bernstein , Gil Zussman

Data augmentation has been widely employed to improve the generalization of deep neural networks. Most existing methods apply fixed or random transformations. However, we find that sample difficulty evolves along with the model's…

Machine Learning · Computer Science 2025-10-02 Suorong Yang , Jie Zong , Lihang Wang , Ziheng Qin , Hai Gan , Pengfei Zhou , Kai Wang , Yang You , Furao Shen

Generalization to out-of-distribution (OOD) data is a capability natural to humans yet challenging for machines to reproduce. This is because most learning algorithms strongly rely on the i.i.d.~assumption on source/target data, which is…

Machine Learning · Computer Science 2022-08-15 Kaiyang Zhou , Ziwei Liu , Yu Qiao , Tao Xiang , Chen Change Loy

Stochastic model-predictive control (SMPC) has evolved to a powerful framework for the control of stochastic dynamical systems. SMPC utilizes a probabilistic uncertainty description to provide a systematic trade-off between the control…

Systems and Control · Electrical Eng. & Systems 2026-05-27 Bendegúz Györök , Roland Tóth , Maarten Schoukens , Tamás Péni

Detecting out-of-distribution (OOD) graphs is crucial for ensuring the safety and reliability of Graph Neural Networks. In unsupervised graph-level OOD detection, models are typically trained using only in-distribution (ID) data, resulting…

Machine Learning · Computer Science 2026-03-03 Li Sun , Lanxu Yang , Jiayu Tian , Bowen Fang , Xiaoyan Yu , Junda Ye , Peng Tang , Hao Peng , Philip S. Yu

Modeling the precise dynamics of off-road vehicles is a complex yet essential task due to the challenging terrain they encounter and the need for optimal performance and safety. Recently, there has been a focus on integrating nominal…

In recent years, computational power and data availability breakthroughs have revolutionized our ability to analyze complex physical systems through the inverse problem approach. Data-driven techniques like system identification and machine…

Systems and Control · Electrical Eng. & Systems 2026-05-04 Sriram Narayanan , Mohamed Naveed Gul Mohamed , Ishan Paranjape , Indranil Nayak , Suman Chakravorty , Mrinal Kumar

Graph Out-of-Distribution (OOD), requiring that models trained on biased data generalize to the unseen test data, has a massive of real-world applications. One of the most mainstream methods is to extract the invariant subgraph by aligning…

Machine Learning · Computer Science 2024-02-15 Xuexin Chen , Ruichu Cai , Kaitao Zheng , Zhifan Jiang , Zhengting Huang , Zhifeng Hao , Zijian Li

Distributionally robust optimization (DRO) and invariant risk minimization (IRM) are two popular methods proposed to improve out-of-distribution (OOD) generalization performance of machine learning models. While effective for small models,…

Machine Learning · Computer Science 2023-01-25 Xiao Zhou , Yong Lin , Renjie Pi , Weizhong Zhang , Renzhe Xu , Peng Cui , Tong Zhang

Physics-Informed Neural Networks (PINNs) provide a mesh-free approach for solving differential equations by embedding physical constraints into neural network training. However, PINNs tend to overfit within the training domain, leading to…

Machine Learning · Computer Science 2026-03-17 Jose Marie Antonio Miñoza

We propose a simple yet novel data augmentation method for general data modalities based on energy-based modeling and principles from information geometry. Unlike most existing learning-based data augmentation methods, which rely on…

Machine Learning · Computer Science 2026-01-28 Pingbang Hu , Mahito Sugiyama

Tabular data is critical across diverse domains, yet high-quality datasets remain scarce due to privacy concerns and the cost of collection. Contemporary approaches adopt large language models (LLMs) for tabular augmentation, but exhibit…

Machine Learning · Computer Science 2025-07-28 Shuo Yang , Zheyu Zhang , Bardh Prenkaj , Gjergji Kasneci

Partial differential equations (PDEs) serve as the cornerstone of mathematical physics. In recent years, Physics-Informed Neural Networks (PINNs) have significantly reduced the dependence on large datasets by embedding physical laws…

Machine Learning · Computer Science 2025-06-09 Wenxuan Huo , Qiang He , Gang Zhu , Weifeng Huang

Text-to-image generation powered by Diffusion Transformers (DiTs) has made remarkable strides, yet remote sensing (RS) synthesis lags behind due to two barriers: the absence of a domain-specialized DiT prior and the prohibitive cost of…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Bingxuan Zhao , Qing Zhou , Chuang Yang , Qi Wang

Physics-Informed Neural Networks (PINNs) have recently shown great promise as a way of incorporating physics-based domain knowledge, including fundamental governing equations, into neural network models for many complex engineering systems.…

Machine Learning · Computer Science 2021-05-06 Jian Cheng Wong , Chinchun Ooi , Pao-Hsiung Chiu , My Ha Dao