English
Related papers

Related papers: Unlocking Out-of-Distribution Generalization in Dy…

200 papers

A comprehensive understanding of heat transport is essential for optimizing various mechanical and engineering applications, including 3D printing. Recent advances in machine learning, combined with physics-based models, have enabled a…

Machine Learning · Computer Science 2026-03-17 Benjamin Uhrich , Tim Häntschel , Erhard Rahm

Non-Gaussian spatial and spatio-temporal data are becoming increasingly prevalent, and their analysis is needed in a variety of disciplines. FRK is an R package for spatial/spatio-temporal modelling and prediction with very large data sets…

Computation · Statistics 2022-11-22 Matthew Sainsbury-Dale , Andrew Zammit-Mangion , Noel Cressie

We present a data-driven framework for reachability analysis of nonlinear dynamical systems that requires no explicit model. A denoising diffusion probabilistic model learns the time-evolving state distribution of a dynamical system from…

Systems and Control · Electrical Eng. & Systems 2026-04-02 Yanliang Huang , Peng Xie , Wenyuan Wu , Zhuoqi Zeng , Amr Alanwar

Cyber-physical systems (CPS) greatly benefit by using machine learning components that can handle the uncertainty and variability of the real-world. Typical components such as deep neural networks, however, introduce new types of hazards…

Machine Learning · Computer Science 2020-01-29 Feiyang Cai , Xenofon Koutsoukos

Deep neural networks have enabled improved image quality and fast inference times for various inverse problems, including accelerated magnetic resonance imaging (MRI) reconstruction. However, such models require a large number of…

Image and Video Processing · Electrical Eng. & Systems 2022-06-20 Arjun D Desai , Beliz Gunel , Batu M Ozturkler , Harris Beg , Shreyas Vasanawala , Brian A Hargreaves , Christopher Ré , John M Pauly , Akshay S Chaudhari

Data augmentation is a popular pre-processing trick to improve generalization accuracy. It is believed that by processing augmented inputs in tandem with the original ones, the model learns a more robust set of features which are shared…

Machine Learning · Computer Science 2020-07-10 Vihari Piratla , Shiv Shankar

Many data-driven modules in smart grid rely on access to high-quality power flow data; however, real-world data are often limited due to privacy and operational constraints. This paper presents a physics-informed generative framework based…

Machine Learning · Computer Science 2025-04-25 Junfei Wang , Darshana Upadhyay , Marzia Zaman , Pirathayini Srikantha

With the recent wave of digitalization, specifically in the context of safety-critical applications, there has been a growing need for computationally efficient, accurate, generalizable, and trustworthy models. Physics-based models have…

Numerical Analysis · Mathematics 2023-09-20 Sondre Sørbø , Sindre Stenen Blakseth , Adil Rasheed , Trond Kvamsdal , Omer San

Gradient clipping is widely used to stabilize deep network training, but its formulation as a hard, fixed threshold limits flexibility and ignores gradient distribution dynamics. We propose SPAMP (Statistical Per-layer Adaptive Modulation…

Machine Learning · Computer Science 2025-10-03 Haochen You , Baojing Liu

Offline reinforcement learning learns from a static dataset without interacting with environments, which ensures security and thus owns a good application prospect. However, directly applying naive reinforcement learning algorithm usually…

Machine Learning · Computer Science 2024-11-08 Yi Shen , Hanyan Huang

Deep learning-based trajectory prediction models for autonomous driving often struggle with generalization to out-of-distribution (OOD) scenarios, sometimes performing worse than simple rule-based models. To address this limitation, we…

Robotics · Computer Science 2024-12-23 Jinning Li , Jiachen Li , Sangjae Bae , David Isele

In some scenarios, classifier requires detecting out-of-distribution samples far from its training data. With desirable characteristics, reconstruction autoencoder-based methods deal with this problem by using input reconstruction error as…

Computer Vision and Pattern Recognition · Computer Science 2023-03-30 Yibo Zhou

A distribution system can flexibly adjust its substation-level power output by aggregating its local distributed energy resources (DERs). Due to DER and network constraints, characterizing the exact feasible power output region is…

Optimization and Control · Mathematics 2023-10-10 Qi Li , Jianzhe Liu , Bai Cui , Wenzhan Song , Jin Ye

In control design most control strategies are model-based and require accurate models to be applied successfully. Due to simplifications and the model-reality-gap physics-derived models frequently exhibit deviations from real-world-systems.…

Optimization and Control · Mathematics 2022-08-09 Ricarda-Samantha Götte , Julia Timmermann

A major bottleneck in the real-world applications of machine learning models is their failure in generalizing to unseen domains whose data distribution is not i.i.d to the training domains. This failure often stems from learning…

Machine Learning · Computer Science 2021-09-28 Soroosh Shahtalebi , Jean-Christophe Gagnon-Audet , Touraj Laleh , Mojtaba Faramarzi , Kartik Ahuja , Irina Rish

We present a general numerical approach to shape optimization with state constraints for 2-dimensional geometries, without relaxing the constraints. To do this we reformulate the problem on a fixed reference domain using a conformal…

Optimization and Control · Mathematics 2014-12-16 Christian Leithäuser , René Pinnau , Robert Feßler

Spatiotemporal neural networks have shown great promise in urban scenarios by effectively capturing temporal and spatial correlations. However, urban environments are constantly evolving, and current model evaluations are often limited to…

Machine Learning · Computer Science 2024-10-10 Hongjun Wang , Jiyuan Chen , Tong Pan , Zheng Dong , Lingyu Zhang , Renhe Jiang , Xuan Song

A number of problems in relational Artificial Intelligence can be viewed as Stochastic Constraint Optimization Problems (SCOPs). These are constraint optimization problems that involve objectives or constraints with a stochastic component.…

Artificial Intelligence · Computer Science 2018-07-04 Anna L. D. Latour , Behrouz Babaki , Siegfried Nijssen

A fundamental challenge for machine learning models is generalizing to out-of-distribution (OOD) data, in part due to spurious correlations. To tackle this challenge, we first formalize the OOD generalization problem as constrained…

Machine Learning · Computer Science 2022-10-20 Hanlin Zhang , Yi-Fan Zhang , Weiyang Liu , Adrian Weller , Bernhard Schölkopf , Eric P. Xing

Out-of-distribution (OOD) learning often relies heavily on statistical approaches or predefined assumptions about OOD data distributions, hindering their efficacy in addressing multifaceted challenges of OOD generalization and OOD detection…

Machine Learning · Computer Science 2024-08-16 Haoyue Bai , Xuefeng Du , Katie Rainey , Shibin Parameswaran , Yixuan Li