English
Related papers

Related papers: Flow Equivariant World Models: Memory for Partiall…

200 papers

Embodied intelligence aims to enable robots to learn, reason, and generalize robustly across complex real-world environments. However, existing approaches often struggle with partial observability, fragmented spatial reasoning, and…

To track rapid changes within our water sector, Global Water Models (GWMs) need to realistically represent hydrologic systems' response patterns - such as baseflow fraction - but are hindered by their limited ability to learn from data.…

Quantum neural network architectures that have little-to-no inductive biases are known to face trainability and generalization issues. Inspired by a similar problem, recent breakthroughs in machine learning address this challenge by…

Flow matching models have emerged as a powerful framework for realistic image generation by learning to reverse a corruption process that progressively adds Gaussian noise. However, because noise is injected in the latent domain, its impact…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Sucheng Ren , Qihang Yu , Ju He , Xiaohui Shen , Alan Yuille , Liang-Chieh Chen

Humans perceive and interact with the world with the awareness of equivariance, facilitating us in manipulating different objects in diverse poses. For robotic manipulation, such equivariance also exists in many scenarios. For example, no…

Robotics · Computer Science 2024-08-08 Yue Chen , Chenrui Tie , Ruihai Wu , Hao Dong

Accurately modeling complex dynamic spatio-temporal systems requires capturing flow-mediated interdependencies and context-sensitive interaction dynamics. Existing methods, predominantly graph-based or attention-driven, rely on…

Machine Learning · Computer Science 2025-11-11 Yutong Feng , Xu Liu , Yutong Xia , Yuxuan Liang

For visual estimation of optical flow, a crucial function for many vision tasks, unsupervised learning, using the supervision of view synthesis has emerged as a promising alternative to supervised methods, since ground-truth flow is not…

Computer Vision and Pattern Recognition · Computer Science 2023-04-17 Zitang Sun , Shin'ya Nishida , Zhengbo Luo

Latent representations are used extensively for downstream tasks, such as visualization, interpolation or feature extraction of deep learning models. Invariant and equivariant neural networks are powerful and well-established models for…

Machine Learning · Computer Science 2025-01-16 Andreas Abildtrup Hansen , Anna Calissano , Aasa Feragen

While a general embodied agent must function as a unified system, current methods are built on isolated models for understanding, world modeling, and control. This fragmentation prevents unifying multimodal generative capabilities and…

Computer Vision and Pattern Recognition · Computer Science 2025-12-29 Hongzhe Bi , Hengkai Tan , Shenghao Xie , Zeyuan Wang , Shuhe Huang , Haitian Liu , Ruowen Zhao , Yao Feng , Chendong Xiang , Yinze Rong , Hongyan Zhao , Hanyu Liu , Zhizhong Su , Lei Ma , Hang Su , Jun Zhu

Incorporating symmetry as an inductive bias into neural network architecture has led to improvements in generalization, data efficiency, and physical consistency in dynamics modeling. Methods such as CNNs or equivariant neural networks use…

Machine Learning · Computer Science 2022-06-17 Rui Wang , Robin Walters , Rose Yu

Recent advances in visual generative models have highlighted the promise of learning generative world models. However, most existing approaches frame world modeling as novel-view synthesis or future-frame prediction, emphasizing visual…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Yifan Yin , Zehao Wen , Jieneng Chen , Zehan Zheng , Nanru Dai , Haojun Shi , Suyu Ye , Aydan Huang , Zheyuan Zhang , Alan Yuille , Jianwen Xie , Ayush Tewari , Tianmin Shu

Equivariant machine learning is an approach for designing deep learning models that respect the symmetries of the problem, with the aim of reducing model complexity and improving generalization. In this paper, we focus on an extension of…

Machine Learning · Computer Science 2024-12-10 Ya-Wei Eileen Lin , Ronen Talmon , Ron Levie

Equivariance is central to graph generative models, as it ensures the model respects the permutation symmetry of graphs. However, strict equivariance can increase computational cost due to added architectural constraints, and can slow down…

Machine Learning · Computer Science 2026-02-23 Benjamin Honoré , Alba Carballo-Castro , Yiming Qin , Pascal Frossard

While existing equivariant methods enhance data efficiency, they suffer from high computational intensity, reliance on single-modality inputs, and instability when combined with fast-sampling methods. In this work, we propose E3Flow, a…

Robotics · Computer Science 2026-03-25 Qinglun Zhang , Shen Cheng , Tian Dan , Haoqiang Fan , Guanghui Liu , Shuaicheng Liu

We present the group equivariant conditional neural process (EquivCNP), a meta-learning method with permutation invariance in a data set as in conventional conditional neural processes (CNPs), and it also has transformation equivariance in…

Machine Learning · Computer Science 2021-02-18 Makoto Kawano , Wataru Kumagai , Akiyoshi Sannai , Yusuke Iwasawa , Yutaka Matsuo

Generative models are a promising tool to address the sampling problem in multi-body and condensed-matter systems in the framework of statistical mechanics. In this work, we show that normalizing flows can be used to learn a transformation…

Computational Physics · Physics 2022-08-23 Alessandro Coretti , Sebastian Falkner , Phillip Geissler , Christoph Dellago

Reinforcement learning has emerged as a promising paradigm for aligning diffusion and flow-matching models with human preferences, yet practitioners face fragmented codebases, model-specific implementations, and engineering complexity. We…

Machine Learning · Computer Science 2026-03-17 Bowen Ping , Chengyou Jia , Minnan Luo , Hangwei Qian , Ivor Tsang

While video-generation-based embodied world models have gained increasing attention, their reliance on large-scale embodied interaction data remains a key bottleneck. The scarcity, difficulty of collection, and high dimensionality of…

Current generative models, such as autoregressive and diffusion approaches, decompose high-dimensional data distribution learning into a series of simpler subtasks. However, inherent conflicts arise during the joint optimization of these…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Ruixiao Dong , Mengde Xu , Zigang Geng , Li Li , Han Hu , Shuyang Gu

World models, which are predictive representations of how environments evolve under actions, have become a central component of robot learning. They support policy learning, planning, simulation, evaluation, data generation, and have…