English
Related papers

Related papers: Flow Equivariant World Models: Memory for Partiall…

200 papers

Although group convolutional networks are able to learn powerful representations based on symmetry patterns, they lack explicit means to learn meaningful relationships among them (e.g., relative positions and poses). In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2020-07-01 David W. Romero , Erik J. Bekkers , Jakub M. Tomczak , Mark Hoogendoorn

Recently, equivariant neural networks for policy learning have shown promising improvements in sample efficiency and generalization, however, their wide adoption faces substantial barriers due to implementation complexity. Equivariant…

Robotics · Computer Science 2025-12-22 Dian Wang , Boce Hu , Shuran Song , Robin Walters , Robert Platt

Embodied action planning is a core challenge in robotics, requiring models to generate precise actions from visual observations and language instructions. While video generation world models are promising, their reliance on pixel-level…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Yangcheng Yu , Xin Jin , Yu Shang , Xin Zhang , Haisheng Su , Wei Wu , Yong Li

Flow matching has emerged as a powerful generative framework, with recent few-step methods achieving remarkable inference acceleration. However, we identify a critical yet overlooked limitation: these models suffer from severe diversity…

Machine Learning · Computer Science 2026-04-15 Yexiong Lin , Jia Shi , Shanshan Ye , Wanyu Wang , Yu Yao , Tongliang Liu

Embodied agents in household environments must plan under partial observation: they need to remember objects, track state changes, and recover when actions fail. Existing benchmarks only partially test this ability. Egocentric video…

Artificial Intelligence · Computer Science 2026-05-14 Qinchuan Cheng , Zhantao Gong , Pengzhan Sun , Angela Yao , Xulei Yang , Shijie Li

Visual environments are structured, consisting of distinct objects or entities. These entities have properties -- both visible and latent -- that determine the manner in which they interact with one another. To partition images into…

Artificial Intelligence · Computer Science 2022-03-24 Anirudh Goyal , Aniket Didolkar , Nan Rosemary Ke , Charles Blundell , Philippe Beaudoin , Nicolas Heess , Michael Mozer , Yoshua Bengio

Incorporating inductive biases is a promising approach for tackling challenging robot learning domains with sample-efficient solutions. This paper identifies partially observable domains where symmetries can be a useful inductive bias for…

Robotics · Computer Science 2024-08-27 Hai Nguyen , Andrea Baisero , David Klee , Dian Wang , Robert Platt , Christopher Amato

In many applications, it is important to reconstruct a fluid flow field, or some other high-dimensional state, from limited measurements and limited data. In this work, we propose a shallow neural network-based learning methodology for such…

Neural networks that process the parameters of other neural networks find applications in domains as diverse as classifying implicit neural representations, generating neural network weights, and predicting generalization errors. However,…

Equivariant neural networks have proven to be effective for tasks with known underlying symmetries. However, optimizing equivariant networks can be tricky and best training practices are less established than for standard networks. In…

Machine Learning · Computer Science 2025-11-04 YuQing Xie , Tess Smidt

We introduce Equilibrium Matching (EqM), a generative modeling framework built from an equilibrium dynamics perspective. EqM discards the non-equilibrium, time-conditional dynamics in traditional diffusion and flow-based generative models…

Machine Learning · Computer Science 2025-10-14 Runqian Wang , Yilun Du

Neural populations exhibit latent dynamical structures that drive time-evolving spiking activities, motivating the search for models that capture both intrinsic network dynamics and external unobserved influences. In this work, we introduce…

Machine Learning · Computer Science 2026-03-11 Yue Song , T. Anderson Keller , Yisong Yue , Pietro Perona , Max Welling

Traditional supervised learning aims to learn an unknown mapping by fitting a function to a set of input-output pairs with a fixed dimension. The fitted function is then defined on inputs of the same dimension. However, in many settings,…

Machine Learning · Computer Science 2024-05-01 Eitan Levin , Mateo Díaz

Motion estimation is one of the core challenges in computer vision. With traditional dual-frame approaches, occlusions and out-of-view motions are a limiting factor, especially in the context of environmental perception for vehicles due to…

Computer Vision and Pattern Recognition · Computer Science 2020-11-05 René Schuster , Christian Unger , Didier Stricker

Ophthalmic decision-making depends on subtle lesion-scale cues interpreted across multimodal imaging and over time, yet most medical foundation models remain static and degrade under modality and acquisition shifts. Here we introduce…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Ziyu Gao , Xinyuan Wu , Xiaolan Chen , Zhuoran Liu , Ruoyu Chen , Bowen Liu , Bingjie Yan , Zhenhan Wang , Kai Jin , Jiancheng Yang , Yih Chung Tham , Mingguang He , Danli Shi

If a robot masters folding a kitchen towel, we would expect it to master folding a large beach towel. However, existing policy learning methods that rely on data augmentation still don't guarantee such generalization. Our insight is to add…

Robotics · Computer Science 2024-07-03 Jingyun Yang , Congyue Deng , Jimmy Wu , Rika Antonova , Leonidas Guibas , Jeannette Bohg

Strong semantic representations improve the convergence and generation quality of diffusion and flow models. Existing approaches largely rely on external models, which require separate training, operate on misaligned objectives, and exhibit…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Hila Chefer , Patrick Esser , Dominik Lorenz , Dustin Podell , Vikash Raja , Vinh Tong , Antonio Torralba , Robin Rombach

We present the Global Neural World Model (GNWM), a self-stabilizing framework that achieves topological quantization through balanced continuous entropy constraints. Operating as a continuous, action-conditioned Joint-Embedding Predictive…

Machine Learning · Computer Science 2026-04-21 Noureddine Kermiche

In recent years, the use of machine learning has become increasingly popular in the context of lattice field theories. An essential element of such theories is represented by symmetries, whose inclusion in the neural network properties can…

High Energy Physics - Lattice · Physics 2021-12-24 Srinath Bulusu , Matteo Favoni , Andreas Ipp , David I. Müller , Daniel Schuh

Standard flow matching scales well but typically relies on an unstructured source distribution, limiting its ability to learn interpretable latent structure. Latent-variable models, by contrast, capture structure but often sacrifice…

Machine Learning · Computer Science 2026-05-11 Xavier Sumba , Carles Balsells-Rodas , Yingzhen Li
‹ Prev 1 3 4 5 6 7 10 Next ›