English
Related papers

Related papers: Geometric Priors for Generalizable World Models vi…

200 papers

Vector Symbolic Architectures (VSAs) provide a well-defined algebraic framework for compositional representations in hyperdimensional spaces. We introduce HyperSpace, an open-source framework that decomposes VSA systems into modular…

Artificial Intelligence · Computer Science 2026-05-12 Shay Snyder , Andrew Capodieci , David Gorsich , Maryam Parsa

Analyzing a visual scene by inferring the configuration of a generative model is widely considered the most flexible and generalizable approach to scene understanding. Yet, one major problem is the computational challenge of the inference…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Alpha Renner , Lazar Supic , Andreea Danielescu , Giacomo Indiveri , Bruno A. Olshausen , Yulia Sandamirskaya , Friedrich T. Sommer , E. Paxon Frady

Large-scale pre-trained Vision-Language Models (VLMs) have demonstrated strong few-shot learning capabilities. However, these methods typically learn holistic representations where an image's domain-invariant structure is implicitly…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Hieu Dinh Trung Pham , Huy Minh Nhat Nguyen , Cuong Tuan Nguyen

Cognitive scientists believe adaptable intelligent agents like humans perform reasoning through learned causal mental simulations of agents and environments. The problem of learning such simulations is called predictive world modeling.…

Computer Vision and Pattern Recognition · Computer Science 2023-05-24 Robin Karlsson , Alexander Carballo , Keisuke Fujii , Kento Ohtani , Kazuya Takeda

Vision-Language Models (VLMs) often struggle with robust 3D spatial reasoning. Prevailing methods that rely on fine-tuning with 3D visual question-answering (VQA) datasets may overfit dataset-specific biases, while integrating specialized…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Chun-Hsiao Yeh , Shengyi Qian , Manchen Wang , Yi Ma , Joseph Tighe , Fanyi Xiao

This is Part II of the two-part comprehensive survey devoted to a computing framework most commonly known under the names Hyperdimensional Computing and Vector Symbolic Architectures (HDC/VSA). Both names refer to a family of computational…

Artificial Intelligence · Computer Science 2023-08-02 Denis Kleyko , Dmitri A. Rachkovskij , Evgeny Osipov , Abbas Rahimi

We present Generalizable Hierarchical Skill Learning (GSL), a novel framework for hierarchical policy learning that significantly improves policy generalization and sample efficiency in robot manipulation. One core idea of GSL is to use…

Despite rapid progress, embodied agents still struggle with long-horizon manipulation that requires maintaining spatial consistency, causal dependencies, and goal constraints. A key limitation of existing approaches is that task reasoning…

Contemporary deep learning architectures lack principled means for capturing and handling fundamental visual concepts, like objects, shapes, geometric transforms, and other higher-level structures. We propose a neurosymbolic architecture…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Krzysztof Krawiec , Antoni Nowinowski

Despite tremendous progress over the past decade, deep learning methods generally fall short of human-level systematic generalization. It has been argued that explicitly capturing the underlying structure of data should allow connectionist…

Machine Learning · Computer Science 2023-04-26 Andrea Dittadi

Broadly intelligent agents should form task-specific abstractions that selectively expose the essential elements of a task, while abstracting away the complexity of the raw sensorimotor space. In this work, we present Neuro-Symbolic…

Artificial Intelligence · Computer Science 2025-03-04 Yichao Liang , Nishanth Kumar , Hao Tang , Adrian Weller , Joshua B. Tenenbaum , Tom Silver , João F. Henriques , Kevin Ellis

Research in Artificial Intelligence (AI) has focused mostly on two extremes: either on small improvements in narrow AI domains, or on universal theoretical frameworks which are usually uncomputable, incompatible with theories of biological…

Vector space models for symbolic processing that encode symbols by random vectors have been proposed in cognitive science and connectionist communities under the names Vector Symbolic Architecture (VSA), and, synonymously, Hyperdimensional…

Machine Learning · Computer Science 2021-09-09 E. Paxon Frady , Denis Kleyko , Christopher J. Kymn , Bruno A. Olshausen , Friedrich T. Sommer

Achieving machine intelligence requires a smooth integration of perception and reasoning, yet models developed to date tend to specialize in one or the other; sophisticated manipulation of symbols acquired from rich perceptual spaces has so…

Machine Learning · Computer Science 2018-09-14 Eric Crawford , Guillaume Rabusseau , Joelle Pineau

Current 3D-aware pretraining methods for embodied perception and manipulation are largely built on differentiable rendering frameworks, producing either fully implicit neural fields or fully explicit geometric primitives. Implicit…

Generalized planning studies the construction of solution strategies that generalize across families of planning problems sharing a common domain model, formally defined by a transition function $\gamma : S \times A \rightarrow S$.…

Artificial Intelligence · Computer Science 2026-03-23 Nitin Gupta , Vishal Pallagani , John A. Aydin , Biplav Srivastava

Robots still lag behind humans in their ability to generalize from limited experience, particularly when transferring learned behaviors to long-horizon tasks in unseen environments. We present the first method that enables robots to…

Robotics · Computer Science 2025-10-07 Naman Shah , Jayesh Nagpal , Siddharth Srivastava

World models compress rich sensory streams into compact latent codes that anticipate future observations. We let separate agents acquire such models from distinct viewpoints of the same environment without any parameter sharing or…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Haoran Zhang , Youjin Wang , Yi Duan , Rong Fu , Dianyu Zhao , Sicheng Fan , Shuaishuai Cao , Wentao Guo , Xiao Zhou

In this paper, we leverage self-supervised vision transformer models and their emergent semantic abilities to improve the generalization abilities of imitation learning policies. We introduce DVK, an imitation learning algorithm that…

Robotics · Computer Science 2025-03-12 Wei-Di Chang , Francois Hogan , Scott Fujimoto , David Meger , Gregory Dudek

Deep learning architectures based on convolutional neural networks tend to rely on continuous, smooth features. While this characteristics provides significant robustness and proves useful in many real-world tasks, it is strikingly…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Zuzanna Buchnajzer , Kacper Dobek , Stanisław Hapke , Daniel Jankowski , Krzysztof Krawiec