English
Related papers

Related papers: FreqPolicy: Efficient Flow-based Visuomotor Policy…

200 papers

Generative flow networks (GFlowNets) are a method for learning a stochastic policy for generating compositional objects, such as graphs or strings, from a given unnormalized density by sequences of actions, where many possible action…

Machine Learning · Computer Science 2023-10-05 Nikolay Malkin , Moksh Jain , Emmanuel Bengio , Chen Sun , Yoshua Bengio

Tool use is essential for enabling robots to perform complex real-world tasks, but learning such skills requires extensive datasets. While teleoperation is widely used, it is slow, delay-sensitive, and poorly suited for dynamic tasks. In…

Robotics · Computer Science 2025-09-16 Haonan Chen , Cheng Zhu , Shuijing Liu , Yunzhu Li , Katherine Driggs-Campbell

Coarse-to-fine autoregressive modeling has recently shown strong promise for visuomotor policy learning, combining the inference efficiency of autoregressive methods with the global trajectory coherence of diffusion-based policies. However,…

Robotics · Computer Science 2026-03-31 Daichi Yashima , Koki Seno , Shuhei Kurita , Yusuke Oda , Komei Sugiura

Robust perception and dynamics modeling are fundamental to real-world robotic policy learning. Recent methods employ video diffusion models (VDMs) to enhance robotic policies, improving their understanding and modeling of the physical…

Flow-based models have proven successful for time-series generation, particularly when defined in lower-dimensional latent spaces that enable efficient sampling. However, how to design latent representations with desirable equivariance…

Machine Learning · Computer Science 2026-02-02 Camilo Carvajal Reyes , Felipe Tobar

Vision-Language-Navigation (VLN) models exhibit excellent navigation accuracy but incur high computational overhead. Token caching has emerged as a promising training-free strategy to reduce this cost by reusing token computation results;…

Diffusion models (DMs) are a powerful generative framework that have attracted significant attention in recent years. However, the high computational cost of training DMs limits their practical applications. In this paper, we start with a…

Machine Learning · Computer Science 2024-04-12 Tianshuo Xu , Peng Mi , Ruilin Wang , Yingcong Chen

Video generation models have been used as a robot policy to predict the future states of executing a task conditioned on task description and observation. Previous works ignore their high computational cost and long inference time. To…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Qikang Zhang , Yingjie Lei , Wei Liu , Daochang Liu

Consistency models have demonstrated powerful capability in efficient image generation and allowed synthesis within a few sampling steps, alleviating the high computational cost in diffusion models. However, the consistency model in the…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Xiang Wang , Shiwei Zhang , Han Zhang , Yu Liu , Yingya Zhang , Changxin Gao , Nong Sang

Current discriminative depth estimation methods often produce blurry artifacts, while generative approaches suffer from slow sampling due to curvatures in the noise-to-depth transport. Our method addresses these challenges by framing depth…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Ming Gui , Johannes Schusterbauer , Ulrich Prestel , Pingchuan Ma , Dmytro Kotovenko , Olga Grebenkova , Stefan Andreas Baumann , Vincent Tao Hu , Björn Ommer

Reinforcement Learning (RL) has proven highly effective in addressing complex control and decision-making tasks. However, in most traditional RL algorithms, the policy is typically parameterized as a diagonal Gaussian distribution, which…

Machine Learning · Computer Science 2026-04-02 Ruijie Hao , Longfei Zhang , Yang Dai , Yang Ma , Xingxing Liang , Guangquan Cheng

Visuomotor policies have shown great promise in robotic manipulation but often require substantial amounts of human-collected data for effective performance. A key reason underlying the data demands is their limited spatial generalization…

Robotics · Computer Science 2025-02-25 Zhengrong Xue , Shuying Deng , Zhenyang Chen , Yixuan Wang , Zhecheng Yuan , Huazhe Xu

While vision-language-action (VLA) models have shown great promise for robot manipulation, their deployment on rigid industrial robots remains challenging due to the inherent trade-off between compliance and responsiveness. Standard…

Robotics · Computer Science 2026-03-18 Johannes Hechtl , Philipp Schmitt , Georg von Wichert , Wolfram Burgard

Fine-grained and contact-rich manipulation remain challenging for robots, largely due to the underutilization of tactile feedback. To address this, we introduce TouchGuide, a novel cross-policy visuo-tactile fusion paradigm that fuses…

Robot behavior policies trained via imitation learning are prone to failure under conditions that deviate from their training data. Thus, algorithms that monitor learned policies at test time and provide early warnings of failure are…

Robotics · Computer Science 2024-11-01 Christopher Agia , Rohan Sinha , Jingyun Yang , Zi-ang Cao , Rika Antonova , Marco Pavone , Jeannette Bohg

Vision-Language Models (VLMs) incur substantial computational overhead and inference latency due to the large number of vision tokens introduced by high-resolution image and video inputs. Existing parameter-free token compression methods…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Huanyu Wang , Jushi Kai , Haoli Bai , Lu Hou , Bo Jiang , Ziwei He , Zhouhan Lin

Generating dynamic motions for legged robots remains a challenging problem. While reinforcement learning has achieved notable success in various legged locomotion tasks, producing highly dynamic behaviors often requires extensive reward…

Robotics · Computer Science 2026-01-01 Dongyun Kang , Min-Gyu Kim , Tae-Gyu Song , Hajun Kim , Sehoon Ha , Hae-Won Park

Generative models have excelled in audio tasks using approaches such as language models, diffusion, and flow matching. However, existing generative approaches for speech enhancement (SE) face notable challenges: language model-based methods…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-28 Ziqian Wang , Zikai Liu , Xinfa Zhu , Yike Zhu , Mingshuai Liu , Jun Chen , Longshuai Xiao , Chao Weng , Lei Xie

Diffusion models can learn rich representations during data generation, showing potential for Self-Supervised Learning (SSL), but they face a trade-off between generative quality and discriminative performance. Their iterative sampling also…

Machine Learning · Computer Science 2025-12-24 Kosuke Ukita , Tsuyoshi Okita

Despite tremendous progress in dexterous manipulation, current visuomotor policies remain fundamentally limited by two challenges: they struggle to generalize under perceptual or behavioral distribution shifts, and their performance is…

Robotics · Computer Science 2025-08-04 Junbang Liang , Pavel Tokmakov , Ruoshi Liu , Sruthi Sudhakar , Paarth Shah , Rares Ambrus , Carl Vondrick