English
Related papers

Related papers: HiFlow: Tokenization-Free Scale-Wise Autoregressiv…

200 papers

Offline reinforcement learning often relies on behavior regularization that enforces policies to remain close to the dataset distribution. However, such approaches fail to distinguish between high-value and low-value actions in their…

A fundamental objective of manipulation policy design is to endow robots to comprehend human instructions, reason about scene cues, and execute generalized actions in dynamic environments. Recent autoregressive vision-language-action (VLA)…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Jiaming Liu , Hao Chen , Pengju An , Zhuoyang Liu , Renrui Zhang , Chenyang Gu , Xiaoqi Li , Ziyu Guo , Sixiang Chen , Mengzhen Liu , Chengkai Hou , Mengdi Zhao , KC alex Zhou , Pheng-Ann Heng , Shanghang Zhang

Numerous applications of machine learning involve representing probability distributions over high-dimensional data. We propose autoregressive quantile flows, a flexible class of normalizing flow models trained using a novel objective based…

Machine Learning · Computer Science 2023-02-17 Phillip Si , Allan Bishop , Volodymyr Kuleshov

Existing imitation learning methods enable robots to interact autonomously with the physical environment. However, contact-rich manipulation tasks remain a significant challenge due to complex contact dynamics that demand high-precision…

Autoregressive sequence models, such as Transformer-based vision-language action (VLA) policies, can be tremendously effective for capturing complex and generalizable robotic behaviors. However, such models require us to choose a…

Autoregressive models have emerged as a powerful generative paradigm for visual generation. The current de-facto standard of next token prediction commonly operates over a single-scale sequence of dense image tokens, and is incapable of…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Guangting Zheng , Yehao Li , Yingwei Pan , Jiajun Deng , Ting Yao , Yanyong Zhang , Tao Mei

Imitation learning for robotic manipulation often suffers from limited generalization and data scarcity, especially in complex, long-horizon tasks. In this work, we introduce a hierarchical framework that leverages code-generating…

Robotics · Computer Science 2025-09-30 Markus Peschl , Pietro Mazzaglia , Daniel Dijkman

Training general robotic policies from heterogeneous data for different tasks is a significant challenge. Existing robotic datasets vary in different modalities such as color, depth, tactile, and proprioceptive information, and collected in…

Robotics · Computer Science 2024-12-03 Lirui Wang , Jialiang Zhao , Yilun Du , Edward H. Adelson , Russ Tedrake

Text-to-motion generation aims to generate 3D human motions that are tightly aligned with the input text while remaining physically plausible and rich in fine-grained detail. Although recent approaches can produce complex and natural…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Heng Li , Xiaotong Lin , Ling-An Zeng , Yulei Kang , Shuai Li , Jian-Fang Hu

Recent advances in inverse problem solving have increasingly adopted flow priors over diffusion models due to their ability to construct straight probability paths from noise to data, thereby enhancing efficiency in both training and…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Hossein Askari , Yadan Luo , Hongfu Sun , Fred Roosta

Learning a generalizable bimanual manipulation policy is extremely challenging for embodied agents due to the large action space and the need for coordinated arm movements. Existing approaches rely on Vision-Language-Action (VLA) models to…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Chenyou Fan , Fangzheng Yan , Chenjia Bai , Jiepeng Wang , Chi Zhang , Zhen Wang , Xuelong Li

We present TokenFlow, a novel unified image tokenizer that bridges the long-standing gap between multimodal understanding and generation. Prior research attempt to employ a single reconstruction-targeted Vector Quantization (VQ) encoder for…

Computer Vision and Pattern Recognition · Computer Science 2025-08-08 Liao Qu , Huichao Zhang , Yiheng Liu , Xu Wang , Yi Jiang , Yiming Gao , Hu Ye , Daniel K. Du , Zehuan Yuan , Xinglong Wu

Likelihood-based policy gradient methods are the dominant approach for training robot control policies from rewards. These methods rely on differentiable action likelihoods, which constrain policy outputs to simple distributions like…

Deploying pretrained visual models in real-world environments often suffers from significant performance degradation due to the diversity of testing scenarios. Continuous adaptation of learning models on edge devices via unlabeled data…

Neural and Evolutionary Computing · Computer Science 2026-05-08 Jianming Lv , Chengjun Wang , Depin Liang , Qianli Ma , Wei Chen , Xueqi Cheng

Autoregressive models, often built on Transformer architectures, represent a powerful paradigm for generating ultra-long videos by synthesizing content in sequential chunks. However, this sequential generation process is notoriously slow.…

Computer Vision and Pattern Recognition · Computer Science 2026-02-12 Yuexiao Ma , Xuzhe Zheng , Jing Xu , Xiwei Xu , Feng Ling , Xiawu Zheng , Huafeng Kuang , Huixia Li , Xing Wang , Xuefeng Xiao , Fei Chao , Rongrong Ji

Diffusion-based models for robotic control, including vision-language-action (VLA) and vision-action (VA) policies, have demonstrated significant capabilities. Yet their advancement is constrained by the high cost of acquiring large-scale…

Autoregressive models have driven remarkable progress in language modeling. Their foundational reliance on discrete tokens, unidirectional context, and single-pass decoding, while central to their success, also inspires the exploration of a…

Diffusion policies have demonstrated exceptional performance in embodied AI. However, their iterative denoising process results in high latency, and existing acceleration methods often sacrifice physical consistency. To address this, we…

Robotics · Computer Science 2026-05-12 Kewei Chen , Yayu Long , Shuai Li , Mingsheng Shang

Developing efficient and accurate visuomotor policies poses a central challenge in robotic imitation learning. While recent rectified flow approaches have advanced visuomotor policy learning, they suffer from a key limitation: After…

Robotics · Computer Science 2025-11-12 Rong Xue , Jiageng Mao , Mingtong Zhang , Yue Wang

Autoregressive (AR) modeling has achieved remarkable success in natural language processing by enabling models to generate text with coherence and contextual understanding through next token prediction. Recently, in image generation, VAR…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Sucheng Ren , Qihang Yu , Ju He , Xiaohui Shen , Alan Yuille , Liang-Chieh Chen