English
Related papers

Related papers: HiFlow: Tokenization-Free Scale-Wise Autoregressiv…

200 papers

As policy catches up with the capabilities of generative AI, watermarking is central to content provenance efforts. Inference-time watermarks for autoregressive models are unfit for continuous modalities due to discretization…

Machine Learning · Computer Science 2026-05-26 Georgios Milis , Yubin Qin , Yihan Wu , Heng Huang

This paper presents Diffusion via Autoregressive models (D-AR), a new paradigm recasting the image diffusion process as a vanilla autoregressive procedure in the standard next-token-prediction fashion. We start by designing the tokenizer…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Ziteng Gao , Mike Zheng Shou

The ability to embed watermarks in images is a fundamental problem of interest for computer vision, and is exacerbated by the rapid rise of generated imagery in recent times. Current state-of-the-art techniques suffer from computational and…

Image and Video Processing · Electrical Eng. & Systems 2025-09-17 Vinay Shukla , Prachee Sharma , Ryan Rossi , Sungchul Kim , Tong Yu , Aditya Grover

Diffusion models have emerged as the leading approach for image synthesis, demonstrating exceptional photorealism and diversity. However, training diffusion models at high resolutions remains computationally prohibitive, and existing…

Computer Vision and Pattern Recognition · Computer Science 2025-06-26 Tobias Vontobel , Seyedmorteza Sadat , Farnood Salehi , Romann M. Weber

Autoregressive visual generation models typically rely on tokenizers to compress images into tokens that can be predicted sequentially. A fundamental dilemma exists in token representation: discrete tokens enable straightforward modeling…

Computer Vision and Pattern Recognition · Computer Science 2025-09-01 Yuqing Wang , Zhijie Lin , Yao Teng , Yuanzhi Zhu , Shuhuai Ren , Jiashi Feng , Xihui Liu

Learning visuomotor policies via behavior cloning typically involves mimicking expert demonstrations collected by human operators. However, natural human demonstrations inherently contain high-frequency noise, such as intermittent jerks,…

Robotics · Computer Science 2026-05-28 Junlin Wang

Deep generative models provide a promising approach to de novo 3D peptide design. Most of them jointly model the distributions of peptide's position, orientation, and conformation, attempting to simultaneously converge to the target pocket.…

Quantitative Methods · Quantitative Biology 2025-11-04 Dengdeng Huang , Shikui Tu

Many robotic systems, such as mobile manipulators or quadrotors, cannot be equipped with high-end GPUs due to space, weight, and power constraints. These constraints prevent these systems from leveraging recent developments in visuomotor…

Robotics · Computer Science 2024-07-02 Aaditya Prasad , Kevin Lin , Jimmy Wu , Linqi Zhou , Jeannette Bohg

Discrete image tokenizers are commonly trained in two stages: first for reconstruction, and then with a prior model fitted to the frozen token sequences. This decoupling leaves the tokenizer unaware of the model that will later generate its…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Bowen Zheng , Yihong Luo , Tianyang Hu

We present UniFluid, a unified autoregressive framework for joint visual generation and understanding leveraging continuous visual tokens. Our unified autoregressive architecture processes multimodal image and text inputs, generating…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Lijie Fan , Luming Tang , Siyang Qin , Tianhong Li , Xuan Yang , Siyuan Qiao , Andreas Steiner , Chen Sun , Yuanzhen Li , Tao Zhu , Michael Rubinstein , Michalis Raptis , Deqing Sun , Radu Soricut

Sequence modeling approaches have shown promising results in robot imitation learning. Recently, diffusion models have been adopted for behavioral cloning in a sequence modeling fashion, benefiting from their exceptional capabilities in…

Robotics · Computer Science 2024-01-12 Xiang Li , Varun Belagali , Jinghuan Shang , Michael S. Ryoo

Vision-Language-Action (VLA) models have emerged as a unified paradigm for robotic perception and control, enabling emergent generalization and long-horizon task execution. However, their deployment in dynamic, real-world environments is…

Artificial Intelligence · Computer Science 2025-12-24 Yuntao Dai , Hang Gu , Teng Wang , Qianyu Cheng , Yifei Zheng , Zhiyong Qiu , Lei Gong , Wenqi Lou , Xuehai Zhou

Synthetic datasets play a critical role in pre-training CNN models for optical flow, but they are painstaking to generate and hard to adapt to new applications. To automate the process, we present AutoFlow, a simple and effective method to…

Computer Vision and Pattern Recognition · Computer Science 2021-04-30 Deqing Sun , Daniel Vlasic , Charles Herrmann , Varun Jampani , Michael Krainin , Huiwen Chang , Ramin Zabih , William T. Freeman , Ce Liu

Reliable 3D dynamic perception requires models that can anticipate motion beyond predefined categories, yet progress is hindered by the scarcity of dense, high-quality motion annotations. While self-supervision on unlabeled real data offers…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Qingwen Zhang , Xiaomeng Zhu , Chenhan Jiang , Patric Jensfelt

We present OneFlow, the first non-autoregressive multimodal model that enables variable-length and concurrent mixed-modal generation. Unlike autoregressive models that enforce rigid causal ordering between text and image generation, OneFlow…

Artificial Intelligence · Computer Science 2025-12-11 John Nguyen , Marton Havasi , Tariq Berrada , Luke Zettlemoyer , Ricky T. Q. Chen

Most recent diffusion-based methods still show a large gap compared to non-diffusion methods for video frame interpolation, in both accuracy and efficiency. Most of them formulate the problem as a denoising procedure in latent space…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Yang Hai , Guo Wang , Tan Su , Wenjie Jiang , Yinlin Hu

The paper presents a complete pipeline for learning continuous motion control policies for a mobile robot when only a non-differentiable physics simulator of robot-terrain interactions is available. The multi-modal state estimation of the…

Robotics · Computer Science 2022-06-22 Martin Pecka , Karel Zimmermann , Matěj Petrlík , Tomáš Svoboda

Scene flow estimation is a crucial component in the development of autonomous driving and 3D robotics, providing valuable information for environment perception and navigation. Despite the advantages of learning-based scene flow estimation…

Computer Vision and Pattern Recognition · Computer Science 2024-01-08 Rahul Ahuja , Chris Baker , Wilko Schwarting

Large displacement optical flow is an integral part of many computer vision tasks. Variational optical flow techniques based on a coarse-to-fine scheme interpolate sparse matches and locally optimize an energy model conditioned on colour,…

Computer Vision and Pattern Recognition · Computer Science 2022-06-28 Qiao Chen , Charalambos Poullis

Flow Matching has emerged as a powerful framework for learning continuous transformations between distributions, enabling high-fidelity generative modeling. This work introduces Symmetrical Flow Matching (SymmFlow), a new formulation that…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Francisco Caetano , Christiaan Viviers , Peter H. N. De With , Fons van der Sommen