中文
相关论文

相关论文: Fast Autoregressive Models for Continuous Latent G…

200 篇论文

Autoregressive models excel in modeling sequential dependencies by enforcing causal constraints, yet they struggle to capture complex bidirectional patterns due to their unidirectional nature. In contrast, mask-based models leverage…

计算与语言 · 计算机科学 2024-09-18 S. Rohollah Hosseyni , Ali Ahmad Rahmani , S. Jamal Seyedmohammadi , Sanaz Seyedin , Arash Mohammadi

We introduce DC-AR, a novel masked autoregressive (AR) text-to-image generation framework that delivers superior image generation quality with exceptional computational efficiency. Due to the tokenizers' limitations, prior masked AR models…

计算机视觉与模式识别 · 计算机科学 2025-07-08 Yecheng Wu , Junyu Chen , Zhuoyang Zhang , Enze Xie , Jincheng Yu , Junsong Chen , Jinyi Hu , Yao Lu , Song Han , Han Cai

This paper presents DetailFlow, a coarse-to-fine 1D autoregressive (AR) image generation method that models images through a novel next-detail prediction strategy. By learning a resolution-aware token sequence supervised with progressively…

计算机视觉与模式识别 · 计算机科学 2025-11-12 Yiheng Liu , Liao Qu , Huichao Zhang , Xu Wang , Yi Jiang , Yiming Gao , Hu Ye , Xian Li , Shuai Wang , Daniel K. Du , Fangmin Chen , Zehuan Yuan , Xinglong Wu

Autoregressive (AR) Large Language Models (LLMs) have demonstrated significant success across numerous tasks. However, the AR modeling paradigm presents certain limitations; for instance, contemporary autoregressive LLMs are trained to…

机器学习 · 计算机科学 2025-02-10 Justin Deschenaux , Caglar Gulcehre

Autoregressive (AR) visual generation has emerged as a powerful paradigm for image and multimodal synthesis, owing to its scalability and generality. However, existing AR image generation suffers from severe memory bottlenecks due to the…

计算机视觉与模式识别 · 计算机科学 2025-12-05 Ziran Qin , Youru Lv , Mingbao Lin , Zeren Zhang , Chanfan Gan , Tieyuan Chen , Weiyao Lin

Autoregressive (AR) models remain the standard for natural language generation but still suffer from high latency due to strictly sequential decoding. Recent diffusion-inspired approaches, such as LlaDA and Dream, mitigate this by…

计算与语言 · 计算机科学 2025-10-16 Qinglin Zhu , Yizhen Yao , Runcong Zhao , Yanzheng Xiang , Amrutha Saseendran , Chen Jin , Philip Teare , Bin Liang , Yulan He , Lin Gui

While Autoregressive (AR) Transformer-based Generative Language Models are frequently employed for lookahead tasks, recent research suggests a potential discrepancy in their ability to perform planning tasks that require multi-step…

机器学习 · 计算机科学 2026-02-24 Itamar Trainin , Shauli Ravfogel , Omri Abend , Amir Feder

Diffusion-based inpainting is a powerful tool for the reconstruction of images from sparse data. Its quality strongly depends on the choice of known data. Optimising their spatial location -- the inpainting mask -- is challenging. A…

图像与视频处理 · 电气工程与系统科学 2022-05-17 Tobias Alt , Pascal Peter , Joachim Weickert

Generative classifiers, which leverage conditional generative models for classification, have recently demonstrated desirable properties such as robustness to distribution shifts. However, recent progress in this area has been largely…

机器学习 · 计算机科学 2026-03-24 Yi-Chung Chen , David I. Inouye , Jing Gao

Image reconstruction from radio-frequency data is pivotal in ultrafast plane wave ultrasound imaging. Unlike the conventional delay-and-sum (DAS) technique, which relies on somewhat imprecise assumptions, deep learning-based methods perform…

计算机视觉与模式识别 · 计算机科学 2023-12-18 Hengrong Lan , Zhiqiang Li , Qiong He , Jianwen Luo

Diffusion models demonstrate outstanding performance in image generation, but their multi-step inference mechanism requires immense computational cost. Previous works accelerate inference by leveraging layer or token cache techniques to…

计算机视觉与模式识别 · 计算机科学 2026-04-07 Haowei Zhu , Ji Liu , Ziqiong Liu , Dong Li , Junhai Yong , Bin Wang , Emad Barsoum

The raster-ordered image token sequence exhibits a significant Euclidean distance between index-adjacent tokens at line breaks, making it unsuitable for autoregressive generation. To address this issue, this paper proposes Direction-Aware…

计算机视觉与模式识别 · 计算机科学 2025-04-17 Yijia Xu , Jianzhong Ju , Jian Luan , Jinshi Cui

Recent economic events, including the global financial crisis and COVID-19 pandemic, have exposed limitations in linear Factor Augmented Vector Autoregressive (FAVAR) models for forecasting and structural analysis. Nonlinear dimension…

机器学习 · 统计学 2025-03-07 Yiyong Luo , Brooks Paige , Jim Griffin

Auto-Regressive (AR) models have achieved impressive results in 2D image generation by modeling joint distributions in the grid space. While this approach has been extended to the 3D domain for powerful shape generation, it still has two…

计算机视觉与模式识别 · 计算机科学 2023-03-28 Simian Luo , Xuelin Qian , Yanwei Fu , Yinda Zhang , Ying Tai , Zhenyu Zhang , Chengjie Wang , Xiangyang Xue

Diffusion models have emerged as powerful generative approaches for missing-data imputation, yet most existing methods operate directly in data space and degrade when training data are heavily incomplete. We investigate whether shifting…

机器学习 · 计算机科学 2026-05-28 Alberte Heering Estad , Ignacio Peis , Jes Frellsen

Autoregressive video diffusion models enable streaming generation, opening the door to long-form synthesis, video world models, and interactive neural game engines. However, their core attention layers become a major bottleneck at inference…

计算机视觉与模式识别 · 计算机科学 2026-02-03 Dvir Samuel , Issar Tzachor , Matan Levy , Micahel Green , Gal Chechik , Rami Ben-Ari

We study one particular type of multivariate spatial autoregression (MSAR) model with diverging dimensions in both responses and covariates. This makes the usual MSAR models no longer applicable due to the high computational cost. To…

统计方法学 · 统计学 2025-09-03 Jiaxin Shi , Xuening Zhu , Jing Zhou , Baichen Yu , Hansheng Wang

Normalizing flows and autoregressive models have been successfully combined to produce state-of-the-art results in density estimation, via Masked Autoregressive Flows (MAF), and to accelerate state-of-the-art WaveNet-based speech synthesis…

机器学习 · 计算机科学 2018-04-04 Chin-Wei Huang , David Krueger , Alexandre Lacoste , Aaron Courville

Super-resolution (SR) and image generation are important tasks in computer vision and are widely adopted in real-world applications. Most existing methods, however, generate images only at fixed-scale magnification and suffer from…

计算机视觉与模式识别 · 计算机科学 2024-03-18 Jinseok Kim , Tae-Kyun Kim

Generative models such as diffusion and flow matching have become dominant paradigms for visuomotor policy learning, yet their reliance on iterative denoising incurs high inference latency incompatible with real-time robotic control. We…

机器人学 · 计算机科学 2026-05-18 Jiaqi Bai , Jindou Jia , Yuxuan Hu , Gen Li , Xiangyu Chen , Tuo An , Kuangji Zuo , Jianfei Yang