English
Related papers

Related papers: Towards Sequence Modeling Alignment between Tokeni…

200 papers

Non-autoregressive translation (NAT) models generate multiple tokens in one forward pass and is highly efficient at inference stage compared with autoregressive translation (AT) methods. However, NAT models often suffer from the…

Computation and Language · Computer Science 2020-02-11 Xiaoya Li , Yuxian Meng , Arianna Yuan , Fei Wu , Jiwei Li

Autoregressive sequence models achieve state-of-the-art performance in domains like machine translation. However, due to the autoregressive factorization nature, these models suffer from heavy latency during inference. Recently,…

Machine Learning · Computer Science 2020-01-10 Zhiqing Sun , Zhuohan Li , Haoqing Wang , Zi Lin , Di He , Zhi-Hong Deng

Autoregressive models excel in modeling sequential dependencies by enforcing causal constraints, yet they struggle to capture complex bidirectional patterns due to their unidirectional nature. In contrast, mask-based models leverage…

Computation and Language · Computer Science 2024-09-18 S. Rohollah Hosseyni , Ali Ahmad Rahmani , S. Jamal Seyedmohammadi , Sanaz Seyedin , Arash Mohammadi

The predominant approach for language modeling is to process sequences from left to right, but this eliminates a source of information: the order by which the sequence was generated. One strategy to recover this information is to decode…

Computation and Language · Computer Science 2021-11-01 Xuanlin Li , Brandon Trabucco , Dong Huk Park , Michael Luo , Sheng Shen , Trevor Darrell , Yang Gao

In this paper, we introduce SemHiTok, a unified image Tokenizer via Semantic-Guided Hierarchical codebook that provides consistent discrete representations for multimodal understanding and generation. Recently, unified image tokenizers have…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Zisheng Chen , Chunwei Wang , Runhui Huang , Hongbin Xu , Xiuwei Chen , Jun Zhou , Jianhua Han , Hang Xu , Xiaodan Liang

Unified Multimodal Large Language Models (MLLMs) require a visual representation that simultaneously supports high-fidelity reconstruction, complex semantic extraction, and generative suitability. However, existing visual tokenizers…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Shaobin Zhuang , Yuang Ai , Jiaming Han , Weijia Mao , Xiaohui Li , Fangyikang Wang , Xiao Wang , Yan Li , Shanchuan Lin , Kun Xu , Zhenheng Yang , Huaibo Huang , Xiangyu Yue , Hao Chen , Yali Wang

The autoregressive nature of conventional large language models (LLMs) inherently limits inference speed, as tokens are generated sequentially. While speculative and parallel decoding techniques attempt to mitigate this, they face…

Artificial Intelligence · Computer Science 2024-10-22 Aishwarya P S , Pranav Ajit Nair , Yashas Samaga , Toby Boyd , Sanjiv Kumar , Prateek Jain , Praneeth Netrapalli

Autoregressive and diffusion models have achieved remarkable progress in language models and visual generation, respectively. We present ACDiT, a novel Autoregressive blockwise Conditional Diffusion Transformer, that innovatively combines…

Computer Vision and Pattern Recognition · Computer Science 2026-01-30 Jinyi Hu , Shengding Hu , Yuxuan Song , Yufei Huang , Mingxuan Wang , Hao Zhou , Zhiyuan Liu , Wei-Ying Ma , Maosong Sun

Designing a universal policy architecture that performs well across diverse robots and task configurations remains a key challenge. In this work, we address this by representing robot actions as sequential data and generating actions…

Robotics · Computer Science 2025-03-27 Xinyu Zhang , Yuhan Liu , Haonan Chang , Liam Schramm , Abdeslam Boularias

We present an approach to pose object recognition as next token prediction. The idea is to apply a language decoder that auto-regressively predicts the text tokens from image embeddings to form labels. To ground this prediction process in…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Kaiyu Yue , Bor-Chun Chen , Jonas Geiping , Hengduo Li , Tom Goldstein , Ser-Nam Lim

Discrete autoregressive (AR) text-to-image (T2I) models pair a VQ tokenizer with an AR policy, and current post-training pipelines optimize only the policy while keeping the VQ decoder frozen. Recent diffusion T2I work, exemplified by…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Siyong Jian , Siyuan Li , Luyuan Zhang , Zedong Wang , Xin Jin , Ying Li , Cheng Tan , Huan Wang

Autoregressive models are widely used for tasks such as image and audio generation. The sampling process of these models, however, does not allow interruptions and cannot adapt to real-time computational resources. This challenge impedes…

Machine Learning · Computer Science 2021-02-24 Yilun Xu , Yang Song , Sahaj Garg , Linyuan Gong , Rui Shu , Aditya Grover , Stefano Ermon

Latent-based image generative models, such as Latent Diffusion Models (LDMs) and Mask Image Models (MIMs), have achieved notable success in image generation tasks. These models typically leverage reconstructive autoencoders like VQGAN or…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Yongxin Zhu , Bocheng Li , Hang Zhang , Xin Li , Linli Xu , Lidong Bing

We consider the problem of customizing text-to-image diffusion models with user-supplied reference images. Given new prompts, the existing methods can capture the key concept from the reference images but fail to align the generated image…

Computer Vision and Pattern Recognition · Computer Science 2024-07-01 Aishwarya Agarwal , Srikrishna Karanam , Balaji Vasan Srinivasan

As generative models scale to larger inputs across language, vision, and video domains, the cost of token-level computation has become a key bottleneck. While prior work suggests that only a subset of tokens significantly influence…

Artificial Intelligence · Computer Science 2025-08-20 Dong Liu , Yanxuan Yu

Autoregressive language modeling (ALM) have been successfully used in self-supervised pre-training in Natural language processing (NLP). However, this paradigm has not achieved comparable results with other self-supervised approach in…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Yu Qi , Fan Yang , Yousong Zhu , Yufei Liu , Liwei Wu , Rui Zhao , Wei Li

Attention-based encoder-decoder (AED) models have achieved promising performance in speech recognition. However, because the decoder predicts text tokens (such as characters or words) in an autoregressive manner, it is difficult for an AED…

Computation and Language · Computer Science 2021-08-31 Ye Bai , Jiangyan Yi , Jianhua Tao , Zhengkun Tian , Zhengqi Wen , Shuai Zhang

In this work, we first revisit the sampling issues in current autoregressive (AR) image generation models and identify that image tokens, unlike text tokens, exhibit lower information density and non-uniform spatial distribution.…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Xiaoxiao Ma , Feng Zhao , Pengyang Ling , Haibo Qiu , Zhixiang Wei , Hu Yu , Jie Huang , Zhixiong Zeng , Lin Ma

Recent advances in autoregressive (AR) models with continuous tokens for image generation show promising results by eliminating the need for discrete tokenization. However, these models face efficiency challenges due to their sequential…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Zhihang Yuan , Yuzhang Shang , Hanling Zhang , Tongcheng Fang , Rui Xie , Bingxin Xu , Yan Yan , Shengen Yan , Guohao Dai , Yu Wang

Unified models aim to support both understanding and generation by encoding images into discrete tokens and processing them alongside text within a single autoregressive framework. This unified design offers architectural simplicity and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Ziyao Wang , Chen Chen , Jingtao Li , Weiming Zhuang , Jiabo Huang , Ang Li , Lingjuan Lyu
‹ Prev 1 8 9 10 Next ›