English
Related papers

Related papers: DCoAR: Deep Concept Injection into Unified Autoreg…

200 papers

Prompt learning is a dominant paradigm for adapting pre-trained Vision-Language Models (VLMs) to downstream tasks. However, existing methods often rely on a simplistic, layer-centric view, assuming shallow layers capture general features…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Yiming Ma , Hongkun Yang , Lionel Z. Wang , Bin Chen , Weizhi Xian , Jianzhi Teng

We introduce Autoregressive Retrieval Augmentation (AR-RAG), a novel paradigm that enhances image generation by autoregressively incorporating knearest neighbor retrievals at the patch level. Unlike prior methods that perform a single,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Jingyuan Qi , Zhiyang Xu , Qifan Wang , Lifu Huang

While diffusion models excel at image synthesis, useful representations have been shown to emerge from generative pre-training, suggesting a path towards unified generative and discriminative learning. However, suboptimal semantic flow…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Weilai Xiang , Hongyu Yang , Di Huang , Yunhong Wang

Autoregressive models for video generation typically operate frame-by-frame, extending next-token prediction from language to video's temporal dimension. We question that unlike word as token is universally agreed in language if frame is a…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Sucheng Ren , Chen Chen , Zhenbang Wang , Liangchen Song , Xiangxin Zhu , Alan Yuille , Yinfei Yang , Jiasen Lu

While autoregressive (AR) models have demonstrated remarkable success in image generation, extending them to layout-conditioned generation remains challenging due to the sparse nature of layout conditions and the risk of feature…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Zirui Zheng , Takashi Isobe , Tong Shen , Xu Jia , Jianbin Zhao , Xiaomin Li , Mengmeng Ge , Baolu Li , Qinghe Wang , Dong Li , Dong Zhou , Yunzhi Zhuge , Huchuan Lu , Emad Barsoum

In this work, we provide a systematic survey of Discrete Diffusion Language Models (dLLMs) and Discrete Diffusion Multimodal Language Models (dMLLMs). Unlike autoregressive (AR) models, dLLMs and dMLLMs adopt a multi-token, parallel…

Machine Learning · Computer Science 2025-09-22 Runpeng Yu , Qi Li , Xinchao Wang

Personalized image synthesis has emerged as a pivotal application in text-to-image generation, enabling the creation of images featuring specific subjects in diverse contexts. While diffusion models have dominated this domain,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-18 Kaiyue Sun , Xian Liu , Yao Teng , Xihui Liu

Personalized text-to-image generation aims to synthesize images of user-provided concepts in diverse contexts. Despite recent progress in multi-concept personalization, most are limited to object concepts and struggle to customize abstract…

Computer Vision and Pattern Recognition · Computer Science 2026-02-23 Weizhi Zhong , Huan Yang , Zheng Liu , Huiguo He , Zijian He , Xuesong Niu , Di Zhang , Guanbin Li

Decoder-only autoregressive image generation typically relies on fixed-length tokenization schemes whose token counts grow quadratically with resolution, substantially increasing the computational and memory demands of attention. We present…

Computer Vision and Pattern Recognition · Computer Science 2025-12-29 Divyansh Srivastava , Akshay Mehra , Pranav Maneriker , Debopam Sanyal , Vishnu Raj , Vijay Kamarshi , Fan Du , Joshua Kimball

Diffusion Language Models (DLMs) have recently achieved significant success due to their any-order generation capabilities. However, existing inference methods typically rely on local, immediate-step metrics such as confidence or entropy…

Computation and Language · Computer Science 2025-12-03 Kecheng Chen , Ziru Liu , Xijia Tao , Hui Liu , Xinyu Fu , Suiyun Zhang , Dandan Tu , Lingpeng Kong , Rui Liu , Haoliang Li

Long-trajectory video generation is a crucial yet challenging task for world modeling primarily due to the limited scalability of existing video diffusion models (VDMs). Autoregressive models, while offering infinite rollout, suffer from…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Junyi Ouyang , Wenbin Teng , Gonglin Chen , Yajie Zhao , Haiwei Chen

Learned image compression methods have shown impressive performance but are often highly specialized for either human perception or specific machine vision tasks. This specialization limits their versatility and requires costly retraining…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Jinming Liu , Yuntao Wei , Junyan Lin , Shengyang Zhao , Heming Sun , Zhibo Chen , Wenjun Zeng , Xin Jin

Learned image reconstruction techniques using deep neural networks have recently gained popularity, and have delivered promising empirical results. However, most approaches focus on one single recovery for each observation, and thus neglect…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Chen Zhang , Riccardo Barbano , Bangti Jin

Autonomous vehicles increasingly rely on cameras to provide the input for perception and scene understanding and the ability of these models to classify their environment and objects, under adverse conditions and image noise is crucial.…

Computer Vision and Pattern Recognition · Computer Science 2021-11-08 Andreas Papachristodoulou , Christos Kyrkou , Theocharis Theocharides

We introduce Calligrapher, a novel diffusion-based framework that innovatively integrates advanced text customization with artistic typography for digital calligraphy and design applications. Addressing the challenges of precise style…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Yue Ma , Qingyan Bai , Hao Ouyang , Ka Leong Cheng , Qiuyu Wang , Hongyu Liu , Zichen Liu , Haofan Wang , Jingye Chen , Yujun Shen , Qifeng Chen

In real-world machine learning deployments, models must be continually updated, composed, and when required, selectively undone. However, existing approaches to model merging and continual learning often suffer from task interference,…

Machine Learning · Computer Science 2026-04-14 Haris Khan , Sadia Asif , Shumaila Asif , Muhammad Zeeshan Karamat , Rajesh Upadhayaya

A persistent structural weakness in deep clustering is the disconnect between feature learning and cluster assignment. Most architectures invoke an external clustering step, typically k-means, to produce pseudo-labels that guide training,…

Machine Learning · Computer Science 2026-04-03 Giansalvo Cirrincione

Autoregressive (AR) visual generation has emerged as a powerful paradigm for image and multimodal synthesis, owing to its scalability and generality. However, existing AR image generation suffers from severe memory bottlenecks due to the…

Computer Vision and Pattern Recognition · Computer Science 2025-12-05 Ziran Qin , Youru Lv , Mingbao Lin , Zeren Zhang , Chanfan Gan , Tieyuan Chen , Weiyao Lin

We build on the Visual Autoregressive Modeling (VAR) framework and formulate style transfer as conditional discrete sequence modeling in a learned latent space. Images are decomposed into multi-scale representations and tokenized into…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Liqi Jing , Dingming Zhang , Peinian Li , Lichen Zhu , Yang Xu , Hanyu Xing

As multi-object tracking (MOT) tasks continue to evolve toward more general and multi-modal scenarios, the rigid and task-specific architectures of existing MOT methods increasingly hinder their applicability across diverse tasks and limit…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Lianjie Jia , Yuhan Wu , Binghao Ran , Yifan Wang , Lijun Wang , Huchuan Lu