中文
相关论文

相关论文: X-Omni: Reinforcement Learning Makes Discrete Auto…

200 篇论文

Autoregressive generative models of images tend to be biased towards capturing local structure, and as a result they often produce samples which are lacking in terms of large-scale coherence. To address this, we propose two methods to learn…

计算机视觉与模式识别 · 计算机科学 2019-10-09 Jeffrey De Fauw , Sander Dieleman , Karen Simonyan

Recent advances in text-to-image generation have produced strong single-shot models, yet no individual system reliably executes the long, compositional prompts typical of creative workflows. We introduce Image-POSER, a reflective…

计算机视觉与模式识别 · 计算机科学 2025-11-18 Hossein Mohebbi , Mohammed Abdulrahman , Yanting Miao , Pascal Poupart , Suraj Kothawade

Recent progress in image generation models (IGMs) enables high-fidelity content creation but also amplifies risks, including the reproduction of copyrighted content and the generation of offensive content. Image Generation Model Unlearning…

计算机视觉与模式识别 · 计算机科学 2026-03-18 Yong Zou , Haoran Li , Fanxiao Li , Shenyang Wei , Yunyun Dong , Li Tang , Wei Zhou , Renyang Liu

Image tokenizers are crucial for visual generative models, e.g., diffusion models (DMs) and autoregressive (AR) models, as they construct the latent representation for modeling. Increasing token length is a common approach to improve the…

计算机视觉与模式识别 · 计算机科学 2024-12-05 Xiang Li , Kai Qiu , Hao Chen , Jason Kuen , Jiuxiang Gu , Bhiksha Raj , Zhe Lin

The rapid evolution of image generation models has revolutionized visual content creation, enabling the synthesis of highly realistic and contextually accurate images for diverse applications. However, the potential for misuse, such as…

计算机视觉与模式识别 · 计算机科学 2025-06-16 Yihan Wu , Xuehao Cui , Ruibo Chen , Georgios Milis , Heng Huang

Text-to-image diffusion models are typically trained to optimize the log-likelihood objective, which presents challenges in meeting specific requirements for downstream tasks, such as image aesthetics and image-text alignment. Recent…

计算机视觉与模式识别 · 计算机科学 2024-07-18 Chaofeng Chen , Annan Wang , Haoning Wu , Liang Liao , Wenxiu Sun , Qiong Yan , Weisi Lin

Inspired by the success of reinforcement learning (RL) in refining large language models (LLMs), we propose AR-GRPO, an approach to integrate online RL training into autoregressive (AR) image generation models. We adapt the Group Relative…

计算机视觉与模式识别 · 计算机科学 2025-08-12 Shihao Yuan , Yahui Liu , Yang Yue , Jingyuan Zhang , Wangmeng Zuo , Qi Wang , Fuzheng Zhang , Guorui Zhou

Autoregressive (AR) image generators offer a language-model-friendly approach to image generation by predicting discrete image tokens in a causal sequence. However, unlike diffusion models, AR models lack a mechanism to refine previous…

计算机视觉与模式识别 · 计算机科学 2026-01-29 Cheng Cheng , Lin Song , Di An , Yicheng Xiao , Xuchong Zhang , Hongbin Sun , Ying Shan

Accurately controlling object count in text-to-image generation remains a key challenge. Supervised methods often fail, as training data rarely covers all count variations. Methods that manipulate the denoising process to add or remove…

计算机视觉与模式识别 · 计算机科学 2025-06-06 Oz Zafar , Yuval Cohen , Lior Wolf , Idan Schwartz

In the domain of image generation, latent-based generative models occupy a dominant status; however, these models rely heavily on image tokenizer. To meet modeling requirements, autoregressive models possessing the characteristics of…

计算机视觉与模式识别 · 计算机科学 2025-03-24 Panpan Wang , Liqiang Niu , Fandong Meng , Jinan Xu , Yufeng Chen , Jie Zhou

Multimodal text-to-image generation remains constrained by the difficulty of maintaining semantic alignment and professional-level detail across diverse visual domains. We propose a multi-agent reinforcement learning framework that…

人工智能 · 计算机科学 2025-10-14 Jiabao Shi , Minfeng Qi , Lefeng Zhang , Di Wang , Yingjie Zhao , Ziying Li , Yalong Xing , Ningran Li

With the rapid advancement of commercial multi-modal models, image editing has garnered significant attention due to its widespread applicability in daily life. Despite impressive progress, existing image editing systems, particularly…

计算机视觉与模式识别 · 计算机科学 2026-03-10 Yiran Zhao , Yaoqi Ye , Xiang Liu , Michael Qizhe Shieh , Trung Bui

The field of advanced text-to-image generation is witnessing the emergence of unified frameworks that integrate powerful text encoders, such as CLIP and T5, with Diffusion Transformer backbones. Although there have been efforts to control…

计算机视觉与模式识别 · 计算机科学 2025-02-28 Liang Chen , Shuai Bai , Wenhao Chai , Weichu Xie , Haozhe Zhao , Leon Vinci , Junyang Lin , Baobao Chang

Watermarking the outputs of generative models has emerged as a promising approach for tracking their provenance. Despite significant interest in autoregressive image generation models and their potential for misuse, no prior work has…

机器学习 · 计算机科学 2025-10-24 Nikola Jovanović , Ismail Labiad , Tomáš Souček , Martin Vechev , Pierre Fernandez

The success of autoregressive (AR) language models in text generation has inspired the computer vision community to adopt Large Language Models (LLMs) for image generation. However, considering the essential differences between text and…

计算机视觉与模式识别 · 计算机科学 2024-10-22 Xuantong Liu , Shaozhe Hao , Xianbiao Qi , Tianyang Hu , Jun Wang , Rong Xiao , Yuan Yao

In this work, we present VARGPT-v1.1, an advanced unified visual autoregressive model that builds upon our previous framework VARGPT. The model preserves the dual paradigm of next-token prediction for visual understanding and next-scale…

计算机视觉与模式识别 · 计算机科学 2025-04-07 Xianwei Zhuang , Yuxin Xie , Yufan Deng , Dongchao Yang , Liming Liang , Jinghan Ru , Yuguo Yin , Yuexian Zou

Language-guided image generation has achieved great success nowadays by using diffusion models. However, texts can be less detailed to describe highly-specific subjects such as a particular dog or a certain car, which makes pure…

计算机视觉与模式识别 · 计算机科学 2023-03-17 Yiyang Ma , Huan Yang , Wenjing Wang , Jianlong Fu , Jiaying Liu

Autoregressive (AR) models, long dominant in language generation, are increasingly applied to image synthesis but are often considered less competitive than Diffusion-based models. A primary limitation is the substantial number of image…

Recent progress in controllable image generation and editing is largely driven by diffusion-based methods. Although diffusion models perform exceptionally well in specific tasks with tailored designs, establishing a unified model is still…

计算机视觉与模式识别 · 计算机科学 2025-01-09 Jiteng Mu , Nuno Vasconcelos , Xiaolong Wang

Image-based single-modality compression learning approaches have demonstrated exceptionally powerful encoding and decoding capabilities in the past few years , but suffer from blur and severe semantics loss at extremely low bitrates. To…

图像与视频处理 · 电气工程与系统科学 2023-04-27 Xuhao Jiang , Weimin Tan , Tian Tan , Bo Yan , Liquan Shen