English
Related papers

Related papers: StyleAR: Customizing Multimodal Autoregressive Mod…

200 papers

Fine-grained text-to-image retrieval aims to retrieve a fine-grained target image with a given text query. Existing methods typically assume that each training image is accurately depicted by its textual descriptions. However, textual…

Computer Vision and Pattern Recognition · Computer Science 2025-04-11 Zehong Ma , Hao Chen , Wei Zeng , Limin Su , Shiliang Zhang

Image stylization aims at applying a reference style to arbitrary input images. A common scenario is one-shot stylization, where only one example is available for each reference style. Recent approaches for one-shot stylization such as…

Computer Vision and Pattern Recognition · Computer Science 2023-04-24 Viraj Shah , Ayush Sarkar , Sudharsan Krishnakumar Anitha , Svetlana Lazebnik

We propose a fast feed-forward network for arbitrary style transfer, which can generate stylized image for previously unseen content and style image pairs. Besides the traditional content and style representation based on deep features and…

Computer Vision and Pattern Recognition · Computer Science 2019-04-16 Zheng Xu , Michael Wilber , Chen Fang , Aaron Hertzmann , Hailin Jin

Visual content creation has spurred a soaring interest given its applications in mobile photography and AR / VR. Style transfer and single-image 3D photography as two representative tasks have so far evolved independently. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2021-12-07 Fangzhou Mu , Jian Wang , Yicheng Wu , Yin Li

Personalized image generation aims to integrate user-provided concepts into text-to-image models, enabling the generation of customized content based on a given prompt. Recent zero-shot approaches, particularly those leveraging diffusion…

Computer Vision and Pattern Recognition · Computer Science 2025-05-29 Yiheng Lin , Shifang Zhao , Ting Liu , Xiaochao Qu , Luoqi Liu , Yao Zhao , Yunchao Wei

The success of autoregressive (AR) language models in text generation has inspired the computer vision community to adopt Large Language Models (LLMs) for image generation. However, considering the essential differences between text and…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Xuantong Liu , Shaozhe Hao , Xianbiao Qi , Tianyang Hu , Jun Wang , Rong Xiao , Yuan Yao

Subject-driven text-to-image diffusion models empower users to tailor the model to new concepts absent in the pre-training dataset using a few sample images. However, prevalent subject-driven models primarily rely on single-concept input…

Computer Vision and Pattern Recognition · Computer Science 2024-02-16 Junjie Shentu , Matthew Watson , Noura Al Moubayed

Customization of text-to-image models enables users to insert new concepts or objects and generate them in unseen settings. Existing methods either rely on comparatively expensive test-time optimization or train encoders on single-image…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Nupur Kumari , Xi Yin , Jun-Yan Zhu , Ishan Misra , Samaneh Azadi

Recent advances in text-to-image models have enabled a new era of creative and controllable image generation. However, generating compositional scenes with multiple subjects and attributes remains a significant challenge. To enhance user…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Shivank Saxena , Dhruv Srivastava , Makarand Tapaswi

Most of the existing works on image description focus on generating expressive descriptions. The only few works that are dedicated to generating stylish (e.g., romantic, lyric, etc.) descriptions suffer from limited style variation and…

Computer Vision and Pattern Recognition · Computer Science 2018-09-18 Cheng Kuan Chen , Zhu Feng Pan , Min Sun , Ming-Yu Liu

Autoregressive (AR) models excel at generating temporally coherent audio by producing tokens sequentially, yet they often falter in faithfully following complex textual prompts, especially those describing complex sound events. We uncover a…

Computation and Language · Computer Science 2026-01-22 Juncheng Wang , Zhe Hu , Chao Xu , Siyue Ren , Yuxiang Feng , Yang Liu , Baigui Sun , Shujun Wang

We present the Pathways Autoregressive Text-to-Image (Parti) model, which generates high-fidelity photorealistic images and supports content-rich synthesis involving complex compositions and world knowledge. Parti treats text-to-image…

Recent studies have shown remarkable success in the unsupervised image to image (I2I) translation. However, due to the imbalance in the data, learning joint distribution for various domains is still very challenging. Although existing…

Computer Vision and Pattern Recognition · Computer Science 2021-06-24 Jihye Back

With the success of autoregressive learning in large language models, it has become a dominant approach for text-to-image generation, offering high efficiency and visual quality. However, invisible watermarking for visual autoregressive…

Multimedia · Computer Science 2025-03-17 Ziyi Wang , Songbai Tan , Gang Xu , Xuerui Qiu , Hongbin Xu , Xin Meng , Ming Li , Fei Richard Yu

In this work, we present a new framework for the stylization of text-based binary images. First, our method stylizes the stroke-based geometric shape like text, symbols and icons in the target binary image based on an input style image.…

Computer Vision and Pattern Recognition · Computer Science 2018-11-14 Shuai Yang , Jiaying Liu , Wenhan Yang , Zongming Guo

Text-style transfer aims to convert text given in one domain into another by paraphrasing the sentence or substituting the keywords without altering the content. By necessity, state-of-the-art methods have evolved to accommodate nonparallel…

Computation and Language · Computer Science 2021-06-22 Xing Han , Jessica Lundin

Recently, text-to-image diffusion models have been widely used for style mimicry and personalized customization through methods such as DreamBooth and Textual Inversion. This has raised concerns about intellectual property protection and…

Computer Vision and Pattern Recognition · Computer Science 2025-10-31 Yanjie Li , Wenxuan Zhang , Xinqi Lyu , Yihao Liu , Bin Xiao

The field of advanced text-to-image generation is witnessing the emergence of unified frameworks that integrate powerful text encoders, such as CLIP and T5, with Diffusion Transformer backbones. Although there have been efforts to control…

Computer Vision and Pattern Recognition · Computer Science 2025-02-28 Liang Chen , Shuai Bai , Wenhao Chai , Weichu Xie , Haozhe Zhao , Leon Vinci , Junyang Lin , Baobao Chang

Recent advances in subject-driven image generation using diffusion models have attracted considerable attention for their remarkable capabilities in producing high-quality images. Nevertheless, the potential of Visual Autoregressive (VAR)…

Computer Vision and Pattern Recognition · Computer Science 2026-02-02 Xin Jiang , Jingwen Chen , Yehao Li , Yingwei Pan , Kezhou Chen , Zechao Li , Ting Yao , Tao Mei

Cross-modal fashion image synthesis has emerged as one of the most promising directions in the generation domain due to the vast untapped potential of incorporating multiple modalities and the wide range of fashion image applications. To…

Computer Vision and Pattern Recognition · Computer Science 2022-08-12 Xujie Zhang , Yu Sha , Michael C. Kampffmeyer , Zhenyu Xie , Zequn Jie , Chengwen Huang , Jianqing Peng , Xiaodan Liang