English
Related papers

Related papers: Revolutionizing Text-to-Image Retrieval as Autoreg…

200 papers

Diffusion based video generation has received extensive attention and achieved considerable success within both the academic and industrial communities. However, current efforts are mainly concentrated on single-objective or single-task…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Ludan Ruan , Lei Tian , Chuanwei Huang , Xu Zhang , Xinyan Xiao

Text-to-image generative models often reflect the biases of the training data, leading to unequal representations of underrepresented groups. This study investigates inclusive text-to-image generative models that generate images based on…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Cheng Zhang , Xuanbai Chen , Siqi Chai , Chen Henry Wu , Dmitry Lagun , Thabo Beeler , Fernando De la Torre

In the field of computer vision, multimodal image generation has become a research hotspot, especially the task of integrating text, image, and style. In this study, we propose a multimodal image generation method based on Generative…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Chaoyi Tan , Wenqing Zhang , Zhen Qi , Kowei Shih , Xinshi Li , Ao Xiang

Autoregressive (AR) visual generation has achieved remarkable performance but suffers from high memory usage and low throughput, as it requires caching previously generated visual tokens. Recent research has shown that retaining only a few…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Guotao Liang , Baoquan Zhang , Zhiyuan Wen , Yunming Ye

Autoregressive Transformer models have demonstrated impressive performance in video generation, but their sequential token-by-token decoding process poses a major bottleneck, particularly for long videos represented by tens of thousands of…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Yang Ye , Junliang Guo , Haoyu Wu , Tianyu He , Tim Pearce , Tabish Rashid , Katja Hofmann , Jiang Bian

Recently, generative retrieval emerges as a promising alternative to traditional retrieval paradigms. It assigns each document a unique identifier, known as DocID, and employs a generative model to directly generate the relevant DocID for…

Information Retrieval · Computer Science 2024-04-16 Peitian Zhang , Zheng Liu , Yujia Zhou , Zhicheng Dou , Fangchao Liu , Zhao Cao

Vector quantization (VQ) is a key technique in high-resolution and high-fidelity image synthesis, which aims to learn a codebook to encode an image with a sequence of discrete codes and then generate an image in an auto-regression manner.…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Guotao Liang , Baoquan Zhang , Yaowei Wang , Xutao Li , Yunming Ye , Huaibin Wang , Chuyao Luo , Kola Ye , linfeng Luo

Text-to-image synthesis has recently seen significant progress thanks to large pretrained language models, large-scale training data, and the introduction of scalable model families such as diffusion and autoregressive models. However, the…

Machine Learning · Computer Science 2023-01-24 Axel Sauer , Tero Karras , Samuli Laine , Andreas Geiger , Timo Aila

We propose a text-guided variational image generation method to address the challenge of getting clean data for anomaly detection in industrial manufacturing. Our method utilizes text information about the target object, learned from…

Computer Vision and Pattern Recognition · Computer Science 2024-03-27 Mingyu Lee , Jongwon Choi

Recent works on personalized text-to-image generation usually learn to bind a special token with specific subjects or styles of a few given images by tuning its embedding through gradient descent. It is natural to question whether we can…

Computer Vision and Pattern Recognition · Computer Science 2023-04-13 Zhengcong Fei , Mingyuan Fan , Junshi Huang

With the success of autoregressive learning in large language models, it has become a dominant approach for text-to-image generation, offering high efficiency and visual quality. However, invisible watermarking for visual autoregressive…

Multimedia · Computer Science 2025-03-17 Ziyi Wang , Songbai Tan , Gang Xu , Xuerui Qiu , Hongbin Xu , Xin Meng , Ming Li , Fei Richard Yu

Synthesizing high-quality realistic images from text descriptions is a challenging task. Existing text-to-image Generative Adversarial Networks generally employ a stacked architecture as the backbone yet still remain three flaws. First, the…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Ming Tao , Hao Tang , Fei Wu , Xiao-Yuan Jing , Bing-Kun Bao , Changsheng Xu

The success of autoregressive (AR) language models in text generation has inspired the computer vision community to adopt Large Language Models (LLMs) for image generation. However, considering the essential differences between text and…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Xuantong Liu , Shaozhe Hao , Xianbiao Qi , Tianyang Hu , Jun Wang , Rong Xiao , Yuan Yao

Recently, with the rapid advancements of generative models, the field of visual text generation has witnessed significant progress. However, it is still challenging to render high-quality text images in real-world scenarios, as three…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Yuanzhi Zhu , Jiawei Liu , Feiyu Gao , Wenyu Liu , Xinggang Wang , Peng Wang , Fei Huang , Cong Yao , Zhibo Yang

Interest in image-to-image translation has grown substantially in recent years with the success of unsupervised models based on the cycle-consistency assumption. The achievements of these models have been limited to a particular subset of…

Computer Vision and Pattern Recognition · Computer Science 2019-02-27 Matthew Amodio , Smita Krishnaswamy

Autoregressive models have recently shown great promise in visual generation by leveraging discrete token sequences akin to language modeling. However, existing approaches often suffer from inefficiency, either due to token-by-token…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Ruiqing Yang , Kaixin Zhang , Zheng Zhang , Shan You , Tao Huang

In this paper, we present a neat yet effective transformer-based framework for visual grounding, namely TransVG, to address the task of grounding a language query to the corresponding region onto an image. The state-of-the-art methods,…

Computer Vision and Pattern Recognition · Computer Science 2022-01-17 Jiajun Deng , Zhengyuan Yang , Tianlang Chen , Wengang Zhou , Houqiang Li

Open-vocabulary object detection (OVD) requires solid modeling of the region-semantic relationship, which could be learned from massive region-text pairs. However, such data is limited in practice due to significant annotation costs. In…

Computer Vision and Pattern Recognition · Computer Science 2024-05-31 Fangyi Chen , Han Zhang , Zhantao Yang , Hao Chen , Kai Hu , Marios Savvides

Audio-Visual Segmentation (AVS) aims to segment sound-producing objects in video frames based on the associated audio signal. Prevailing AVS methods typically adopt an audio-centric Transformer architecture, where object queries are derived…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Shaofei Huang , Rui Ling , Tianrui Hui , Hongyu Li , Xu Zhou , Shifeng Zhang , Si Liu , Richang Hong , Meng Wang

Electroencephalogram (EEG) signals have become a popular medium for decoding visual information due to their cost-effectiveness and high temporal resolution. However, current approaches face significant challenges in bridging the modality…

Machine Learning · Computer Science 2026-03-10 Sicheng Dai , Hongwang Xiao , Shan Yu , Qiwei Ye