中文
相关论文

相关论文: GigaTok: Scaling Visual Tokenizers to 3 Billion Pa…

200 篇论文

Generative linguistic steganography (GLS) enables covert communication by embedding secret messages into the natural language generation process. In practical deployment, however, GLS is vulnerable to tokenization ambiguity: the same…

密码学与安全 · 计算机科学 2026-04-29 Yaofei Wang , Rui Wang , Weilong Pang , JiaLiang Han , Yuan Qi , Donghui Hu , Kejiang Chen

Autoregressive models with continuous tokens form a promising paradigm for visual generation, especially for text-to-image (T2I) synthesis, but they suffer from high computational cost. We study how to design compute-efficient linear…

计算机视觉与模式识别 · 计算机科学 2026-02-02 Jiahao Wang , Ting Pan , Haoge Deng , Dongchen Han , Taiqiang Wu , Xinlong Wang , Ping Luo

Efficiently representing audio signals in a compressed latent space is critical for latent generative modelling. However, existing autoencoders often force a choice between continuous embeddings and discrete tokens. Furthermore, achieving…

声音 · 计算机科学 2025-09-15 Marco Pasini , Stefan Lattner , George Fazekas

Vision-language large models are moving toward the unification of visual understanding and visual generation tasks. However, whether generation can enhance understanding is still under-explored on large data scale. In this work, we analysis…

计算与语言 · 计算机科学 2026-01-01 Fengjiao Chen , Minhao Jing , Weitao Lu , Yan Feng , Xiaoyu Li , Xuezhi Cao

Recent advances in generative deep learning have enabled the creation of high-quality synthetic images in text-to-image generation. Prior work shows that fine-tuning a pretrained diffusion model on ImageNet and generating synthetic training…

计算机视觉与模式识别 · 计算机科学 2025-01-22 Zhuoran Yu , Chenchen Zhu , Sean Culatana , Raghuraman Krishnamoorthi , Fanyi Xiao , Yong Jae Lee

Generative adversarial networks (GANs) have achieved great success in image translation and manipulation. However, high-fidelity image generation with faithful style control remains a grand challenge in computer vision. This paper presents…

计算机视觉与模式识别 · 计算机科学 2022-07-25 Fangneng Zhan , Yingchen Yu , Rongliang Wu , Jiahui Zhang , Kaiwen Cui , Aoran Xiao , Shijian Lu , Chunyan Miao

The image tokenizer is a critical component in AR image generation, as it determines how rich and structured visual content is encoded into compact representations. Existing quantization-based tokenizers such as VQ-GAN primarily focus on…

计算机视觉与模式识别 · 计算机科学 2025-08-21 Yiang Shi , Xiaoyang Guo , Wei Yin , Mingkai Jia , Qian Zhang , Xiaolin Hu , Wenyu Liu , Xinggang Wang

Autoregressive (AR) visual generation has emerged as a powerful paradigm for image and multimodal synthesis, owing to its scalability and generality. However, existing AR image generation suffers from severe memory bottlenecks due to the…

计算机视觉与模式识别 · 计算机科学 2025-12-05 Ziran Qin , Youru Lv , Mingbao Lin , Zeren Zhang , Chanfan Gan , Tieyuan Chen , Weiyao Lin

Image tokenizers play a central role in modern generative models, where the structure of the latent space critically determines the downstream generation performance. A key but underexplored property of effective latent representations is…

计算机视觉与模式识别 · 计算机科学 2026-05-20 Jinsung Lee , Jaemin Oh , Namhun Kim , Dongwon Kim , Byung-Jun Yoon , Suha Kwak

Image Super-Resolution (ISR) has seen significant progress with the introduction of remarkable generative models. However, challenges such as the trade-off issues between fidelity and realism, as well as computational complexity, have also…

计算机视觉与模式识别 · 计算机科学 2025-02-03 Yunpeng Qu , Kun Yuan , Jinhua Hao , Kai Zhao , Qizhi Xie , Ming Sun , Chao Zhou

Multimodal latent reasoning has emerged as a promising paradigm that replaces explicit Chain-of-Thought (CoT) decoding with implicit feature propagation, simultaneously enhancing representation informativeness and reducing inference…

计算机视觉与模式识别 · 计算机科学 2026-05-13 Yudong Han , Yong Wang , Zaiquan Yang , Zhen Qu , Liyuan Pan , Xiangxiang Chu

Unified Multimodal Large Language Models (MLLMs) require a visual representation that simultaneously supports high-fidelity reconstruction, complex semantic extraction, and generative suitability. However, existing visual tokenizers…

计算机视觉与模式识别 · 计算机科学 2026-03-12 Shaobin Zhuang , Yuang Ai , Jiaming Han , Weijia Mao , Xiaohui Li , Fangyikang Wang , Xiao Wang , Yan Li , Shanchuan Lin , Kun Xu , Zhenheng Yang , Huaibo Huang , Xiangyu Yue , Hao Chen , Yali Wang

Real-time transmission of video over wireless networks remains highly challenging, even with advanced deep models, particularly under severe channel conditions such as limited bandwidth and weak connectivity. In this paper, we propose…

信息论 · 计算机科学 2025-10-30 Zhenyu Liu , Yi Ma , Rahim Tafazolli , Zhi Ding

Latent generative models have shown remarkable progress in high-fidelity image synthesis, typically using a two-stage training process that involves compressing images into latent embeddings via learned tokenizers in the first stage. The…

计算机视觉与模式识别 · 计算机科学 2025-09-12 Tejaswini Medi , Hsien-Yi Wang , Arianna Rampini , Margret Keuper

Chain of Thought (CoT) reasoning enhances logical performance by decomposing complex tasks, yet its multimodal extension faces a trade-off. The prevailing Thinking with Images paradigm achieves visual refocusing by explicitly cropping image…

计算机视觉与模式识别 · 计算机科学 2026-05-27 Jizheng Ma , Xiaofei Zhou , Geyuan Zhang , Yanlong Song , Han Yan

Unifying multimodal understanding, generation and reconstruction representation in a single tokenizer remains a key challenge in building unified models. Previous research predominantly attempts to address this in a dual encoder paradigm,…

计算机视觉与模式识别 · 计算机科学 2025-12-01 Sinan Du , Jiahao Guo , Bo Li , Shuhao Cui , Zhengzhuo Xu , Yifu Luo , Yongxian Wei , Kun Gai , Xinggang Wang , Kai Wu , Chun Yuan

Masked-based autoregressive models have demonstrated promising image generation capability in continuous space. However, their potential for video generation remains under-explored. In this paper, we propose \textbf{VideoMAR}, a concise and…

计算机视觉与模式识别 · 计算机科学 2025-06-19 Hu Yu , Biao Gong , Hangjie Yuan , DanDan Zheng , Weilong Chai , Jingdong Chen , Kecheng Zheng , Feng Zhao

Multimodal Large Language Models (MLLMs) have demonstrated substantial value in unified text-image understanding and reasoning, primarily by converting images into sequences of patch-level tokens that align with their architectural…

计算机视觉与模式识别 · 计算机科学 2025-11-25 Xinliang Zhang , Lei Zhu , Hangzhou He , Shuang Zeng , Ourui Fu , Jiakui Hu , Zhengjian Yao , Yanye Lu

Multimodal large language models (MLLMs) have made significant advancements in vision understanding and reasoning. However, the autoregressive Transformer architecture used by MLLMs requries tokenization on input images, which limits their…

计算机视觉与模式识别 · 计算机科学 2026-05-05 Xiangxuan Ren , Zhongdao Wang , Liping Hou , Pin Tang , Guoqing Wang , Chao Ma

Autoregressive (AR) modeling has achieved remarkable success in natural language processing by enabling models to generate text with coherence and contextual understanding through next token prediction. Recently, in image generation, VAR…

计算机视觉与模式识别 · 计算机科学 2024-12-20 Sucheng Ren , Qihang Yu , Ju He , Xiaohui Shen , Alan Yuille , Liang-Chieh Chen