English
Related papers

Related papers: Highly Compressed Tokenizer Can Generate Without T…

200 papers

Recent deep generative models are able to provide photo-realistic images as well as visual or textual content embeddings useful to address various tasks of computer vision and natural language processing. Their usefulness is nevertheless…

Machine Learning · Computer Science 2020-01-29 Antoine Plumerault , Hervé Le Borgne , Céline Hudelot

Synthetic images rendered by graphics engines are a promising source for training deep networks. However, it is challenging to ensure that they can help train a network to perform well on real images, because a graphics-based generation…

Computer Vision and Pattern Recognition · Computer Science 2020-04-28 Dawei Yang , Jia Deng

Computer vision has achieved remarkable success by (a) representing images as uniformly-arranged pixel arrays and (b) convolving highly-localized features. However, convolutions treat all image pixels equally regardless of importance;…

Computer Vision and Pattern Recognition · Computer Science 2020-11-23 Bichen Wu , Chenfeng Xu , Xiaoliang Dai , Alvin Wan , Peizhao Zhang , Zhicheng Yan , Masayoshi Tomizuka , Joseph Gonzalez , Kurt Keutzer , Peter Vajda

Token compression is essential for reducing the computational and memory requirements of transformer models, enabling their deployment in resource-constrained environments. In this work, we propose an efficient and hardware-compatible token…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Junzhu Mao , Yang Shen , Jinyang Guo , Yazhou Yao , Xiansheng Hua

A range of recent works addresses the problem of compression of sequence of tokens into a shorter sequence of real-valued vectors to be used as inputs instead of token embeddings or key-value cache. These approaches are focused on reduction…

Computation and Language · Computer Science 2025-06-24 Yuri Kuratov , Mikhail Arkhipov , Aydar Bulatov , Mikhail Burtsev

Modern Latent Diffusion Models (LDMs) typically operate in low-level Variational Autoencoder (VAE) latent spaces that are primarily optimized for pixel-level reconstruction. To unify vision generation and understanding, a burgeoning trend…

Computer Vision and Pattern Recognition · Computer Science 2025-12-22 Shilong Zhang , He Zhang , Zhifei Zhang , Chongjian Ge , Shuchen Xue , Shaoteng Liu , Mengwei Ren , Soo Ye Kim , Yuqian Zhou , Qing Liu , Daniil Pakhomov , Kai Zhang , Zhe Lin , Ping Luo

Convolutional neural networks are able to learn realistic image priors from numerous training samples in low-level image generation and restoration. We show that, for high-level image recognition tasks, we can further reconstruct…

Computer Vision and Pattern Recognition · Computer Science 2021-01-22 Xiangyu He , Qinghao Hu , Peisong Wang , Jian Cheng

Generative transformers have experienced rapid popularity growth in the computer vision community in synthesizing high-fidelity and high-resolution images. The best generative transformer models so far, however, still treat an image naively…

Computer Vision and Pattern Recognition · Computer Science 2022-02-10 Huiwen Chang , Han Zhang , Lu Jiang , Ce Liu , William T. Freeman

Text-to-video generation poses significant challenges due to the inherent complexity of video data, which spans both temporal and spatial dimensions. It introduces additional redundancy, abrupt variations, and a domain gap between language…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Ziqin Zhou , Yifan Yang , Yuqing Yang , Tianyu He , Houwen Peng , Kai Qiu , Qi Dai , Lili Qiu , Chong Luo , Lingqiao Liu

Tokenizers are a key component of state-of-the-art generative image models, extracting the most important features from the signal while reducing data dimension and redundancy. Most current tokenizers are based on KL-regularized variational…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Théophane Vallaeys , Jakob Verbeek , Matthieu Cord

We propose V2Flow, a novel tokenizer that produces discrete visual tokens capable of high-fidelity reconstruction, while ensuring structural and latent distribution alignment with the vocabulary space of large language models (LLMs).…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Guiwei Zhang , Tianyu Zhang , Mohan Zhou , Yalong Bai , Biye Li

Vision-language models like CLIP can offer a promising foundation for 3D scene understanding when extended with 3D tokenizers. However, standard approaches, such as k-nearest neighbor or radius-based tokenization, struggle with cross-domain…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Guofeng Mei , Bin Ren , Juan Liu , Luigi Riz , Xiaoshui Huang , Xu Zheng , Yongshun Gong , Ming-Hsuan Yang , Nicu Sebe , Fabio Poiesi

Large language model (LLM) tokenizers act as structured compressors: by mapping text to discrete token sequences, they determine token count (and thus compute and context usage) and the statistical structure seen by downstream models.…

Information Theory · Computer Science 2026-01-15 Mete Erdogan , Abhiram Gorle , Shubham Chandak , Mert Pilanci , Tsachy Weissman

In generative modeling, tokenization simplifies complex data into compact, structured representations, creating a more efficient, learnable space. For high-dimensional visual data, it reduces redundancy and emphasizes key features for…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Long Zhao , Sanghyun Woo , Ziyu Wan , Yandong Li , Han Zhang , Boqing Gong , Hartwig Adam , Xuhui Jia , Ting Liu

Traditional cartoon and anime production involves keyframing, inbetweening, and colorization stages, which require intensive manual effort. Despite recent advances in AI, existing methods often handle these stages separately, leading to…

Computer Vision and Pattern Recognition · Computer Science 2025-08-15 Lingen Li , Guangzhi Wang , Zhaoyang Zhang , Yaowei Li , Xiaoyu Li , Qi Dou , Jinwei Gu , Tianfan Xue , Ying Shan

Token merging can effectively accelerate various vision systems by processing groups of similar tokens only once and sharing the results across them. However, existing token grouping methods are often ad hoc and random, disregarding the…

Computer Vision and Pattern Recognition · Computer Science 2025-04-28 Haoyu Wu , Jingyi Xu , Hieu Le , Dimitris Samaras

Tokenizers are crucial for encoding information in Large Language Models, but their development has recently stagnated, and they contain inherent weaknesses. Major limitations include computational overhead, ineffective vocabulary use, and…

Computation and Language · Computer Science 2025-01-08 Björn Deiseroth , Manuel Brack , Patrick Schramowski , Kristian Kersting , Samuel Weinbach

This paper describes a novel approach for on demand volumetric texture synthesis based on a deep learning framework that allows for the generation of high quality 3D data at interactive rates. Based on a few example images of textures, a…

Graphics · Computer Science 2020-01-15 Jorge Gutierrez , Julien Rabin , Bruno Galerne , Thomas Hurtut

Recent advances in the field of generative models and in particular generative adversarial networks (GANs) have lead to substantial progress for controlled image editing, especially compared with the pre-deep learning era. Despite their…

Computer Vision and Pattern Recognition · Computer Science 2023-12-14 Gwilherm Lesné , Yann Gousseau , Saïd Ladjal , Alasdair Newson

Current 3D tokenizers largely treat representation as spatial compression: compact codes reconstruct surface geometry, but leave component ownership and attachment validity implicit. In open-world assets with intersecting components, noisy…

Machine Learning · Computer Science 2026-05-12 Xiang Chen , Alexander Binder
‹ Prev 1 4 5 6 7 8 10 Next ›