English
Related papers

Related papers: Co-Me: Confidence-Guided Token Merging for Visual …

200 papers

Recently, Vector Quantized AutoRegressive (VQ-AR) models have shown remarkable results in text-to-image synthesis by equally predicting discrete image tokens from the top left to bottom right in the latent space. Although the simple…

Computer Vision and Pattern Recognition · Computer Science 2023-09-21 Zhengcong Fei , Mingyuan Fan , Li Zhu , Junshi Huang

Latent generative models are increasingly shifting from traditional VAEs toward representation autoencoders and semantically aligned latent spaces, which lift images into higher-dimensional feature domains where semantic factors become more…

Optimization and Control · Mathematics 2025-12-02 Xu Duan , Dongmei Chen

As the scale of data and models for video understanding rapidly expand, handling long-form video input in transformer-based models presents a practical challenge. Rather than resorting to input sampling or token dropping, which may result…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Seon-Ho Lee , Jue Wang , Zhikang Zhang , David Fan , Xinyu Li

Transformers are widely applied to solve natural language understanding and computer vision tasks. While scaling up these architectures leads to improved performance, it often comes at the expense of much higher computational costs. In…

Computer Vision and Pattern Recognition · Computer Science 2022-02-25 Cedric Renggli , André Susano Pinto , Neil Houlsby , Basil Mustafa , Joan Puigcerver , Carlos Riquelme

Low-overhead visual place recognition (VPR) is a highly active research topic. Mobile robotics applications often operate under low-end hardware, and even more hardware capable systems can still benefit from freeing up onboard system…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Bruno Arcanjo , Bruno Ferrarini , Michael Milford , Klaus D. McDonald-Maier , Shoaib Ehsan

Recent advances in feature learning have shown that self-supervised vision foundation models can capture semantic correspondences but often lack awareness of underlying 3D geometry. GECO addresses this gap by producing geometrically…

Computer Vision and Pattern Recognition · Computer Science 2025-08-04 Regine Hartwig , Dominik Muhle , Riccardo Marin , Daniel Cremers

Although large-scale visual foundation models (VFMs) achieve remarkable performance in semantic understanding, they still underperform in instance-aware dense prediction tasks. They exhibit different biases in representation: for instance,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Yachan Guo , JoseLuis Gomez Zurita , Danna Xue , Yi Xiao , AntonioManuel Lopez Pena

Many adaptations of transformers have emerged to address the single-modal vision tasks, where self-attention modules are stacked to handle input sources like images. Intuitively, feeding multiple modalities of data to vision transformers…

Computer Vision and Pattern Recognition · Computer Science 2022-07-18 Yikai Wang , Xinghao Chen , Lele Cao , Wenbing Huang , Fuchun Sun , Yunhe Wang

Masked image modeling (MIM) has emerged as a promising approach for pre-training Vision Transformers (ViTs). MIMs predict masked tokens token-wise to recover target signals that are tokenized from images or generated by pre-trained models…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Taekyung Kim , Byeongho Heo , Dongyoon Han

High-resolution imagery is essential for accurate 3D reconstruction, as many geometric details only emerge at fine spatial scales. Recent feed-forward approaches, such as the Visual Geometry Grounded Transformer (VGGT), have demonstrated…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Tianrun Chen , Yuanqi Hu , Yidong Han , Hanjie Xu , Deyi Ji , Qi Zhu , Chunan Yu , Xin Zhang , Cheng Chen , Chaotao Ding , Ying Zang , Xuanfu Li , Jin Ma , Lanyun Zhu

Vision Transformers can achieve high accuracy and strong generalization across various contexts, but their practical applicability on real-world robotic systems is limited due to their quadratic attention complexity. Recent works have…

Computer Vision and Pattern Recognition · Computer Science 2026-05-04 Fabio Montello , Ronja Güldenring , Lazaros Nalpantidis

We present DyMU, an efficient, training-free framework that dynamically reduces the computational burden of vision-language models (VLMs) while maintaining high task performance. Our approach comprises two key components. First, Dynamic…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Zhenhailong Wang , Senthil Purushwalkam , Caiming Xiong , Silvio Savarese , Heng Ji , Ran Xu

Computer-Aided Design (CAD) is essential in industrial design, but the complexity of traditional CAD modeling and workflows presents significant challenges for automating the generation of high-precision, editable CAD models. Existing…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Ke Niu , Haiyang Yu , Zhuofan Chen , Zhengtao Yao , Weitao Jia , Xiaodong Ge , Jingqun Tang , Benlei Cui , Bin Li , Xiangyang Xue

In this paper, we introduce LightVLM, a simple but effective method that can be seamlessly deployed upon existing Vision-Language Models (VLMs) to greatly accelerate the inference process in a training-free manner. We divide the inference…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Lianyu Hu , Fanhua Shang , Wei Feng , Liang Wan

Achieving human-like reasoning in deep learning models for complex tasks in unknown environments remains a critical challenge in embodied intelligence. While advanced vision-language models (VLMs) excel in static scene understanding, their…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Jinzhou Tang , Jusheng zhang , Sidi Liu , Waikit Xiu , Qinhan Lv , Xiying Li

Mixup is a commonly adopted data augmentation technique for image classification. Recent advances in mixup methods primarily focus on mixing based on saliency. However, many saliency detectors require intense computation and are especially…

Computer Vision and Pattern Recognition · Computer Science 2022-10-17 Hyeong Kyu Choi , Joonmyung Choi , Hyunwoo J. Kim

Estimating 3D hand pose from monocular RGB images is fundamental for applications in AR/VR, human-computer interaction, and sign language understanding. In this work we focus on a scenario where a discrete set of gesture labels is available…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Rui Hong , Jana Kosecka

Masked image generation (MIG) has demonstrated remarkable efficiency and high-fidelity images by enabling parallel token prediction. Existing methods typically rely solely on the model itself to learn semantic dependencies among visual…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Guotao Liang , Baoquan Zhang , Zhiyuan Wen , Zihao Han , Yunming Ye

Predicting effective thermal conductivity by solving a Partial Differential Equation (PDE) defined on a high-resolution Representative Volume Element (RVE) is a computationally intensive task. In this paper, we tackle the task by proposing…

Numerical Analysis · Mathematics 2024-04-04 Changqing Ye , Shubin Fu , Eric T. Chung

The dominant paradigm for high-fidelity 3D generation relies on a VAE-Diffusion pipeline, where the VAE's reconstruction capability sets a firm upper bound on generation quality. A fundamental challenge limiting existing VAEs is the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Guan Luo , Xiu Li , Rui Chen , Xuanyu Yi , Jing Lin , Chia-Hao Chen , Jiahang Liu , Song-Hai Zhang , Jianfeng Zhang