English
Related papers

Related papers: Image-Specific Adaptation of Transformer Encoders …

200 papers

An increasing share of captured images and videos are transmitted for storage and remote analysis by computer vision algorithms, rather than to be viewed by humans. Contrary to traditional standard codecs with engineered tools, neural…

Computer Vision and Pattern Recognition · Computer Science 2021-03-09 Lahiru D. Chamain , Fabien Racapé , Jean Bégaint , Akshay Pushparaja , Simon Feltman

Image compression constitutes a significant challenge amidst the era of information explosion. Recent studies employing deep learning methods have demonstrated the superior performance of learning-based image compression methods over…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Yuefeng Zhang , Kai Lin

Surface defect detection is an extremely crucial step to ensure the quality of industrial products. Nowadays, convolutional neural networks (CNNs) based on encoder-decoder architecture have achieved tremendous success in various defect…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Junpu Wang , Guili Xu , Fuju Yan , Jinjin Wang , Zhengsheng Wang

Transformers are widely used for solving tasks in natural language processing, computer vision, speech, and music domains. In this paper, we talk about the efficiency of transformers in terms of memory (the number of parameters),…

Computer Vision and Pattern Recognition · Computer Science 2023-02-27 Badri N. Patro , Vijay Srinivas Agneeswaran

This work introduces a Transformer-based image compression system. It has the flexibility to switch between the standard image reconstruction and the denoising reconstruction from a single compressed bitstream. Instead of training separate…

Image and Video Processing · Electrical Eng. & Systems 2024-02-21 Yi-Hsin Chen , Kuan-Wei Ho , Shiau-Rung Tsai , Guan-Hsun Lin , Alessandro Gnutti , Wen-Hsiao Peng , Riccardo Leonardi

Automatic segmentation of fine-grained brain structures remains a challenging task. Current segmentation methods mainly utilize 2D and 3D deep neural networks. The 2D networks take image slices as input to produce coarse segmentation in…

Computer Vision and Pattern Recognition · Computer Science 2019-05-08 Yuemeng Li , Hangfan Liu , Hongming Li , Yong Fan

Intrinsic image decomposition is an important and long-standing computer vision problem. Given an input image, recovering the physical scene properties is ill-posed. Several physically motivated priors have been used to restrict the…

Computer Vision and Pattern Recognition · Computer Science 2022-09-27 Zongji Wang , Yunfei Liu , Feng Lu

Deep learning has achieved remarkable success in medical image segmentation, often reaching expert-level accuracy in delineating tumors and tissues. However, most existing approaches remain task-specific, showing strong performance on…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Fares Bougourzi , Fadi Dornaika , Abdenour Hadid

Visual tokenization via auto-encoding empowers state-of-the-art image and video generative models by compressing pixels into a latent space. Although scaling Transformer-based generators has been central to recent advances, the tokenizer…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Philippe Hansen-Estruch , David Yan , Ching-Yao Chung , Orr Zohar , Jialiang Wang , Tingbo Hou , Tao Xu , Sriram Vishwanath , Peter Vajda , Xinlei Chen

The Transformer architecture has achieved significant success in natural language processing, motivating its adaptation to computer vision tasks. Unlike convolutional neural networks, vision transformers inherently capture long-range…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Zherui Zhang , Rongtao Xu , Jie Zhou , Changwei Wang , Xingtian Pei , Wenhao Xu , Jiguang Zhang , Li Guo , Longxiang Gao , Wenbo Xu , Shibiao Xu

Multi-scale architecture, including hierarchical vision transformer, has been commonly applied to high-resolution semantic segmentation to deal with computational complexity with minimum performance loss. In this paper, we propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2024-06-17 Jiwon Yoo , Jangwon Lee , Gyeonghwan Kim

In recent times, with the exception of sporadic cases, the trend in Computer Vision is to achieve minor improvements compared to considerable increases in complexity. To reverse this trend, we propose a novel method to boost image…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Antonio Bruno , Davide Moroni , Massimo Martinelli

Masked Image Modeling (MIM) has garnered significant attention in self-supervised learning, thanks to its impressive capacity to learn scalable visual representations tailored for downstream tasks. However, images inherently contain…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Wenzhao Xiang , Chang Liu , Hongyang Yu , Xilin Chen

Transformer-based trackers have achieved strong accuracy on the standard benchmarks. However, their efficiency remains an obstacle to practical deployment on both GPU and CPU platforms. In this paper, to overcome this issue, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2024-02-08 Yutao Cui , Tianhui Song , Gangshan Wu , Limin Wang

Many functional and structural neuroimaging studies call for accurate morphometric segmentation of different brain structures starting from image intensity values of MRI scans. Current automatic (multi-) atlas-based segmentation strategies…

Image and Video Processing · Electrical Eng. & Systems 2019-09-27 Dennis Bontempi , Sergio Benini , Alberto Signoroni , Michele Svanera , Lars Muckli

This paper explores improvements to the masked image modeling (MIM) paradigm. The MIM paradigm enables the model to learn the main object features of the image by masking the input image and predicting the masked part by the unmasked part.…

Computer Vision and Pattern Recognition · Computer Science 2022-05-24 Jiawei Mao , Xuesong Yin , Yuanqi Chang , Honggu Zhou

This work presents a simple vision transformer design as a strong baseline for object localization and instance segmentation tasks. Transformers recently demonstrate competitive performance in image classification tasks. To adopt ViT to…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Wuyang Chen , Xianzhi Du , Fan Yang , Lucas Beyer , Xiaohua Zhai , Tsung-Yi Lin , Huizhong Chen , Jing Li , Xiaodan Song , Zhangyang Wang , Denny Zhou

Modern vision backbones for 3D medical imaging typically process dense voxel grids through parameter-heavy encoder-decoder structures, a design that allocates a significant portion of its parameters to spatial reconstruction rather than…

In this paper, we propose TransMEF, a transformer-based multi-exposure image fusion framework that uses self-supervised multi-task learning. The framework is based on an encoder-decoder network, which can be trained on large natural image…

Computer Vision and Pattern Recognition · Computer Science 2021-12-16 Linhao Qu , Shaolei Liu , Manning Wang , Zhijian Song

Medical segmentation plays an important role in clinical applications like radiation therapy and surgical guidance, but acquiring clinically acceptable results is difficult. In recent years, progress has been witnessed with the success of…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Xin Zhang , Dongdong Meng , Sheng Li