English
Related papers

Related papers: Shuffle Transformer with Feature Alignment for Vid…

200 papers

In this paper, we investigate the task of hallucinating an authentic high-resolution (HR) human face from multiple low-resolution (LR) video snapshots. We propose a pure transformer-based model, dubbed VidFace, to fully exploit the…

Computer Vision and Pattern Recognition · Computer Science 2021-06-01 Yuan Gan , Yawei Luo , Xin Yu , Bang Zhang , Yi Yang

As the quality of optical sensors improves, there is a need for processing large-scale images. In particular, the ability of devices to capture ultra-high definition (UHD) images and video places new demands on the image processing…

Computer Vision and Pattern Recognition · Computer Science 2022-12-23 Tao Wang , Kaihao Zhang , Tianrun Shen , Wenhan Luo , Bjorn Stenger , Tong Lu

Correlation acts as a critical role in the tracking field, especially in recent popular Siamese-based trackers. The correlation operation is a simple fusion manner to consider the similarity between the template and the search region.…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Xin Chen , Bin Yan , Jiawen Zhu , Dong Wang , Xiaoyun Yang , Huchuan Lu

Transformer-based methods have achieved remarkable results in image super-resolution tasks because they can capture non-local dependencies in low-quality input images. However, this feature-intensive modeling approach is computationally…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Wei Long , Xingyu Zhou , Leheng Zhang , Shuhang Gu

Local feature matching remains a challenging task, primarily due to difficulties in matching sparse keypoints and low-texture regions. The key to solving this problem lies in effectively and accurately integrating global and local…

Image and Video Processing · Electrical Eng. & Systems 2025-04-01 Yun Liao , Yide Di , Hao Zhou , Kaijun Zhu , Mingyu Lu , Yijia Zhang , Qing Duan , Junhui Liu

Effective feature fusion of multispectral images plays a crucial role in multi-spectral object detection. Previous studies have demonstrated the effectiveness of feature fusion using convolutional neural networks, but these methods are…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Jifeng Shen , Yifei Chen , Yue Liu , Xin Zuo , Heng Fan , Wankou Yang

State-of-the-art face recognition (FR) models often experience a significant performance drop when dealing with facial images in surveillance scenarios where images are in low quality and often corrupted with noise. Leveraging facial…

Computer Vision and Pattern Recognition · Computer Science 2023-12-18 Md Mahedi Hasan , Shoaib Meraj Sami , Nasser Nasrabadi

Convolutional Neural Networks (CNNs) and Transformers have achieved remarkable success in computer vision tasks. However, their deep architectures often lead to high computational redundancy, making them less suitable for…

Computer Vision and Pattern Recognition · Computer Science 2024-10-03 Novendra Setyawan , Ghufron Wahyu Kurniawan , Chi-Chia Sun , Jun-Wei Hsieh , Jing-Ming Guo , Wen-Kai Kuo

Surgical scene segmentation is a fundamental task for robotic-assisted laparoscopic surgery understanding. It often contains various anatomical structures and surgical instruments, where similar local textures and fine-grained structures…

Computer Vision and Pattern Recognition · Computer Science 2024-10-24 Cheng Yuan , Yutong Ban

In this work, we introduce FaceXFormer, an end-to-end unified transformer model capable of performing ten facial analysis tasks within a single framework. These tasks include face parsing, landmark detection, head pose estimation, attribute…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Kartik Narayan , Vibashan VS , Rama Chellappa , Vishal M. Patel

Face forgery by deepfake is widely spread over the internet and this raises severe societal concerns. In this paper, we propose a novel video transformer with incremental learning for detecting deepfake videos. To better align the input…

Computer Vision and Pattern Recognition · Computer Science 2021-08-12 Sohail A. Khan , Hang Dai

Pretraining Vision Transformers (ViTs) has achieved great success in visual recognition. A following scenario is to adapt a ViT to various image and video recognition tasks. The adaptation is challenging because of heavy computation and…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Shoufa Chen , Chongjian Ge , Zhan Tong , Jiangliu Wang , Yibing Song , Jue Wang , Ping Luo

Text-based person search aims to retrieve images of a certain pedestrian by a textual description. The key challenge of this task is to eliminate the inter-modality gap and achieve the feature alignment across modalities. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2021-12-14 Shiping Li , Min Cao , Min Zhang

Occluded person re-identification (Re-ID) is a challenging problem due to the destruction of occluders. Most existing methods focus on visible human body parts through some prior information. However, when complementary occlusions occur,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Tao Wang , Mengyuan Liu , Hong Liu , Wenhao Li , Miaoju Ban , Tuanyu Guo , Yidi Li

Face swapping aims to generate swapped images that fuse the identity of source faces and the attributes of target faces. Most existing works address this challenging task through 3D modelling or generation using generative adversarial…

Computer Vision and Pattern Recognition · Computer Science 2023-04-06 Kaiwen Cui , Rongliang Wu , Fangneng Zhan , Shijian Lu

Visual place recognition (VPR) remains challenging due to significant viewpoint changes and appearance variations. Mainstream works tackle these challenges by developing various feature aggregation methods to transform deep features into…

Computer Vision and Pattern Recognition · Computer Science 2024-07-10 Teng Wang , Lingquan Meng , Lei Cheng , Changyin Sun

Extracting robust feature representation is critical for object re-identification to accurately identify objects across non-overlapping cameras. Although having a strong representation ability, the Vision Transformer (ViT) tends to overfit…

Computer Vision and Pattern Recognition · Computer Science 2024-08-30 Lei Tan , Pingyang Dai , Jie Chen , Liujuan Cao , Yongjian Wu , Rongrong Ji

Owing to the advances in image processing technology and large-scale datasets, companies have implemented facial authentication processes, thereby stimulating increased focus on face anti-spoofing (FAS) against realistic presentation…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Yunseung Lee , Youngjun Kwak , Jinho Shin

Recent advancements have illuminated the efficacy of some tensorization-decomposition Parameter-Efficient Fine-Tuning methods like LoRA and FacT in the context of Vision Transformers (ViT). However, these methods grapple with the challenges…

Computer Vision and Pattern Recognition · Computer Science 2023-11-14 Dongping Chen

Recent success of generative adversarial networks (GAN) has made great progress on the face animation task. However, the complex scene structure of a face image still makes it a challenge to generate videos with face poses significantly…

Computer Vision and Pattern Recognition · Computer Science 2021-11-10 Qiulin Wang , Lu Zhang , Bo Li