English
Related papers

Related papers: TransMatting: Tri-token Equipped Transformer Model…

200 papers

Image inpainting, which refers to the synthesis of missing regions in an image, can help restore occluded or degraded areas and also serve as a precursor task for self-supervision. The current state-of-the-art models for image inpainting…

Computer Vision and Pattern Recognition · Computer Science 2023-07-04 Pranav Jeevan , Dharshan Sampath Kumar , Amit Sethi

Recent studies have shown the importance of modeling long-range interactions in the inpainting problem. To achieve this goal, existing approaches exploit either standalone attention techniques or transformers, but usually under a low…

Computer Vision and Pattern Recognition · Computer Science 2022-06-28 Wenbo Li , Zhe Lin , Kun Zhou , Lu Qi , Yi Wang , Jiaya Jia

Non-overlapping patch-wise convolution is the default image tokenizer for all state-of-the-art vision Transformer (ViT) models. Even though many ViT variants have been proposed to improve its efficiency and accuracy, little research on…

Computer Vision and Pattern Recognition · Computer Science 2024-05-30 Zhenhai Zhu , Radu Soricut

Alpha matting is widely used in video conferencing as well as in movies, television, and social media sites. Deep learning approaches to the matte extraction problem are well suited to video conferencing due to the consistent subject matter…

Computer Vision and Pattern Recognition · Computer Science 2023-07-03 Sharif Elcott , J. P. Lewis , Nori Kanazawa , Christoph Bregler

Restoring images distorted by atmospheric turbulence is a ubiquitous problem in long-range imaging applications. While existing deep-learning-based methods have demonstrated promising results in specific testing conditions, they suffer from…

Image and Video Processing · Electrical Eng. & Systems 2023-12-12 Xingguang Zhang , Zhiyuan Mao , Nicholas Chimitt , Stanley H. Chan

Local feature matching is an essential component in many visual applications. In this work, we propose OAMatcher, a Tranformer-based detector-free method that imitates humans behavior to generate dense and accurate matches. Firstly,…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Kun Dai , Tao Xie , Ke Wang , Zhiqiang Jiang , Ruifeng Li , Lijun Zhao

Learning robust local image feature matching is a fundamental low-level vision task, which has been widely explored in the past few years. Recently, detector-free local feature matchers based on transformers have shown promising results,…

Computer Vision and Pattern Recognition · Computer Science 2023-07-19 Chenjie Cao , Yanwei Fu

LiDAR and camera are two important sensors for 3D object detection in autonomous driving. Despite the increasing popularity of sensor fusion in this field, the robustness against inferior image conditions, e.g., bad illumination and sensor…

Computer Vision and Pattern Recognition · Computer Science 2022-03-23 Xuyang Bai , Zeyu Hu , Xinge Zhu , Qingqiu Huang , Yilun Chen , Hongbo Fu , Chiew-Lan Tai

In this paper, we address the limitations of existing text-to-image diffusion models in generating demographically fair results when given human-related descriptions. These models often struggle to disentangle the target language context…

Computer Vision and Pattern Recognition · Computer Science 2024-03-07 Jia Li , Lijie Hu , Jingfeng Zhang , Tianhang Zheng , Hua Zhang , Di Wang

Usually, lesions are not isolated but are associated with the surrounding tissues. For example, the growth of a tumour can depend on or infiltrate into the surrounding tissues. Due to the pathological nature of the lesions, it is…

Image and Video Processing · Electrical Eng. & Systems 2022-10-12 Lin Wang , Xiufen Ye , Donghao Zhang , Wanji He , Lie Ju , Yi Luo , Huan Luo , Xin Wang , Wei Feng , Kaimin Song , Xin Zhao , Zongyuan Ge

In the last decade, convolutional neural networks (ConvNets) have been a major focus of research in medical image analysis. However, the performances of ConvNets may be limited by a lack of explicit consideration of the long-range spatial…

Image and Video Processing · Electrical Eng. & Systems 2022-10-18 Junyu Chen , Eric C. Frey , Yufan He , William P. Segars , Ye Li , Yong Du

Metalenses offer significant potential for ultra-compact computational imaging but face challenges from complex optical degradation and computational restoration difficulties. Existing methods typically rely on precise optical calibration…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Jianing Zhang , Jiayi Zhu , Feiyu Ji , Xiaokang Yang , Xiaoyun Yuan

The capability to jointly process multi-modal information is becoming an essential task. However, the limited number of paired multi-modal data and the large computational requirements in multi-modal learning hinder the development. We…

Computation and Language · Computer Science 2025-06-09 Minsu Kim , Jee-weon Jung , Hyeongseop Rha , Soumi Maiti , Siddhant Arora , Xuankai Chang , Shinji Watanabe , Yong Man Ro

Co-Salient Object Detection (CoSOD) aims at simulating the human visual system to discover the common and salient objects from a group of relevant images. Recent methods typically develop sophisticated deep learning based models have…

Computer Vision and Pattern Recognition · Computer Science 2022-09-23 Lv Tang , Bo Li

Recently, deep-learning-based approaches have been widely studied for deformable image registration task. However, most efforts directly map the composite image representation to spatial transformation through the convolutional neural…

Image and Video Processing · Electrical Eng. & Systems 2022-07-08 Jiashun Chen , Donghuan Lu , Yu Zhang , Dong Wei , Munan Ning , Xinyu Shi , Zhe Xu , Yefeng Zheng

We present a novel framework for exemplar based image translation. Recent advanced methods for this task mainly focus on establishing cross-domain semantic correspondence, which sequentially dominates image generation in the manner of local…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Chang Jiang , Fei Gao , Biao Ma , Yuhao Lin , Nannan Wang , Gang Xu

Existing image-to-image transformation approaches primarily focus on synthesizing visually pleasing data. Generating images with correct identity labels is challenging yet much less explored. It is even more challenging to deal with image…

Computer Vision and Pattern Recognition · Computer Science 2020-06-16 Wei Xiong , Yutong He , Yixuan Zhang , Wenhan Luo , Lin Ma , Jiebo Luo

This paper deals with deep transductive learning, and proposes TransBoost as a procedure for fine-tuning any deep neural model to improve its performance on any (unlabeled) test set provided at training time. TransBoost is inspired by a…

Computer Vision and Pattern Recognition · Computer Science 2023-01-18 Omer Belhasin , Guy Bar-Shalom , Ran El-Yaniv

Recent interactive matting methods have shown satisfactory performance in capturing the primary regions of objects, but they fall short in extracting fine-grained details in edge regions. Diffusion models trained on billions of image-text…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Longfei Huang , Yu Liang , Hao Zhang , Jinwei Chen , Wei Dong , Lunde Chen , Wanyu Liu , Bo Li , Peng-Tao Jiang

Benefiting from powerful convolutional neural networks (CNNs), learning-based image inpainting methods have made significant breakthroughs over the years. However, some nature of CNNs (e.g. local prior, spatially shared parameters) limit…

Computer Vision and Pattern Recognition · Computer Science 2023-05-22 Ye Deng , Siqi Hui , Sanping Zhou , Deyu Meng , Jinjun Wang