English
Related papers

Related papers: WT-MVSNet: Window-based Transformers for Multi-vie…

200 papers

Recently, Visual Transformer (ViT) has been widely used in various fields of computer vision due to applying self-attention mechanism in the spatial domain to modeling global knowledge. Especially in medical image segmentation (MIS), many…

Image and Video Processing · Electrical Eng. & Systems 2022-10-26 Jiacheng Ruan , Mingye Xie , Suncheng Xiang , Ting Liu , Yuzhuo Fu

Transformer-based approaches have achieved superior performance in image restoration, since they can model long-term dependencies well. However, the limitation in capturing local information restricts their capacity to remove degradations.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Shihao Zhou , Duosheng Chen , Jinshan Pan , Jufeng Yang

We present a novel framework to learn to convert the perpixel photometric information at each view into spatially distinctive and view-invariant low-level features, which can be plugged into existing multi-view stereo pipeline for enhanced…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Kaizhang Kang , Cihui Xie , Ruisheng Zhu , Xiaohe Ma , Ping Tan , Hongzhi Wu , Kun Zhou

Wireless power transfer (WPT) is expected to be a technology reshaping the landscape of low-power applications such as the Internet of Things, machine-to-machine communications and radio frequency identification networks. Although there has…

Information Theory · Computer Science 2016-05-05 Yang Huang , Bruno Clerckx

In this paper, we aim to redesign the vision Transformer (ViT) as a new backbone to realize semantic image transmission, termed wireless image transmission transformer (WITT). Previous works build upon convolutional neural networks (CNNs),…

Computer Vision and Pattern Recognition · Computer Science 2022-11-03 Ke Yang , Sixian Wang , Jincheng Dai , Kailin Tan , Kai Niu , Ping Zhang

Transformers have become the standard in state-of-the-art vision architectures, achieving impressive performance on both image-level and dense pixelwise tasks. However, training vision transformers for high-resolution pixelwise tasks has a…

Computer Vision and Pattern Recognition · Computer Science 2024-03-25 Vincent Leroy , Jerome Revaud , Thomas Lucas , Philippe Weinzaepfel

Multi-channel inputs offer several advantages over single-channel, to improve the robustness of on-device speech recognition systems. Recent work on multi-channel transformer, has proposed a way to incorporate such inputs into end-to-end…

Audio and Speech Processing · Electrical Eng. & Systems 2021-08-31 Feng-Ju Chang , Martin Radfar , Athanasios Mouchtaris , Maurizio Omologo

We present CSWin Transformer, an efficient and effective Transformer-based backbone for general-purpose vision tasks. A challenging issue in Transformer design is that global self-attention is very expensive to compute whereas local…

Computer Vision and Pattern Recognition · Computer Science 2022-01-11 Xiaoyi Dong , Jianmin Bao , Dongdong Chen , Weiming Zhang , Nenghai Yu , Lu Yuan , Dong Chen , Baining Guo

In human-centered environments such as restaurants, homes, and warehouses, robots often face challenges in accurately recognizing 3D objects. These challenges stem from the complexity and variability of these environments, including diverse…

Computer Vision and Pattern Recognition · Computer Science 2025-08-14 Songsong Xiong , Hamidreza Kasaei

We present PatchmatchNet, a novel and learnable cascade formulation of Patchmatch for high-resolution multi-view stereo. With high computation speed and low memory requirement, PatchmatchNet can process higher resolution imagery and is more…

Computer Vision and Pattern Recognition · Computer Science 2020-12-03 Fangjinhua Wang , Silvano Galliani , Christoph Vogel , Pablo Speciale , Marc Pollefeys

Surface meshes are a favoured domain for representing structural and functional information on the human cortex, but their complex topology and geometry pose significant challenges for deep learning analysis. While Transformers have…

Image and Video Processing · Electrical Eng. & Systems 2024-06-12 Simon Dahan , Logan Z. J. Williams , Daniel Rueckert , Emma C. Robinson

The self-attention mechanism, successfully employed with the transformer structure is shown promise in many computer vision tasks including image recognition, and object detection. Despite the surge, the use of the transformer for the…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Xuelian Cheng , Yiran Zhong , Mehrtash Harandi , Tom Drummond , Zhiyong Wang , Zongyuan Ge

Visual Transformers (VTs) are emerging as an architectural paradigm alternative to Convolutional networks (CNNs). Differently from CNNs, VTs can capture global relations between image elements and they potentially have a larger…

Computer Vision and Pattern Recognition · Computer Science 2021-11-16 Yahui Liu , Enver Sangineto , Wei Bi , Nicu Sebe , Bruno Lepri , Marco De Nadai

We introduce a learning-based depth map fusion framework that accepts a set of depth and confidence maps generated by a Multi-View Stereo (MVS) algorithm as input and improves them. This is accomplished by integrating volumetric visibility…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Nathaniel Burgdorfer , Philippos Mordohai

We propose an efficient multi-view stereo (MVS) network for infering depth value from multiple RGB images. Recent studies have shown that mapping the geometric relationship in real space to neural network is an essential topic of the MVS…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Zihang Wan

For medical image semantic segmentation (MISS), Vision Transformers have emerged as strong alternatives to convolutional neural networks thanks to their inherent ability to capture long-range correlations. However, existing research uses…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Qianying Liu , Chaitanya Kaul , Jun Wang , Christos Anagnostopoulos , Roderick Murray-Smith , Fani Deligianni

Low-light image enhancement aims to improve the perception of images collected in dim environments and provide high-quality data support for image recognition tasks. When dealing with photos captured under non-uniform illumination, existing…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Xiao Fang , Xin Gao , Baofeng Li , Feng Zhai , Yu Qin , Zhihang Meng , Jiansheng Lu , Chun Xiao

Large transformer models are proving to be a powerful tool for 3D vision and novel view synthesis. However, the standard Transformer's well-known quadratic complexity makes it difficult to scale these methods to large scenes. To address…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Tooba Imtiaz , Lucy Chai , Kathryn Heal , Xuan Luo , Jungyeon Park , Jennifer Dy , John Flynn

Prior works have proposed several strategies to reduce the computational cost of self-attention mechanism. Many of these works consider decomposing the self-attention procedure into regional and local feature extraction procedures that each…

Computer Vision and Pattern Recognition · Computer Science 2022-07-13 Ting Yao , Yehao Li , Yingwei Pan , Yu Wang , Xiao-Ping Zhang , Tao Mei

Deep image registration has demonstrated exceptional accuracy and fast inference. Recent advances have adopted either multiple cascades or pyramid architectures to estimate dense deformation fields in a coarse-to-fine manner. However, due…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Xinxing Cheng , Xi Jia , Wenqi Lu , Qiufu Li , Linlin Shen , Alexander Krull , Jinming Duan