English
Related papers

Related papers: Vision Transformer with Convolutional Encoder-Deco…

200 papers

Within Convolutional Neural Network (CNN), the convolution operations are good at extracting local features but experience difficulty to capture global representations. Within visual transformer, the cascaded self-attention modules can…

Computer Vision and Pattern Recognition · Computer Science 2021-05-11 Zhiliang Peng , Wei Huang , Shanzhi Gu , Lingxi Xie , Yaowei Wang , Jianbin Jiao , Qixiang Ye

Depth completion aims to predict dense depth maps with sparse depth measurements from a depth sensor. Currently, Convolutional Neural Network (CNN) based models are the most popular methods applied to depth completion tasks. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-13 Jian Qian , Miao Sun , Ashley Lee , Jie Li , Shenglong Zhuo , Patrick Yin Chiang

Reconstructing hand-held objects in 3D from monocular images remains a significant challenge in computer vision. Most existing approaches rely on implicit 3D representations, which produce overly smooth reconstructions and are…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Zerui Chen , Rolandos Alexandros Potamias , Shizhe Chen , Cordelia Schmid

We present in this paper a new architecture, named Convolutional vision Transformer (CvT), that improves Vision Transformer (ViT) in performance and efficiency by introducing convolutions into ViT to yield the best of both designs. This is…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Haiping Wu , Bin Xiao , Noel Codella , Mengchen Liu , Xiyang Dai , Lu Yuan , Lei Zhang

Handwritten Text Recognition (HTR) in free-layout pages is a challenging image understanding task that can provide a relevant boost to the digitization of handwritten documents and reuse of their content. The task becomes even more…

Computer Vision and Pattern Recognition · Computer Science 2022-08-18 Silvia Cascianelli , Marcella Cornia , Lorenzo Baraldi , Rita Cucchiara

The 3D reconstruction of faces gains wide attention in computer vision and is used in many fields of application, for example, animation, virtual reality, and even forensics. This work is motivated by monitoring patients in sleep…

Computer Vision and Pattern Recognition · Computer Science 2025-02-06 Valentin Braeutigam , Vanessa Wirth , Ingrid Ullmann , Christian Schüßler , Martin Vossiek , Matthias Berking , Bernhard Egger

Millimeter wave radar is gaining traction recently as a promising modality for enabling pervasive and privacy-preserving gesture recognition. However, the lack of rich and fine-grained radar datasets hinders progress in developing…

Multimedia · Computer Science 2024-04-24 Kaikai Deng , Dong Zhao , Wenxin Zheng , Yue Ling , Kangwen Yin , Huadong Ma

We present a pure machine learning process for synthesizing radar spectrograms from Motion-Capture (MoCap) data. We formulate MoCap-to-spectrogram translation as a windowed sequence-to-sequence task using a transformer-based model that…

Machine Learning · Computer Science 2025-11-17 Kevin Chen , Kenneth W. Parker , Anish Arora

In this paper, we present a spectrum monitoring framework for the detection of radar signals in spectrum sharing scenarios. The core of our framework is a deep convolutional neural network (CNN) model that enables Measurement Capable…

Networking and Internet Architecture · Computer Science 2017-05-02 Ahmed Selim , Francisco Paisana , Jerome A. Arokkiam , Yi Zhang , Linda Doyle , Luiz A. DaSilva

Existing state-of-the-art saliency detection methods heavily rely on CNN-based architectures. Alternatively, we rethink this task from a convolution-free sequence-to-sequence perspective and predict saliency by modeling long-range…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Nian Liu , Ni Zhang , Kaiyuan Wan , Ling Shao , Junwei Han

This paper introduces a live object recognition system that serves as a blind aid. Visually impaired people heavily rely on their other senses such as touch and auditory signals for understanding the environment around them. The act of…

Computer Vision and Pattern Recognition · Computer Science 2018-11-27 Kedar Potdar , Chinmay D. Pai , Sukrut Akolkar

The majority of deep learning (DL) based deformable image registration methods use convolutional neural networks (CNNs) to estimate displacement fields from pairs of moving and fixed images. This, however, requires the convolutional kernels…

Image and Video Processing · Electrical Eng. & Systems 2022-08-02 Yihao Liu , Lianrui Zuo , Shuo Han , Yuan Xue , Jerry L. Prince , Aaron Carass

Recent work has proven the effectiveness of transformers in many computer vision tasks. However, the performance of transformers in gaze estimation is still unexplored. In this paper, we employ transformers and assess their effectiveness…

Computer Vision and Pattern Recognition · Computer Science 2021-06-01 Yihua Cheng , Feng Lu

Existing RGB-based imitation learning approaches typically employ traditional vision encoders such as ResNet or ViT, which lack explicit 3D reasoning capabilities. Recent geometry-grounded vision models, such as VGGT~\cite{wang2025vggt},…

Robotics · Computer Science 2025-09-22 An Dinh Vuong , Minh Nhat Vu , Ian Reid

Transformers have recently gained increasing attention in computer vision. However, existing studies mostly use Transformers for feature representation learning, e.g. for image classification and dense predictions, and the generalizability…

Computer Vision and Pattern Recognition · Computer Science 2021-12-08 Shengcai Liao , Ling Shao

Depth perception of transparent and reflective objects has long been a critical challenge in robotic manipulation.Conventional depth sensors often fail to provide reliable measurements on such surfaces, limiting the performance of robots in…

Robotics · Computer Science 2025-11-11 Guanghu Xie , Mingxu Li , Songwei Wu , Yang Liu , Zongwu Xie , Baoshi Cao , Hong Liu

We solve the fNIRS left/right hand force decoding problem using a data-driven approach by using a convolutional neural network architecture, the HemCNN. We test HemCNN's decoding capabilities to decode in a streaming way the hand, left or…

Machine Learning · Computer Science 2021-03-10 Pablo Ortega , Aldo Faisal

Hand Gesture Recognition (HGR) enables intuitive human-computer interactions in various real-world contexts. However, existing frameworks often struggle to meet the real-time requirements essential for practical HGR applications. This study…

Computer Vision and Pattern Recognition · Computer Science 2026-04-17 Oluwaleke Yusuf , Maki Habib , Mohamed Moustafa

Transceivers used for telecommunications transmit and receive specific modulation patterns that are represented as sequences of complex numbers. Classifying modulation patterns is challenging because noise and channel impairments affect the…

Machine Learning · Computer Science 2020-10-30 Jakob Krzyston , Rajib Bhattacharjea , Andrew Stark

Due to the powerful ability in capturing the global information, Transformer has become an alternative architecture of CNNs for hyperspectral image classification. However, general Transformer mainly considers the global spectral…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Zhiqiang Gong , Xian Zhou , Wen Yao