English
Related papers

Related papers: Transformers in Unsupervised Structure-from-Motion

200 papers

In this paper, a self-supervised model that simultaneously predicts a sequence of future frames from video-input with a novel spatial-temporal attention (ST) network is proposed. The ST transformer network allows constraining both temporal…

Computer Vision and Pattern Recognition · Computer Science 2023-03-03 Houssem Boulahbal , Adrian Voicila , Andrew Comport

Sensor fusion is an essential topic in many perception systems, such as autonomous driving and robotics. Transformers-based detection head and CNN-based feature encoder to extract features from raw sensor-data has emerged as one of the best…

Computer Vision and Pattern Recognition · Computer Science 2023-02-23 Apoorv Singh

The adoption of Vision Transformers (ViTs) based architectures represents a significant advancement in 3D Medical Image (MI) segmentation, surpassing traditional Convolutional Neural Network (CNN) models by enhancing global contextual…

Computer Vision and Pattern Recognition · Computer Science 2024-04-25 Shehan Perera , Pouyan Navard , Alper Yilmaz

Dynamic attention mechanism and global modeling ability make Transformer show strong feature learning ability. In recent years, Transformer has become comparable to CNNs methods in computer vision. This review mainly investigates the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-25 Yuting Yang , Licheng Jiao , Xu Liu , Fang Liu , Shuyuan Yang , Zhixi Feng , Xu Tang

Transformers are widely used for solving tasks in natural language processing, computer vision, speech, and music domains. In this paper, we talk about the efficiency of transformers in terms of memory (the number of parameters),…

Computer Vision and Pattern Recognition · Computer Science 2023-02-27 Badri N. Patro , Vijay Srinivas Agneeswaran

In line with the development of deep learning, this survey examines the transformative role of Transformers and foundation models in advancing visual anomaly detection (VAD). We explore how these architectures, with their global receptive…

Machine Learning · Computer Science 2025-07-23 Mouïn Ben Ammar , Arturo Mendoza , Nacim Belkhir , Antoine Manzanera , Gianni Franchi

Transformer-based models have transformed the landscape of natural language processing (NLP) and are increasingly applied to computer vision tasks with remarkable success. These models, renowned for their ability to capture long-range…

Computer Vision and Pattern Recognition · Computer Science 2024-08-28 Gracile Astlin Pereira , Muhammad Hussain

This paper provides a comprehensive review of mechanical equipment fault diagnosis methods, focusing on the advancements brought by Transformer-based models. It details the structure, working principles, and benefits of Transformers,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Guiran Liu , Binrong Zhu

Recent escalation in the field of computer vision underpins a huddle of algorithms with the magnificent potential to unravel the information contained within images. These computer vision algorithms are being practised in medical image…

Image and Video Processing · Electrical Eng. & Systems 2022-03-30 Arshi Parvaiz , Muhammad Anwaar Khalid , Rukhsana Zafar , Huma Ameer , Muhammad Ali , Muhammad Moazam Fraz

While transformers have shown great potential on video recognition with their strong capability of capturing long-range dependencies, they often suffer high computational costs induced by the self-attention to the huge number of 3D tokens.…

Computer Vision and Pattern Recognition · Computer Science 2022-11-23 Yuxuan Liang , Pan Zhou , Roger Zimmermann , Shuicheng Yan

3D object detection from monocular images has proven to be an enormously challenging task, with the performance of leading systems not yet achieving even 10\% of that of LiDAR-based counterparts. One explanation for this performance gap is…

Computer Vision and Pattern Recognition · Computer Science 2018-11-21 Thomas Roddick , Alex Kendall , Roberto Cipolla

Given the prevalence of 3D medical imaging technologies such as MRI and CT that are widely used in diagnosing and treating diverse diseases, 3D segmentation is one of the fundamental tasks of medical image analysis. Recently,…

Computer Vision and Pattern Recognition · Computer Science 2023-02-10 Yuhui Zhang , Shih-Cheng Huang , Zhengping Zhou , Matthew P. Lungren , Serena Yeung

The recent success of Vision Transformers is shaking the long dominance of Convolutional Neural Networks (CNNs) in image recognition for a decade. Specifically, in terms of robustness on out-of-distribution samples, recent research finds…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Zeyu Wang , Yutong Bai , Yuyin Zhou , Cihang Xie

We establish connections between the Transformer architecture, originally introduced for natural language processing, and Graph Neural Networks (GNNs) for representation learning on graphs. We show how Transformers can be viewed as message…

Machine Learning · Computer Science 2025-06-30 Chaitanya K. Joshi

Using convolutional neural networks for 360images can induce sub-optimal performance due to distortions entailed by a planar projection. The distortion gets deteriorated when a rotation is applied to the 360image. Thus, many researches…

Computer Vision and Pattern Recognition · Computer Science 2022-02-14 Sungmin Cho , Raehyuk Jung , Junseok Kwon

Transformer-based detection and segmentation methods use a list of learned detection queries to retrieve information from the transformer network and learn to predict the location and category of one specific object from each query. We…

Computer Vision and Pattern Recognition · Computer Science 2023-07-31 Yiming Cui , Linjie Yang , Haichao Yu

Self-supervised monocular depth estimation has been widely studied recently. Most of the work has focused on improving performance on benchmark datasets, such as KITTI, but has offered a few experiments on generalization performance. In…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Jinwoo Bae , Sungho Moon , Sunghoon Im

Self-supervised prediction is a powerful mechanism to learn representations that capture the underlying structure of the data. Despite recent progress, the self-supervised video prediction task is still challenging. One of the critical…

Computer Vision and Pattern Recognition · Computer Science 2020-04-21 Hafez Farazi , Sven Behnke

Full surround monodepth (FSM) methods can learn from multiple camera views simultaneously in a self-supervised manner to predict the scale-aware depth, which is more practical for real-world applications in contrast to scale-ambiguous depth…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Yuchen Yang , Xinyi Wang , Dong Li , Lu Tian , Ashish Sirasao , Xun Yang

This paper aims to address the problem of supervised monocular depth estimation. We start with a meticulous pilot study to demonstrate that the long-range correlation is essential for accurate depth estimation. Therefore, we propose to…

Computer Vision and Pattern Recognition · Computer Science 2023-10-13 Zhenyu Li , Zehui Chen , Xianming Liu , Junjun Jiang