English
Related papers

Related papers: Transformers in Unsupervised Structure-from-Motion

200 papers

Monocular scene reconstruction from posed images is challenging due to the complexity of a large environment. Recent volumetric methods learn to directly predict the TSDF volume and have demonstrated promising results in this task. However,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Weihao Yuan , Xiaodong Gu , Heng Li , Zilong Dong , Siyu Zhu

Transformers have become prevalent in computer vision due to their performance and flexibility in modelling complex operations. Of particular significance is the 'cross-attention' operation, which allows a vector representation (e.g. of an…

Computer Vision and Pattern Recognition · Computer Science 2022-08-08 Ali Athar , Jonathon Luiten , Alexander Hermans , Deva Ramanan , Bastian Leibe

Jointly considering multiple camera views (multi-view) is very effective for pedestrian detection under occlusion. For such multi-view systems, it is critical to have well-designed camera configurations, including camera locations,…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Yunzhong Hou , Xingjian Leng , Tom Gedeon , Liang Zheng

Self-supervised representation learning is able to learn semantically meaningful features; however, much of its recent success relies on multiple crops of an image with very few objects. Instead of learning view-invariant representation…

Computer Vision and Pattern Recognition · Computer Science 2021-10-13 Yuwen Xiong , Mengye Ren , Wenyuan Zeng , Raquel Urtasun

In recent developments in the field of Computer Vision, a rise is seen in the use of transformer-based architectures. They are surpassing the state-of-the-art set by CNN architectures in accuracy but on the other hand, they are…

Computer Vision and Pattern Recognition · Computer Science 2021-10-12 Durvesh Malpure , Onkar Litake , Rajesh Ingle

State-of-the-art deep learning models for computer vision tasks are based on the transformer architecture and often deployed in real-time applications. In this scenario, the resources available for every inference can vary, so it is useful…

Computer Vision and Pattern Recognition · Computer Science 2024-04-17 Kavya Sreedhar , Jason Clemons , Rangharajan Venkatesan , Stephen W. Keckler , Mark Horowitz

In this paper, we show how a 3D Morphable Model (i.e. a statistical model of the 3D shape of a class of objects such as faces) can be used to spatially transform input data as a module (a 3DMM-STN) within a convolutional neural network.…

Computer Vision and Pattern Recognition · Computer Science 2018-04-20 Anil Bas , Patrik Huber , William A. P. Smith , Muhammad Awais , Josef Kittler

Image Classification is a fundamental task in the field of computer vision that frequently serves as a benchmark for gauging advancements in Computer Vision. Over the past few years, significant progress has been made in image…

Computer Vision and Pattern Recognition · Computer Science 2023-12-06 Mahmoud Khalil , Ahmad Khalil , Alioune Ngom

We tackle the problem of automatically reconstructing a complete 3D model of a scene from a single RGB image. This challenging task requires inferring the shape of both visible and occluded surfaces. Our approach utilizes viewer-centered,…

Computer Vision and Pattern Recognition · Computer Science 2019-08-28 Daeyun Shin , Zhile Ren , Erik B. Sudderth , Charless C. Fowlkes

Following unprecedented success on the natural language tasks, Transformers have been successfully applied to several computer vision problems, achieving state-of-the-art results and prompting researchers to reconsider the supremacy of…

Image and Video Processing · Electrical Eng. & Systems 2022-01-25 Fahad Shamshad , Salman Khan , Syed Waqas Zamir , Muhammad Haris Khan , Munawar Hayat , Fahad Shahbaz Khan , Huazhu Fu

The lifting of 3D structure and camera from 2D landmarks is at the cornerstone of the entire discipline of computer vision. Traditional methods have been confined to specific rigid objects, such as those in Perspective-n-Point (PnP)…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Mosam Dabhi , Laszlo A. Jeni , Simon Lucey

Deep Learning based techniques have been adopted with precision to solve a lot of standard computer vision problems, some of which are image classification, object detection and segmentation. Despite the widespread success of these…

Computer Vision and Pattern Recognition · Computer Science 2016-11-21 Vikram Mohanty , Shubh Agrawal , Shaswat Datta , Arna Ghosh , Vishnu Dutt Sharma , Debashish Chakravarty

A clear understanding of where humans move in a scenario, their usual paths and speeds, and where they stop, is very important for different applications, such as mobility studies in urban areas or robot navigation tasks within…

Computer Vision and Pattern Recognition · Computer Science 2025-01-31 Placido Falqueto , Alberto Sanfeliu , Luigi Palopoli , Daniele Fontanelli

In this work, we consider the problem of learning a perception model for monocular robot navigation using few annotated images. Using a Vision Transformer (ViT) pretrained with a label-free self-supervised method, we successfully train a…

Robotics · Computer Science 2022-05-03 Miguel Saavedra-Ruiz , Sacha Morin , Liam Paull

Depth completion aims to predict dense depth maps with sparse depth measurements from a depth sensor. Currently, Convolutional Neural Network (CNN) based models are the most popular methods applied to depth completion tasks. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-13 Jian Qian , Miao Sun , Ashley Lee , Jie Li , Shenglong Zhuo , Patrick Yin Chiang

Most existing methods for depth estimation from a focal stack of images employ convolutional neural networks (CNNs) using 2D or 3D convolutions over a fixed set of images. However, their effectiveness is constrained by the local properties…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Xueyang Kang , Fengze Han , Abdur R. Fayjie , Patrick Vandewalle , Kourosh Khoshelham , Dong Gong

Image deblurring continues to achieve impressive performance with the development of generative models. Nonetheless, there still remains a displeasing problem if one wants to improve perceptual quality and quantitative scores of recovered…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Pengwei Liang , Junjun Jiang , Xianming Liu , Jiayi Ma

In this paper, we propose a novel projector-camera system for practical and low-cost acquisition of a dense object 3D model with the spectral reflectance property. In our system, we use a standard RGB camera and leverage an off-the-shelf…

Computer Vision and Pattern Recognition · Computer Science 2019-08-23 Chunyu Li , Yusuke Monno , Hironori Hidaka , Masatoshi Okutomi

Transformers were initially introduced for natural language processing (NLP) tasks, but fast they were adopted by most deep learning fields, including computer vision. They measure the relationships between pairs of input tokens (words in…

Computer Vision and Pattern Recognition · Computer Science 2023-03-22 Robin Courant , Maika Edberg , Nicolas Dufour , Vicky Kalogeiton

Vision transformers have shown excellent performance in computer vision tasks. As the computation cost of their self-attention mechanism is expensive, recent works tried to replace the self-attention mechanism in vision transformers with…

Computer Vision and Pattern Recognition · Computer Science 2022-11-30 Zimian Wei , Hengyue Pan , Lujun Li , Menglong Lu , Xin Niu , Peijie Dong , Dongsheng Li