English
Related papers

Related papers: STRMs: Spatial Temporal Reasoning Models for Visio…

200 papers

Successful visual navigation depends upon capturing images that contain sufficient useful information. In this letter, we explore a data-driven approach to account for environmental lighting changes, improving the quality of images for use…

Robotics · Computer Science 2022-07-12 Justin Tomasi , Brandon Wagstaff , Steven L. Waslander , Jonathan Kelly

Computer vision has achieved remarkable success by (a) representing images as uniformly-arranged pixel arrays and (b) convolving highly-localized features. However, convolutions treat all image pixels equally regardless of importance;…

Computer Vision and Pattern Recognition · Computer Science 2020-11-23 Bichen Wu , Chenfeng Xu , Xiaoliang Dai , Alvin Wan , Peizhao Zhang , Zhicheng Yan , Masayoshi Tomizuka , Joseph Gonzalez , Kurt Keutzer , Peter Vajda

Being able to perceive the semantics and the spatial structure of the environment is essential for visual navigation of a household robot. However, most existing works only employ visual backbones pre-trained either with independent images…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Yicong Hong , Yang Zhou , Ruiyi Zhang , Franck Dernoncourt , Trung Bui , Stephen Gould , Hao Tan

Previous attempts to integrate Neural Radiance Fields (NeRF) into the Simultaneous Localization and Mapping (SLAM) framework either rely on the assumption of static scenes or require the ground truth camera poses, which impedes their…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Chengyao Duan , Zhiliu Yang

The existing methods for Vision and Language Navigation in the Continuous Environment (VLN-CE) commonly incorporate a waypoint predictor to discretize the environment. This simplifies the navigation actions into a view selection task and…

Computer Vision and Pattern Recognition · Computer Science 2024-08-21 Yue Zhang , Parisa Kordjamshidi

Service robots are increasingly deployed in diverse and dynamic environments, where both physical layouts and social contexts change over time and across locations. In these unstructured settings, conventional navigation systems that rely…

Robotics · Computer Science 2025-07-16 Yanbo Wang , Zipeng Fang , Lei Zhao , Weidong Chen

Vision Transformers (ViTs) have achieved comparable or superior performance than Convolutional Neural Networks (CNNs) in computer vision. This empirical breakthrough is even more remarkable since, in contrast to CNNs, ViTs do not embed any…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Samy Jelassi , Michael E. Sander , Yuanzhi Li

Navigation and localization of UAVs present a challenge when global navigation satellite systems (GNSS) are disrupted and unreliable. Traditional techniques, such as simultaneous localization and mapping (SLAM) and visual odometry (VO),…

Computer Vision and Pattern Recognition · Computer Science 2023-10-13 Haoling Li , Jiuniu Wang , Zhiwei Wei , Wenjia Xu

Place recognition and loop closure detection are challenging for long-term visual navigation tasks. SeqSLAM is considered to be one of the most successful approaches to achieving long-term localization under varying environmental conditions…

Robot navigation in dynamic, human-centered environments requires socially-compliant decisions grounded in robust scene understanding. Recent Vision-Language Models (VLMs) exhibit promising capabilities such as object recognition,…

Vehicle re-identification is an important problem and has many applications in video surveillance and intelligent transportation. It gains increasing attention because of the recent advances of person re-identification techniques. However,…

Computer Vision and Pattern Recognition · Computer Science 2017-08-15 Yantao Shen , Tong Xiao , Hongsheng Li , Shuai Yi , Xiaogang Wang

Plant phenology-the study of recurrent life cycle events-is essential for understanding ecosystem dynamics and their responses to climate change impacts. While Unmanned Aerial Vehicles (UAVs) and near-surface cameras enable high-resolution…

We present a novel artificial cognitive mapping system using generative deep neural networks, called variational autoencoder/generative adversarial network (VAE/GAN), which can map input images to latent vectors and generate temporal…

Machine Learning · Computer Science 2022-04-14 Hiroki Kojima , Takashi Ikegami

Vision-Language Models (VLMs) have shown great success as foundational models for downstream vision and natural language applications in a variety of domains. However, these models are limited to reasoning over objects and actions currently…

Robotics · Computer Science 2025-06-13 Zachary Chavis , Hyun Soo Park , Stephen J. Guy

Recently spatial-temporal intelligence of Visual-Language Models (VLMs) has attracted much attention due to its importance for autonomous driving, embodied AI and general AI. Existing spatial-temporal benchmarks mainly focus on egocentric…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Qinghongbing Xie , Zhaoyuan Xia , Feng Zhu , Lijun Gong , Ziyue Li , Rui Zhao , Long Zeng

This paper introduces a novel smartphone-enabled localization technology for ambient Internet of Things (IoT) devices, leveraging the widespread use of smartphones. By utilizing the passive movement of a smartphone, we create a virtual…

Information Theory · Computer Science 2024-10-29 Shang-Ling Shih , Chao-Kai Wen , Chau Yuen , Shi Jin

Globally-consistent localization in urban environments is crucial for autonomous systems such as self-driving vehicles and drones, as well as assistive technologies for visually impaired people. Traditional Visual-Inertial Odometry (VIO)…

Robotics · Computer Science 2024-12-13 Roxane Merat , Giovanni Cioffi , Leonard Bauersfeld , Davide Scaramuzza

Accurate localization is an essential technology for the flexible navigation of robots in large-scale environments. Both SLAM-based and map-based localization will increase the computing load due to the increase in map size, which will…

Robotics · Computer Science 2024-04-30 Yixiao Feng , Zhou Jiang , Yongliang Shi , Yunlong Feng , Xiangyu Chen , Hao Zhao , Guyue Zhou

Visual localization is a critical task in mobile robotics, and researchers are continuously developing new approaches to enhance its efficiency. In this article, we propose a novel approach to improve the accuracy of visual localization…

Computer Vision and Pattern Recognition · Computer Science 2023-10-10 Artem Nenashev , Mikhail Kurenkov , Andrei Potapov , Iana Zhura , Maksim Katerishich , Dzmitry Tsetserukou

Visual localization algorithms, i.e., methods that estimate the camera pose of a query image in a known scene, are core components of many applications, including self-driving cars and augmented / mixed reality systems. State-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2025-04-25 Vojtech Panek , Qunjie Zhou , Yaqing Ding , Sérgio Agostinho , Zuzana Kukelova , Torsten Sattler , Laura Leal-Taixé