English
Related papers

Related papers: Learning 3D Representations for Spatial Intelligen…

200 papers

Neural network representation learning for spatial data is a common need for geographic artificial intelligence (GeoAI) problems. In recent years, many advancements have been made in representation learning for points, polylines, and…

Computer Vision and Pattern Recognition · Computer Science 2022-10-03 Gengchen Mai , Chiyu Jiang , Weiwei Sun , Rui Zhu , Yao Xuan , Ling Cai , Krzysztof Janowicz , Stefano Ermon , Ni Lao

3D Gaussian Splatting (3DGS) techniques have achieved satisfactory 3D scene representation. Despite their impressive performance, they confront challenges due to the limitation of structure-from-motion (SfM) methods on acquiring accurate…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Ao Gao , Luosong Guo , Tao Chen , Zhao Wang , Ying Tai , Jian Yang , Zhenyu Zhang

Recent advancements in Multimodal Large Language Models (MLLMs) have significantly enhanced performance on 2D visual tasks. However, improving their spatial intelligence remains a challenge. Existing 3D MLLMs always rely on additional 3D or…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Diankun Wu , Fangfu Liu , Yi-Hsin Hung , Yueqi Duan

Feed-forward 3D Gaussian Splatting methods have achieved impressive reconstruction quality for autonomous driving scenes, yet they entangle scene geometry with transient appearance properties such as lighting, weather, and time of day. This…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Quentin Herau , Tianshuo Xu , Depu Meng , Jiezhi Yang , Chensheng Peng , Spencer Sherk , Yihan Hu , Wei Zhan

UAVs play an important role in applications such as autonomous exploration, disaster response, and infrastructure inspection. However, UAV VLN in complex 3D environments remains challenging. A key difficulty is the structural representation…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Wen Jiang , Kangyao Huang , Li Wang , Wang Xu , Wei Fan , Jinyuan Liu , Shaoyu Liu , Hanfang Liang , Hongwei Duan , Bin Xu , Xiangyang Ji

In recent years, the paradigm of neural implicit representations has gained substantial attention in the field of Simultaneous Localization and Mapping (SLAM). However, a notable gap exists in the existing approaches when it comes to scene…

Computer Vision and Pattern Recognition · Computer Science 2024-07-31 Hongjia Zhai , Gan Huang , Qirui Hu , Guanglin Li , Hujun Bao , Guofeng Zhang

Euclidean representation learning methods have achieved promising results in image fusion tasks, which can be attributed to their clear advantages in handling with linear space. However, data collected from a realistic scene usually has a…

Computer Vision and Pattern Recognition · Computer Science 2025-09-25 Huan Kang , Hui Li , Tianyang Xu , Xiao-Jun Wu , Rui Wang , Chunyang Cheng , Josef Kittler

We introduce an improved solution to the neural image-based rendering problem in computer vision. Given a set of images taken from a freely moving camera at train time, the proposed approach could synthesize a realistic image of the scene…

Computer Vision and Pattern Recognition · Computer Science 2023-11-09 Nishant Jain , Suryansh Kumar , Luc Van Gool

Feed-forward 3D reconstruction offers substantial runtime advantages over per-scene optimization, which remains slow at inference and often fragile under sparse views. However, existing feed-forward methods still have potential for further…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Tianyu Chen , Wei Xiang , Kang Han , Yu Lu , Di Wu , Gaowen Liu , Ramana Rao Kompella

To endow machines with the ability to perceive the real-world in a three dimensional representation as we do as humans is a fundamental and long-standing topic in Artificial Intelligence. Given different types of visual inputs such as…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Bo Yang

This paper presents a pose-free, feed-forward 3D Gaussian Splatting (3DGS) framework designed to handle unfavorable input views. A common rendering setup for training feed-forward approaches places a 3D object at the world origin and…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Yuki Fujimura , Takahiro Kushida , Kazuya Kitano , Takuya Funatomi , Yasuhiro Mukaigawa

Self-supervised representation learning techniques utilize large datasets without semantic annotations to learn meaningful, universal features that can be conveniently transferred to solve a wide variety of downstream supervised tasks. In…

Computer Vision and Pattern Recognition · Computer Science 2022-10-10 Swetava Ganguli , C. V. Krishnakumar Iyer , Vipul Pandey

Surface reconstruction is fundamental to computer vision and graphics, enabling applications in 3D modeling, mixed reality, robotics, and more. Existing approaches based on volumetric rendering obtain promising results, but optimize on a…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Yueh-Cheng Liu , Lukas Höllein , Matthias Nießner , Angela Dai

Learning-based 3D reconstruction methods have shown impressive results. However, most methods require 3D supervision which is often hard to obtain for real-world datasets. Recently, several works have proposed differentiable rendering…

Computer Vision and Pattern Recognition · Computer Science 2020-03-24 Michael Niemeyer , Lars Mescheder , Michael Oechsle , Andreas Geiger

We propose R3GS, a robust reconstruction and relocalization framework tailored for unconstrained datasets. Our method uses a hybrid representation during training. Each anchor combines a global feature from a convolutional neural network…

Computer Vision and Pattern Recognition · Computer Science 2025-05-22 Xu yan , Zhaohui Wang , Rong Wei , Jingbo Yu , Dong Li , Xiangde Liu

Scaling up representations for images or text has been extensively investigated in the past few years and has led to revolutions in learning vision and language. However, scalable representation for 3D objects and scenes is relatively…

Computer Vision and Pattern Recognition · Computer Science 2023-10-11 Junsheng Zhou , Jinsheng Wang , Baorui Ma , Yu-Shen Liu , Tiejun Huang , Xinlong Wang

Models for image representation learning are typically designed for either recognition or generation. Various forms of contrastive learning help models learn to convert images to embeddings that are useful for classification, detection, and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Matthew Gwilliam , Xiao Wang , Xuefeng Hu , Zhenheng Yang

Embodied intelligence requires precise reconstruction and rendering to simulate large-scale real-world data. Although 3D Gaussian Splatting (3DGS) has recently demonstrated high-quality results with real-time performance, it still faces…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Haodong Xiang , Xinghui Li , Kai Cheng , Xiansong Lai , Wanting Zhang , Zhichao Liao , Long Zeng , Xueping Liu

Reconstructing high-fidelity underwater scenes remains a challenging task due to light absorption, scattering, and limited visibility inherent in aquatic environments. This paper presents an enhanced Gaussian Splatting-based framework that…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Zhuodong Jiang , Haoran Wang , Guoxi Huang , Brett Seymour , Nantheera Anantrasirichai

The recently advanced unsupervised learning approaches use the siamese-like framework to compare two "views" from the same image for learning representations. Making the two views distinctive is a core to guarantee that unsupervised methods…

Computer Vision and Pattern Recognition · Computer Science 2022-02-18 Zhiqiang Shen , Zechun Liu , Zhuang Liu , Marios Savvides , Trevor Darrell , Eric Xing