English
Related papers

Related papers: Galaxy Walker: Geometry-aware VLMs For Galaxy-scal…

200 papers

Vision Language Models (VLMs) have achieved impressive performance in 2D image understanding, however they are still struggling with spatial understanding which is the foundation of Embodied AI. In this paper, we propose SpatialBot for…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Wenxiao Cai , Iaroslav Ponomarenko , Jianhao Yuan , Xiaoqi Li , Wankou Yang , Hao Dong , Bo Zhao

Existing RGB-based imitation learning approaches typically employ traditional vision encoders such as ResNet or ViT, which lack explicit 3D reasoning capabilities. Recent geometry-grounded vision models, such as VGGT~\cite{wang2025vggt},…

Robotics · Computer Science 2025-09-22 An Dinh Vuong , Minh Nhat Vu , Ian Reid

Solving geometric tasks involving point clouds by using machine learning is a challenging problem. Standard feed-forward neural networks combine linear or, if the bias parameter is included, affine layers and activation functions. Their…

Machine Learning · Computer Science 2022-06-15 Pavlo Melnyk , Michael Felsberg , Mårten Wadenbäck

This paper investigates the notion of learning user and item representations in non-Euclidean space. Specifically, we study the connection between metric learning in hyperbolic space and collaborative filtering by exploring Mobius…

Information Retrieval · Computer Science 2019-12-02 Lucas Vinh Tran , Yi Tay , Shuai Zhang , Gao Cong , Xiaoli Li

Geo-localization is the task of identifying the location of an image using visual cues alone. It has beneficial applications, such as improving disaster response, enhancing navigation, and geography education. Recently, Vision-Language…

Computer Vision and Pattern Recognition · Computer Science 2025-08-28 Oliver Grainge , Sania Waheed , Jack Stilgoe , Michael Milford , Shoaib Ehsan

Though recent advances in vision-language models (VLMs) have achieved remarkable progress across a wide range of multimodal tasks, understanding 3D spatial relationships from limited views remains a significant challenge. Previous reasoning…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Zhangquan Chen , Manyuan Zhang , Xinlei Yu , Xufang Luo , Mingze Sun , Zihao Pan , Xiang An , Yan Feng , Peng Pei , Xunliang Cai , Ruqi Huang

Integration of Large Language Models (LLMs) into visual domain tasks, resulting in visual-LLMs (V-LLMs), has enabled exceptional performance in vision-language tasks, particularly for visual question answering (VQA). However, existing…

Computer Vision and Pattern Recognition · Computer Science 2024-04-12 Kanchana Ranasinghe , Satya Narayan Shukla , Omid Poursaeed , Michael S. Ryoo , Tsung-Yu Lin

This letter proposes a method of global localization on a map with semantic object landmarks. One of the most promising approaches for localization on object maps is to use semantic graph matching using landmark descriptors calculated from…

Computer Vision and Pattern Recognition · Computer Science 2024-10-07 Shigemichi Matsuzaki , Kazuhito Tanaka , Kazuhiro Shintani

Zero-shot Vision-and-Language Navigation (VLN) agents leveraging Large Language Models (LLMs) excel in generalization but suffer from insufficient spatial perception. Focusing on complex continuous environments, we categorize key perceptual…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Lu Yue , Yue Fan , Shiwei Lian , Yu Zhao , Jiaxin Yu , Liang Xie , Feitian Zhang

Visual Spatial Reasoning is crucial for enabling Multimodal Large Language Models (MLLMs) to understand object properties and spatial relationships, yet current models still struggle with 3D-aware reasoning. Existing approaches typically…

Computer Vision and Pattern Recognition · Computer Science 2025-12-08 Zefeng Zhang , Xiangzhao Hao , Hengzhu Tang , Zhenyu Zhang , Jiawei Sheng , Xiaodong Li , Zhenyang Li , Li Gao , Daiting Shi , Dawei Yin , Tingwen Liu

Vision-Language-Action (VLA) models have recently shown impressive generalization and language-guided manipulation capabilities. However, their performance degrades on tasks requiring precise spatial reasoning due to limited spatial…

Computer Vision and Pattern Recognition · Computer Science 2025-10-16 Tianyuan Yuan , Yicheng Liu , Chenhao Lu , Zhuoguang Chen , Tao Jiang , Hang Zhao

Understanding the environment and a robot's physical reachability is crucial for task execution. While state-of-the-art vision-language models (VLMs) excel in environmental perception, they often generate inaccurate or impractical responses…

Robotics · Computer Science 2025-03-14 Weijie Zhou , Manli Tao , Chaoyang Zhao , Haiyun Guo , Honghui Dong , Ming Tang , Jinqiao Wang

Camera motion is a fundamental geometric signal that shapes visual perception and cinematic style, yet current video-capable vision-language models (VideoLLMs) rarely represent it explicitly and often fail on fine-grained motion primitives.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Haoan Feng , Sri Harsha Musunuri , Guan-Ming Su

Vision-language models (VLMs) achieve strong performance on spatial reasoning benchmarks, yet it remains unclear whether this reflects structured 3D understanding or reliance on statistical shortcuts in natural images. We introduce a…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Cheolhong Min , Jaeyun Jung , Daeun Lee , Hyeonseong Jeon , Yu Su , Jonathan Tremblay , Chan Hee Song , Jaesik Park

Vision-Language Models (VLMs) have recently witnessed significant progress in visual comprehension. As the permitting length of image context grows, VLMs can now comprehend a broader range of views and spaces. Current benchmarks provide…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Yiqi Zhu , Ziyue Wang , Can Zhang , Peng Li , Yang Liu

Visual grounding is an essential tool that links user-provided text queries with query-specific regions within an image. Despite advancements in visual grounding models, their ability to comprehend complex queries remains limited. To…

Computer Vision and Pattern Recognition · Computer Science 2024-05-29 Haoyu Zhao , Wenhang Ge , Ying-cong Chen

LLMs excel at linguistic tasks but lack the inner geospatial capabilities needed for time-critical disaster response, where reasoning about road networks, coordinates, and access to essential infrastructure such as hospitals, shelters, and…

Computation and Language · Computer Science 2026-03-27 Ahmed El Fekih Zguir , Ferda Ofli , Muhammad Imran

Vision-Language Models (VLMs) have emerged as general purpose tools for addressing a variety of complex computer vision problems. Such models have been shown to be highly capable, but, at the same time, also lacking some basic visual…

Computer Vision and Pattern Recognition · Computer Science 2024-08-14 Shivam Chandhok , Wan-Cyuan Fan , Leonid Sigal

Vision-Language Models (VLMs) have shown remarkable capabilities in spatial reasoning, yet they remain fundamentally limited to qualitative precision and lack the computational precision required for real-world robotics. Current approaches…

Robotics · Computer Science 2026-03-05 Yi Han , Enshen Zhou , Shanyu Rong , Jingkun An , Pengwei Wang , Zhongyuan Wang , Cheng Chi , Lu Sheng , Shanghang Zhang

Vision-language models (VLMs) have made substantial progress across a wide range of visual question answering benchmarks, spanning visual reasoning, document understanding, and multimodal dialogue. These improvements are evident in a wide…

Computer Vision and Pattern Recognition · Computer Science 2026-02-23 Dhruba Ghosh , Yuhui Zhang , Ludwig Schmidt
‹ Prev 1 8 9 10 Next ›