中文
相关论文

相关论文: Towards Visual Query Localization in the 3D World

200 篇论文

Vision Large Language Models (VLLMs) are widely acknowledged to be prone to hallucinations. Existing research addressing this problem has primarily been confined to image inputs, with limited exploration of video-based hallucinations.…

计算机视觉与模式识别 · 计算机科学 2026-04-24 Wey Yeh Choong , Yangyang Guo , Mohan Kankanhalli

Visual Question Answering (VQA) is a challenging task that requires the joint understanding of natural language and visual content. While early research primarily focused on recognizing objects and scene context, it often overlooked scene…

Developing vision-language models (VLMs) capable of understanding 3D scenes has been a longstanding research goal. Despite recent progress, 3D VLMs still struggle with spatial reasoning and robustness. We identify three key obstacles…

计算机视觉与模式识别 · 计算机科学 2026-03-24 Jiangyong Huang , Xiaojian Ma , Xiongkun Linghu , Junchao He , Qing Li , Song-Chun Zhu , Yixin Chen , Baoxiong Jia , Siyuan Huang

The rapid progress of Multimodal Large Language Models (MLLMs) has unlocked the potential for enhanced 3D scene understanding and spatial reasoning. A recent line of work explores learning spatial reasoning directly from multi-view images,…

计算机视觉与模式识别 · 计算机科学 2026-04-10 Kanghee Lee , Injae Lee , Minseok Kwak , Jungi Hong , Kwonyoung Ryu , Jaesik Park

We present DeepSeek-VL, an open-source Vision-Language (VL) Model designed for real-world vision and language understanding applications. Our approach is structured around three key dimensions: We strive to ensure our data is diverse,…

2D object proposals, quickly detected regions in an image that likely contain an object of interest, are an effective approach for improving the computational efficiency and accuracy of object detection in color images. In this work, we…

计算机视觉与模式识别 · 计算机科学 2018-06-27 Ramanpreet Singh Pahwa , Jiangbo Lu , Nianjuan Jiang , Tian Tsong Ng , Minh N. Do

This paper presents a summary of the VQualA 2025 Challenge on Visual Quality Comparison for Large Multimodal Models (LMMs), hosted as part of the ICCV 2025 Workshop on Visual Quality Assessment. The challenge aims to evaluate and enhance…

Localization is a critical technology in autonomous driving, encompassing both topological localization, which identifies the most similar map keyframe to the current observation, and metric localization, which provides precise spatial…

计算机视觉与模式识别 · 计算机科学 2026-02-03 Ze Huang , Zhongyang Xiao , Mingliang Song , Longan Yang , Hongyuan Yuan , Li Sun

Text-based Visual Question Answering~(TextVQA) aims to produce correct answers for given questions about the images with multiple scene texts. In most cases, the texts naturally attach to the surface of the objects. Therefore, spatial…

计算机视觉与模式识别 · 计算机科学 2023-06-16 Hao Li , Jinfa Huang , Peng Jin , Guoli Song , Qi Wu , Jie Chen

Video Quality Assessment (VQA), which intends to predict the perceptual quality of videos, has attracted increasing attention. Due to factors like motion blur or specific distortions, the quality of different regions in a video varies.…

计算机视觉与模式识别 · 计算机科学 2025-03-14 Yunpeng Qu , Kun Yuan , Qizhi Xie , Ming Sun , Chao Zhou , Jian Wang

Retrieving the most similar vector embeddings to a given query among a massive collection of vectors has long been a key component of countless real-world applications. The recently introduced Retrieval-Augmented Generation is one of the…

机器学习 · 计算机科学 2024-02-06 Cecilia Aguerrebere , Mark Hildebrand , Ishwar Singh Bhati , Theodore Willke , Mariano Tepper

Understanding multi-image, multi-turn scenarios is a critical yet underexplored capability for Large Vision-Language Models (LVLMs). Existing benchmarks predominantly focus on static or horizontal comparisons -- e.g., spotting visual…

计算机视觉与模式识别 · 计算机科学 2025-12-09 Wenbo Lyu , Yingjun Du , Jinglin Zhao , Xianton Zhen , Ling Shao

Research on 3D Vision-Language Models (3D-VLMs) is gaining increasing attention, which is crucial for developing embodied AI within 3D scenes, such as visual navigation and embodied question answering. Due to the high density of visual…

计算机视觉与模式识别 · 计算机科学 2025-02-04 Hongyan Zhi , Peihao Chen , Junyan Li , Shuailei Ma , Xinyu Sun , Tianhang Xiang , Yinjie Lei , Mingkui Tan , Chuang Gan

Situation awareness is essential for understanding and reasoning about 3D scenes in embodied AI agents. However, existing datasets and benchmarks for situated understanding are limited in data modality, diversity, scale, and task scope. To…

计算机视觉与模式识别 · 计算机科学 2024-11-19 Xiongkun Linghu , Jiangyong Huang , Xuesong Niu , Xiaojian Ma , Baoxiong Jia , Siyuan Huang

Large vision-language models (LVLMs) have demonstrated remarkable achievements, yet the generation of non-factual responses remains prevalent in fact-seeking question answering (QA). Current multimodal fact-seeking benchmarks primarily…

计算与语言 · 计算机科学 2025-03-11 Yanling Wang , Yihan Zhao , Xiaodong Chen , Shasha Guo , Lixin Liu , Haoyang Li , Yong Xiao , Jing Zhang , Qi Li , Ke Xu

Text-guided 3D visual grounding (T-3DVG), which aims to locate a specific object that semantically corresponds to a language query from a complicated 3D scene, has drawn increasing attention in the 3D research community over the past few…

计算机视觉与模式识别 · 计算机科学 2024-07-23 Daizong Liu , Yang Liu , Wencan Huang , Wei Hu

Recently, 3D vision-and-language tasks have attracted increasing research interest. Compared to other vision-and-language tasks, the 3D visual question answering (VQA) task is less exploited and is more susceptible to language priors and…

计算机视觉与模式识别 · 计算机科学 2022-09-27 Lichen Zhao , Daigang Cai , Jing Zhang , Lu Sheng , Dong Xu , Rui Zheng , Yinjie Zhao , Lipeng Wang , Xibo Fan

LiDAR sensors are widely used for 3D object detection in various mobile robotics applications. LiDAR sensors continuously generate point cloud data in real-time. Conventional 3D object detectors detect objects using a set of points acquired…

计算机视觉与模式识别 · 计算机科学 2022-10-04 Junhyung Lee , Junho Koh , Youngwoo Lee , Jun Won Choi

In this paper, we will present SketchQL, a video database management system (VDBMS) for retrieving video moments with a sketch-based query interface. This novel interface allows users to specify object trajectory events with simple mouse…

Vision-Language Models (VLMs) achieve outstanding performance, yet their huge model size severely hinders deployment on edge devices with limited resources. As an efficient model compression technique, vector quantization (VQ) excels in…

计算机视觉与模式识别 · 计算机科学 2026-05-26 Zhong Wang , Zukang Xu , Xing Hu , Dawei Yang