中文
相关论文

相关论文: Unifying 3D Vision-Language Understanding via Prom…

200 篇论文

Unified Multimodal Models (UMMs) have demonstrated remarkable performance in text-to-image generation (T2I) and editing (TI2I), whether instantiated as assembled unified frameworks which couple powerful vision-language model (VLM) with…

计算机视觉与模式识别 · 计算机科学 2025-10-01 Yuxin Song , Wenkai Dong , Shizun Wang , Qi Zhang , Song Xue , Tao Yuan , Hu Yang , Haocheng Feng , Hang Zhou , Xinyan Xiao , Jingdong Wang

Concurrent processing of multiple autonomous driving 3D perception tasks within the same spatiotemporal scene poses a significant challenge, in particular due to the computational inefficiencies and feature competition between tasks when…

计算机视觉与模式识别 · 计算机科学 2024-07-23 Chunliang Li , Wencheng Han , Junbo Yin , Sanyuan Zhao , Jianbing Shen

Recent progress in vision-language modeling for 3D medical imaging has been fueled by large-scale computed tomography (CT) corpora with paired free-text reports, stronger architectures, and powerful pretrained models. This has enabled…

计算机视觉与模式识别 · 计算机科学 2025-10-24 Ibrahim Ethem Hamamci , Sezgin Er , Suprosanna Shit , Hadrien Reynaud , Dong Yang , Pengfei Guo , Marc Edgar , Daguang Xu , Bernhard Kainz , Bjoern Menze

Multimodal Machine Translation (MMT) focuses on enhancing text-only translation with visual features, which has attracted considerable attention from both natural language processing and computer vision communities. Recent advances still…

计算与语言 · 计算机科学 2022-11-29 Hongcheng Guo , Jiaheng Liu , Haoyang Huang , Jian Yang , Zhoujun Li , Dongdong Zhang , Zheng Cui , Furu Wei

We present an effective method for fusing visual-and-language representations for several question answering tasks including visual question answering and visual entailment. In contrast to prior works that concatenate unimodal…

计算机视觉与模式识别 · 计算机科学 2022-12-06 Maxwell Mbabilla Aladago , AJ Piergiovanni

Large language models (LLMs) and Vision-Language Models (VLMs) have been proven to excel at multiple tasks, such as commonsense reasoning. Powerful as these models can be, they are not grounded in the 3D physical world, which involves…

计算机视觉与模式识别 · 计算机科学 2023-07-25 Yining Hong , Haoyu Zhen , Peihao Chen , Shuhong Zheng , Yilun Du , Zhenfang Chen , Chuang Gan

In recent years, vision language pre-training frameworks have made significant progress in natural language processing and computer vision, achieving remarkable performance improvement on various downstream tasks. However, when extended to…

计算机视觉与模式识别 · 计算机科学 2023-05-19 Taolin Zhang , Sunan He , Dai Tao , Bin Chen , Zhi Wang , Shu-Tao Xia

With Transformers achieving outstanding performance on individual remote sensing (RS) tasks, we are now approaching the realization of a unified model that excels across multiple tasks through multi-task learning (MTL). Compared to…

计算机视觉与模式识别 · 计算机科学 2026-01-12 Qingyun Li , Shuran Ma , Junwei Luo , Yi Yu , Yue Zhou , Fengxiang Wang , Xudong Lu , Xiaoxing Wang , Xin He , Yushi Chen , Xue Yang

The rapid advancement of Multimodal Large Language Models (MLLMs) has significantly impacted various multimodal tasks. However, these models face challenges in tasks that require spatial understanding within 3D environments. Efforts to…

计算机视觉与模式识别 · 计算机科学 2025-03-28 Duo Zheng , Shijia Huang , Liwei Wang

Autonomous driving is a challenging task that requires perceiving and understanding the surrounding environment for safe trajectory planning. While existing vision-based end-to-end models have achieved promising results, these methods are…

计算机视觉与模式识别 · 计算机科学 2025-01-16 Tengpeng Li , Hanli Wang , Xianfei Li , Wenlong Liao , Tao He , Pai Peng

We present GR3D, a spatial vision language model equipped with three complementary grounding capabilities--explicit 2D grounding, implicit 2D grounding, and monocular 3D grounding--within a single framework. GR3D introduces an implicit…

Significant advancements has recently been achieved in the field of multi-modal large language models (MLLMs), demonstrating their remarkable capabilities in understanding and reasoning across diverse tasks. However, these models are often…

计算与语言 · 计算机科学 2024-08-06 Zhaowei Li , Wei Wang , YiQing Cai , Xu Qi , Pengyu Wang , Dong Zhang , Hang Song , Botian Jiang , Zhida Huang , Tao Wang

We introduce Venn Diagram (VD) Prompting, an innovative prompting technique which allows Large Language Models (LLMs) to combine and synthesize information across complex, diverse and long-context documents in knowledge-intensive…

计算与语言 · 计算机科学 2024-06-11 Sakshi Mahendru , Tejul Pandit

In this report, we introduce the Qwen3-VL-Embedding and Qwen3-VL-Reranker model series, the latest extensions of the Qwen family built on the Qwen3-VL foundation model. Together, they provide an end-to-end pipeline for high-precision…

Vision-language models (VLMs) exhibit a striking paradox: they can generate executable code that reconstructs a 3D scene from geometric primitives with correct object counts, classes, and approximate positions, yet the same models fail at…

计算机视觉与模式识别 · 计算机科学 2026-05-14 Junze Liu , Kun Qian , Florian Dubost , Kai Zhong , Arvind Srinivasan , Nan Chen , Anping Wang , Sam Zhang , Alejandro Mottini , Qingjun Cui , Tian Wang

Despite significant progress in Vision-Language Pre-training (VLP), current approaches predominantly emphasize feature extraction and cross-modal comprehension, with limited attention to generating or transforming visual content. This gap…

计算机视觉与模式识别 · 计算机科学 2025-04-22 Ziyang Zhang , Yang Yu , Yucheng Chen , Xulei Yang , Si Yong Yeo

We present a conceptually simple, flexible, and universal visual perception head for variant visual tasks, e.g., classification, object detection, instance segmentation and pose estimation, and different frameworks, such as one-stage or…

计算机视觉与模式识别 · 计算机科学 2022-09-13 Jianming Liang , Guanglu Song , Biao Leng , Yu Liu

In this paper, we introduce Uni3D-LLM, a unified framework that leverages a Large Language Model (LLM) to integrate tasks of 3D perception, generation, and editing within point cloud scenes. This framework empowers users to effortlessly…

计算机视觉与模式识别 · 计算机科学 2024-02-07 Dingning Liu , Xiaoshui Huang , Yuenan Hou , Zhihui Wang , Zhenfei Yin , Yongshun Gong , Peng Gao , Wanli Ouyang

Unified vision-language models (VLMs) promise to streamline computer vision pipelines by reframing multiple visual tasks such as classification, detection, and keypoint localization within a single language-driven interface. This…

计算机视觉与模式识别 · 计算机科学 2025-08-05 Conor Wallace , Isaac Corley , Jonathan Lwowski

3D scene understanding has gained significant attention due to its wide range of applications. However, existing methods for 3D scene understanding are limited to specific downstream tasks, which hinders their practicality in real-world…

计算机视觉与模式识别 · 计算机科学 2023-08-21 Zehan Wang , Haifeng Huang , Yang Zhao , Ziang Zhang , Zhou Zhao