English
Related papers

Related papers: Unifying 3D Vision-Language Understanding via Prom…

200 papers

Unified Multimodal Models (UMMs) have demonstrated remarkable performance in text-to-image generation (T2I) and editing (TI2I), whether instantiated as assembled unified frameworks which couple powerful vision-language model (VLM) with…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Yuxin Song , Wenkai Dong , Shizun Wang , Qi Zhang , Song Xue , Tao Yuan , Hu Yang , Haocheng Feng , Hang Zhou , Xinyan Xiao , Jingdong Wang

Concurrent processing of multiple autonomous driving 3D perception tasks within the same spatiotemporal scene poses a significant challenge, in particular due to the computational inefficiencies and feature competition between tasks when…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Chunliang Li , Wencheng Han , Junbo Yin , Sanyuan Zhao , Jianbing Shen

Recent progress in vision-language modeling for 3D medical imaging has been fueled by large-scale computed tomography (CT) corpora with paired free-text reports, stronger architectures, and powerful pretrained models. This has enabled…

Computer Vision and Pattern Recognition · Computer Science 2025-10-24 Ibrahim Ethem Hamamci , Sezgin Er , Suprosanna Shit , Hadrien Reynaud , Dong Yang , Pengfei Guo , Marc Edgar , Daguang Xu , Bernhard Kainz , Bjoern Menze

Multimodal Machine Translation (MMT) focuses on enhancing text-only translation with visual features, which has attracted considerable attention from both natural language processing and computer vision communities. Recent advances still…

Computation and Language · Computer Science 2022-11-29 Hongcheng Guo , Jiaheng Liu , Haoyang Huang , Jian Yang , Zhoujun Li , Dongdong Zhang , Zheng Cui , Furu Wei

We present an effective method for fusing visual-and-language representations for several question answering tasks including visual question answering and visual entailment. In contrast to prior works that concatenate unimodal…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Maxwell Mbabilla Aladago , AJ Piergiovanni

Large language models (LLMs) and Vision-Language Models (VLMs) have been proven to excel at multiple tasks, such as commonsense reasoning. Powerful as these models can be, they are not grounded in the 3D physical world, which involves…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Yining Hong , Haoyu Zhen , Peihao Chen , Shuhong Zheng , Yilun Du , Zhenfang Chen , Chuang Gan

In recent years, vision language pre-training frameworks have made significant progress in natural language processing and computer vision, achieving remarkable performance improvement on various downstream tasks. However, when extended to…

Computer Vision and Pattern Recognition · Computer Science 2023-05-19 Taolin Zhang , Sunan He , Dai Tao , Bin Chen , Zhi Wang , Shu-Tao Xia

With Transformers achieving outstanding performance on individual remote sensing (RS) tasks, we are now approaching the realization of a unified model that excels across multiple tasks through multi-task learning (MTL). Compared to…

Computer Vision and Pattern Recognition · Computer Science 2026-01-12 Qingyun Li , Shuran Ma , Junwei Luo , Yi Yu , Yue Zhou , Fengxiang Wang , Xudong Lu , Xiaoxing Wang , Xin He , Yushi Chen , Xue Yang

The rapid advancement of Multimodal Large Language Models (MLLMs) has significantly impacted various multimodal tasks. However, these models face challenges in tasks that require spatial understanding within 3D environments. Efforts to…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Duo Zheng , Shijia Huang , Liwei Wang

Autonomous driving is a challenging task that requires perceiving and understanding the surrounding environment for safe trajectory planning. While existing vision-based end-to-end models have achieved promising results, these methods are…

Computer Vision and Pattern Recognition · Computer Science 2025-01-16 Tengpeng Li , Hanli Wang , Xianfei Li , Wenlong Liao , Tao He , Pai Peng

We present GR3D, a spatial vision language model equipped with three complementary grounding capabilities--explicit 2D grounding, implicit 2D grounding, and monocular 3D grounding--within a single framework. GR3D introduces an implicit…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 An-Chieh Cheng , Yang Fu , Yatai Ji , Ligeng Zhu , Guanqi Zhan , Zhuoyang Zhang , Zhaojing Yang , Song Han , Yao Lu , Pavlo Molchanov , Vidya Nariyambut Murali , Jan Kautz , Xiaolong Wang , Hongxu Yin , Sifei Liu

Significant advancements has recently been achieved in the field of multi-modal large language models (MLLMs), demonstrating their remarkable capabilities in understanding and reasoning across diverse tasks. However, these models are often…

Computation and Language · Computer Science 2024-08-06 Zhaowei Li , Wei Wang , YiQing Cai , Xu Qi , Pengyu Wang , Dong Zhang , Hang Song , Botian Jiang , Zhida Huang , Tao Wang

We introduce Venn Diagram (VD) Prompting, an innovative prompting technique which allows Large Language Models (LLMs) to combine and synthesize information across complex, diverse and long-context documents in knowledge-intensive…

Computation and Language · Computer Science 2024-06-11 Sakshi Mahendru , Tejul Pandit

In this report, we introduce the Qwen3-VL-Embedding and Qwen3-VL-Reranker model series, the latest extensions of the Qwen family built on the Qwen3-VL foundation model. Together, they provide an end-to-end pipeline for high-precision…

Computation and Language · Computer Science 2026-01-21 Mingxin Li , Yanzhao Zhang , Dingkun Long , Keqin Chen , Sibo Song , Shuai Bai , Zhibo Yang , Pengjun Xie , An Yang , Dayiheng Liu , Jingren Zhou , Junyang Lin

Vision-language models (VLMs) exhibit a striking paradox: they can generate executable code that reconstructs a 3D scene from geometric primitives with correct object counts, classes, and approximate positions, yet the same models fail at…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Junze Liu , Kun Qian , Florian Dubost , Kai Zhong , Arvind Srinivasan , Nan Chen , Anping Wang , Sam Zhang , Alejandro Mottini , Qingjun Cui , Tian Wang

Despite significant progress in Vision-Language Pre-training (VLP), current approaches predominantly emphasize feature extraction and cross-modal comprehension, with limited attention to generating or transforming visual content. This gap…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Ziyang Zhang , Yang Yu , Yucheng Chen , Xulei Yang , Si Yong Yeo

We present a conceptually simple, flexible, and universal visual perception head for variant visual tasks, e.g., classification, object detection, instance segmentation and pose estimation, and different frameworks, such as one-stage or…

Computer Vision and Pattern Recognition · Computer Science 2022-09-13 Jianming Liang , Guanglu Song , Biao Leng , Yu Liu

In this paper, we introduce Uni3D-LLM, a unified framework that leverages a Large Language Model (LLM) to integrate tasks of 3D perception, generation, and editing within point cloud scenes. This framework empowers users to effortlessly…

Computer Vision and Pattern Recognition · Computer Science 2024-02-07 Dingning Liu , Xiaoshui Huang , Yuenan Hou , Zhihui Wang , Zhenfei Yin , Yongshun Gong , Peng Gao , Wanli Ouyang

Unified vision-language models (VLMs) promise to streamline computer vision pipelines by reframing multiple visual tasks such as classification, detection, and keypoint localization within a single language-driven interface. This…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Conor Wallace , Isaac Corley , Jonathan Lwowski

3D scene understanding has gained significant attention due to its wide range of applications. However, existing methods for 3D scene understanding are limited to specific downstream tasks, which hinders their practicality in real-world…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Zehan Wang , Haifeng Huang , Yang Zhao , Ziang Zhang , Zhou Zhao
‹ Prev 1 3 4 5 6 7 10 Next ›