中文
相关论文

相关论文: CoMa: Contextual Massing Generation with Vision-La…

200 篇论文

Unified Multimodal Models (UMMs) have demonstrated remarkable performance in text-to-image generation (T2I) and editing (TI2I), whether instantiated as assembled unified frameworks which couple powerful vision-language model (VLM) with…

计算机视觉与模式识别 · 计算机科学 2025-10-01 Yuxin Song , Wenkai Dong , Shizun Wang , Qi Zhang , Song Xue , Tao Yuan , Hu Yang , Haocheng Feng , Hang Zhou , Xinyan Xiao , Jingdong Wang

Interpretable communication is essential for safe and trustworthy autonomous driving, yet current vision-language models (VLMs) often operate under idealized assumptions and struggle to capture user intent in real-world scenarios. Existing…

计算机视觉与模式识别 · 计算机科学 2025-07-02 Djamahl Etchegaray , Yuxia Fu , Zi Huang , Yadan Luo

Current roadside perception systems mainly focus on instance-level perception, which fall short in enabling interaction via natural language and reasoning about traffic behaviors in context. To bridge this gap, we introduce RoadSceneVQA, a…

计算机视觉与模式识别 · 计算机科学 2025-12-29 Runwei Guan , Rongsheng Hu , Shangshu Chen , Ningyuan Xiao , Xue Xia , Jiayang Liu , Beibei Chen , Ziren Tang , Ningwei Ouyang , Shaofeng Liang , Yuxuan Fan , Wanjie Sun , Yutao Yue

The increasing demand for intelligent systems capable of interpreting and reasoning about visual content requires the development of large Vision-and-Language Models (VLMs) that are not only accurate but also have explicit reasoning…

Automated neural network architecture design remains a significant challenge in computer vision. Task diversity and computational constraints require both effective architectures and efficient search methods. Large Language Models (LLMs)…

计算机视觉与模式识别 · 计算机科学 2026-04-17 Raghuvir Duvvuri , Chandini Vysyaraju , Avi Goyal , Dmitry Ignatov , Radu Timofte

Multimodal Large Language Models advance multimodal representation learning by acquiring transferable semantic embeddings, thereby substantially enhancing performance across a range of vision-language tasks, including cross-modal retrieval,…

计算机视觉与模式识别 · 计算机科学 2026-04-21 Da Li , Yuxiao Luo , Keping Bi , Jiafeng Guo , Wei Yuan , Biao Yang , Yan Wang , Fan Yang , Tingting Gao , Guorui Zhou

Multimodal Vision-Language Models (VLMs) enable powerful applications from their fused understanding of images and language, but many perform poorly on UI tasks due to the lack of UI training data. In this paper, we adapt a recipe for…

人机交互 · 计算机科学 2023-10-10 Yue Jiang , Eldon Schoop , Amanda Swearngin , Jeffrey Nichols

Recent advances in Large Language Models (LLMs) and Vision Language Models (VLMs) have shown significant progress in mathematical reasoning, yet they still face a critical bottleneck with problems requiring visual assistance, such as…

计算机视觉与模式识别 · 计算机科学 2025-10-14 Chengqi Duan , Kaiyue Sun , Rongyao Fang , Manyuan Zhang , Yan Feng , Ying Luo , Yufang Liu , Ke Wang , Peng Pei , Xunliang Cai , Hongsheng Li , Yi Ma , Xihui Liu

Multi-modal Large Language Models (MLLMs) have introduced a novel dimension to document understanding, i.e., they endow large language models with visual comprehension capabilities; however, how to design a suitable image-text pre-training…

计算机视觉与模式识别 · 计算机科学 2025-03-19 Zining Wang , Tongkun Guan , Pei Fu , Chen Duan , Qianyi Jiang , Zhentao Guo , Shan Guo , Junfeng Luo , Wei Shen , Xiaokang Yang

Large vision language models (VLMs) have demonstrated significant potential for integration into daily life, making it crucial for them to incorporate human values when making decisions in real-world situations. This paper introduces VIVA,…

计算与语言 · 计算机科学 2024-10-11 Zhe Hu , Yixiao Ren , Jing Li , Yu Yin

In a globalized world, cultural elements from diverse origins frequently appear together within a single visual scene. We refer to these as culture mixing scenarios, yet how Large Vision-Language Models (LVLMs) perceive them remains…

Generating images with conditional descriptions gains increasing interests in recent years. However, existing conditional inputs are suffering from either unstructured forms (captions) or limited information and expensive labeling (scene…

计算机视觉与模式识别 · 计算机科学 2021-06-08 Tao Ma , Yikang Li

Integrating large language models (LLMs) into autonomous driving motion planning has recently emerged as a promising direction, offering enhanced interpretability, better controllability, and improved generalization in rare and long-tail…

人工智能 · 计算机科学 2025-07-29 Zhipeng Tang , Sha Zhang , Jiajun Deng , Chenjie Wang , Guoliang You , Yuting Huang , Xinrui Lin , Yanyong Zhang

Autonomous driving systems depend on on models that can reason about high-level scene contexts and accurately predict the dynamics of their surrounding environment. Vision- Language Models (VLMs) have recently emerged as promising tools for…

计算机视觉与模式识别 · 计算机科学 2026-03-18 Stefan Englmeier , Katharina Winter , Fabian B. Flohr

Vision-Language Models (VLMs) have been applied to autonomous driving to support decision-making in complex real-world scenarios. However, their training on static, web-sourced image-text pairs fundamentally limits the precise…

计算机视觉与模式识别 · 计算机科学 2026-01-21 Keishi Ishihara , Kento Sasaki , Tsubasa Takahashi , Daiki Shiono , Yu Yamaguchi

While Multimodal Large Language Models (MLLMs) excel at general vision-language tasks, visuospatial cognition - reasoning about spatial layouts, relations, and dynamics - remains a significant challenge. Existing models often lack the…

计算机视觉与模式识别 · 计算机科学 2025-09-10 Qi Feng

This report provides an architecture-led analysis of two modern vision-language models (VLMs), Qwen2.5-VL-7B-Instruct and Llama-4-Scout-17B-16E-Instruct, and explains how their architectural properties map to a practical video-to-artifact…

计算机视觉与模式识别 · 计算机科学 2025-12-30 Thomson Tong , Diba Darooneh

Human language is grounded on multimodal knowledge including visual knowledge like colors, sizes, and shapes. However, current large-scale pre-trained language models rely on text-only self-supervised training with massive text data, which…

计算与语言 · 计算机科学 2023-02-28 Weizhi Wang , Li Dong , Hao Cheng , Haoyu Song , Xiaodong Liu , Xifeng Yan , Jianfeng Gao , Furu Wei

Scaling Vision-Language-Action (VLA) models requires massive datasets that are both semantically coherent and physically feasible. However, existing scene generation methods often lack context-awareness, making it difficult to synthesize…

机器人学 · 计算机科学 2026-04-13 Yaru Liu , Ao-bo Wang , Nanyang Ye

Vision-Language Models (VLMs) have made significant strides in static image understanding but continue to face critical hurdles in spatiotemporal reasoning. A major bottleneck is "multi-image reasoning hallucination", where a massive…