English
Related papers

Related papers: CoMa: Contextual Massing Generation with Vision-La…

200 papers

Unified Multimodal Models (UMMs) have demonstrated remarkable performance in text-to-image generation (T2I) and editing (TI2I), whether instantiated as assembled unified frameworks which couple powerful vision-language model (VLM) with…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Yuxin Song , Wenkai Dong , Shizun Wang , Qi Zhang , Song Xue , Tao Yuan , Hu Yang , Haocheng Feng , Hang Zhou , Xinyan Xiao , Jingdong Wang

Interpretable communication is essential for safe and trustworthy autonomous driving, yet current vision-language models (VLMs) often operate under idealized assumptions and struggle to capture user intent in real-world scenarios. Existing…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Djamahl Etchegaray , Yuxia Fu , Zi Huang , Yadan Luo

Current roadside perception systems mainly focus on instance-level perception, which fall short in enabling interaction via natural language and reasoning about traffic behaviors in context. To bridge this gap, we introduce RoadSceneVQA, a…

Computer Vision and Pattern Recognition · Computer Science 2025-12-29 Runwei Guan , Rongsheng Hu , Shangshu Chen , Ningyuan Xiao , Xue Xia , Jiayang Liu , Beibei Chen , Ziren Tang , Ningwei Ouyang , Shaofeng Liang , Yuxuan Fan , Wanjie Sun , Yutao Yue

The increasing demand for intelligent systems capable of interpreting and reasoning about visual content requires the development of large Vision-and-Language Models (VLMs) that are not only accurate but also have explicit reasoning…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Kohei Uehara , Nabarun Goswami , Hanqin Wang , Toshiaki Baba , Kohtaro Tanaka , Tomohiro Hashimoto , Kai Wang , Rei Ito , Takagi Naoya , Ryo Umagami , Yingyi Wen , Tanachai Anakewat , Tatsuya Harada

Automated neural network architecture design remains a significant challenge in computer vision. Task diversity and computational constraints require both effective architectures and efficient search methods. Large Language Models (LLMs)…

Computer Vision and Pattern Recognition · Computer Science 2026-04-17 Raghuvir Duvvuri , Chandini Vysyaraju , Avi Goyal , Dmitry Ignatov , Radu Timofte

Multimodal Large Language Models advance multimodal representation learning by acquiring transferable semantic embeddings, thereby substantially enhancing performance across a range of vision-language tasks, including cross-modal retrieval,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Da Li , Yuxiao Luo , Keping Bi , Jiafeng Guo , Wei Yuan , Biao Yang , Yan Wang , Fan Yang , Tingting Gao , Guorui Zhou

Multimodal Vision-Language Models (VLMs) enable powerful applications from their fused understanding of images and language, but many perform poorly on UI tasks due to the lack of UI training data. In this paper, we adapt a recipe for…

Human-Computer Interaction · Computer Science 2023-10-10 Yue Jiang , Eldon Schoop , Amanda Swearngin , Jeffrey Nichols

Recent advances in Large Language Models (LLMs) and Vision Language Models (VLMs) have shown significant progress in mathematical reasoning, yet they still face a critical bottleneck with problems requiring visual assistance, such as…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Chengqi Duan , Kaiyue Sun , Rongyao Fang , Manyuan Zhang , Yan Feng , Ying Luo , Yufang Liu , Ke Wang , Peng Pei , Xunliang Cai , Hongsheng Li , Yi Ma , Xihui Liu

Multi-modal Large Language Models (MLLMs) have introduced a novel dimension to document understanding, i.e., they endow large language models with visual comprehension capabilities; however, how to design a suitable image-text pre-training…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Zining Wang , Tongkun Guan , Pei Fu , Chen Duan , Qianyi Jiang , Zhentao Guo , Shan Guo , Junfeng Luo , Wei Shen , Xiaokang Yang

Large vision language models (VLMs) have demonstrated significant potential for integration into daily life, making it crucial for them to incorporate human values when making decisions in real-world situations. This paper introduces VIVA,…

Computation and Language · Computer Science 2024-10-11 Zhe Hu , Yixiao Ren , Jing Li , Yu Yin

In a globalized world, cultural elements from diverse origins frequently appear together within a single visual scene. We refer to these as culture mixing scenarios, yet how Large Vision-Language Models (LVLMs) perceive them remains…

Computer Vision and Pattern Recognition · Computer Science 2025-12-11 Eunsu Kim , Junyeong Park , Na Min An , Junseong Kim , Hitesh Laxmichand Patel , Jiho Jin , Julia Kruk , Amit Agarwal , Srikant Panda , Fenal Ashokbhai Ilasariya , Hyunjung Shim , Alice Oh

Generating images with conditional descriptions gains increasing interests in recent years. However, existing conditional inputs are suffering from either unstructured forms (captions) or limited information and expensive labeling (scene…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Tao Ma , Yikang Li

Integrating large language models (LLMs) into autonomous driving motion planning has recently emerged as a promising direction, offering enhanced interpretability, better controllability, and improved generalization in rare and long-tail…

Artificial Intelligence · Computer Science 2025-07-29 Zhipeng Tang , Sha Zhang , Jiajun Deng , Chenjie Wang , Guoliang You , Yuting Huang , Xinrui Lin , Yanyong Zhang

Autonomous driving systems depend on on models that can reason about high-level scene contexts and accurately predict the dynamics of their surrounding environment. Vision- Language Models (VLMs) have recently emerged as promising tools for…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Stefan Englmeier , Katharina Winter , Fabian B. Flohr

Vision-Language Models (VLMs) have been applied to autonomous driving to support decision-making in complex real-world scenarios. However, their training on static, web-sourced image-text pairs fundamentally limits the precise…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Keishi Ishihara , Kento Sasaki , Tsubasa Takahashi , Daiki Shiono , Yu Yamaguchi

While Multimodal Large Language Models (MLLMs) excel at general vision-language tasks, visuospatial cognition - reasoning about spatial layouts, relations, and dynamics - remains a significant challenge. Existing models often lack the…

Computer Vision and Pattern Recognition · Computer Science 2025-09-10 Qi Feng

This report provides an architecture-led analysis of two modern vision-language models (VLMs), Qwen2.5-VL-7B-Instruct and Llama-4-Scout-17B-16E-Instruct, and explains how their architectural properties map to a practical video-to-artifact…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Thomson Tong , Diba Darooneh

Human language is grounded on multimodal knowledge including visual knowledge like colors, sizes, and shapes. However, current large-scale pre-trained language models rely on text-only self-supervised training with massive text data, which…

Computation and Language · Computer Science 2023-02-28 Weizhi Wang , Li Dong , Hao Cheng , Haoyu Song , Xiaodong Liu , Xifeng Yan , Jianfeng Gao , Furu Wei

Scaling Vision-Language-Action (VLA) models requires massive datasets that are both semantically coherent and physically feasible. However, existing scene generation methods often lack context-awareness, making it difficult to synthesize…

Robotics · Computer Science 2026-04-13 Yaru Liu , Ao-bo Wang , Nanyang Ye

Vision-Language Models (VLMs) have made significant strides in static image understanding but continue to face critical hurdles in spatiotemporal reasoning. A major bottleneck is "multi-image reasoning hallucination", where a massive…

Artificial Intelligence · Computer Science 2026-04-14 Xiaoda Yang , Shuai Yang , Can Wang , Jingyang Xue , Menglan Tang , Checheng Yu , Xunzhe Zhou , Sashuai Zhou , Tao Jin , Lixin Yang , Xiangyu Yue , Zhou Zhao