中文
相关论文

相关论文: VisualNeedle: Benchmarking Active Visual Search in…

200 篇论文

The visual world around us constantly evolves, from real-time news and social media trends to global infrastructure changes visible through satellite imagery and augmented reality enhancements. However, Multimodal Large Language Models…

计算机视觉与模式识别 · 计算机科学 2025-07-02 Mingyang Fu , Yuyang Peng , Dongping Chen , Zetong Zhou , Benlin Liu , Yao Wan , Zhou Zhao , Philip S. Yu , Ranjay Krishna

Multimodal Large Language Models (MLLMs) have displayed remarkable performance in multi-modal tasks, particularly in visual comprehension. However, we reveal that MLLMs often generate incorrect answers even when they understand the visual…

计算机视觉与模式识别 · 计算机科学 2025-03-20 Yexin Liu , Zhengyang Liang , Yueze Wang , Xianfeng Wu , Feilong Tang , Muyang He , Jian Li , Zheng Liu , Harry Yang , Sernam Lim , Bo Zhao

Large Vision-Language Models (LVLMs) have demonstrated outstanding performance across various multimodal tasks. However, they suffer from a problem known as language prior, where responses are generated based solely on textual patterns…

人工智能 · 计算机科学 2025-02-11 Kang-il Lee , Minbeom Kim , Seunghyun Yoon , Minsung Kim , Dongryeol Lee , Hyukhun Koh , Kyomin Jung

Large vision-language models (LVLMs) have significantly improved multimodal reasoning tasks, such as visual question answering and image captioning. These models embed multimodal facts within their parameters, rather than relying on…

计算与语言 · 计算机科学 2025-02-18 Shengkang Wang , Hongzhan Lin , Ziyang Luo , Zhen Ye , Guang Chen , Jing Ma

Recent advances in multimodal large language models (MLLMs) have substantially expanded the capabilities of multimodal retrieval, enabling systems to align and retrieve information across visual and textual modalities. Yet, existing…

计算机视觉与模式识别 · 计算机科学 2026-03-03 Xuan Lu , Kangle Li , Haohang Huang , Rui Meng , Wenjun Zeng , Xiaoyu Shen

Vision-Language Models (VLMs) have achieved impressive performance in cross-modal understanding across textual and visual inputs, yet existing benchmarks predominantly focus on pure-text queries. In real-world scenarios, language also…

计算机视觉与模式识别 · 计算机科学 2026-05-19 Qing'an Liu , Juntong Feng , Yuhao Wang , Xinzhe Han , Yujie Cheng , Yue Zhu , Haiwen Diao , Yunzhi Zhuge , Huchuan Lu

Large vision-language models (LVLMs) have demonstrated remarkable achievements, yet the generation of non-factual responses remains prevalent in fact-seeking question answering (QA). Current multimodal fact-seeking benchmarks primarily…

计算与语言 · 计算机科学 2025-03-11 Yanling Wang , Yihan Zhao , Xiaodong Chen , Shasha Guo , Lixin Liu , Haoyang Li , Yong Xiao , Jing Zhang , Qi Li , Ke Xu

Understanding multi-image, multi-turn scenarios is a critical yet underexplored capability for Large Vision-Language Models (LVLMs). Existing benchmarks predominantly focus on static or horizontal comparisons -- e.g., spotting visual…

计算机视觉与模式识别 · 计算机科学 2025-12-09 Wenbo Lyu , Yingjun Du , Jinglin Zhao , Xianton Zhen , Ling Shao

Visual perception in modern Vision-Language Models (VLMs) is constrained by a perceptual bandwidth bottleneck: a broad field of view preserves global context but sacrifices the fine-grained details required for complex reasoning. We argue…

计算机视觉与模式识别 · 计算机科学 2026-05-12 Anjie Liu , Ziqin Gong , Yan Song , Yuxiang Chen , Xiaolong Liu , Hengtong Lu , Kaike Zhang , Chen Wei , Jun Wang

Large Vision Language Models (LVLMs) have demonstrated impressive zero-shot capabilities in various vision-language dialogue scenarios. However, the absence of fine-grained visual object detection hinders the model from understanding the…

计算与语言 · 计算机科学 2024-04-15 Junyu Lu , Dixiang Zhang , Songxin Zhang , Zejian Xie , Zhuoyang Song , Cong Lin , Jiaxing Zhang , Bingyi Jing , Pingjian Zhang

Memory is essential for large vision-language models (LVLMs) to handle long, multimodal interactions, with two method directions providing this capability: long-context LVLMs and memory-augmented agents. However, no existing benchmark…

计算机视觉与模式识别 · 计算机科学 2026-05-15 Xiyu Ren , Zhaowei Wang , Yiming Du , Zhongwei Xie , Chi Liu , Xinlin Yang , Haoyue Feng , Wenjun Pan , Tianshi Zheng , Baixuan Xu , Zhengnan Li , Yangqiu Song , Ginny Wong , Simon See

Multimodal Large Language Models (MLLMs) are evaluated on various benchmarks, such as image captioning, visual question answering, and reasoning. However, many of these benchmarks include overly simple or uninformative samples, complicating…

Large Vision-Language Models (LVLMs) increasingly rely on retrieval to answer knowledge-intensive multimodal questions. Existing benchmarks overlook conflicts between visual and textual evidence and the importance of generating deflections…

计算与语言 · 计算机科学 2026-04-15 Nicholas Moratelli , Christopher Davis , Leonardo F. R. Ribeiro , Bill Byrne , Gonzalo Iglesias

Multimodal large language models (MLLMs) have achieved strong performance on vision-language tasks but still struggle with fine-grained visual differences, leading to hallucinations or missed semantic shifts. We attribute this to…

计算机视觉与模式识别 · 计算机科学 2025-06-10 Tianyi Bai , Yuxuan Fan , Jiantao Qiu , Fupeng Sun , Jiayi Song , Junlin Han , Zichen Liu , Conghui He , Wentao Zhang , Binhang Yuan

While multimodal large language models (MLLMs) have demonstrated extraordinary vision-language understanding capabilities, their abilities to solve instance-level visual-language problems beyond a single image warrant further exploration.…

计算机视觉与模式识别 · 计算机科学 2025-07-23 Yunqiu Xu , Linchao Zhu , Yi Yang

One of the main objectives in developing large vision-language models (LVLMs) is to engineer systems that can assist humans with multimodal tasks, including interpreting descriptions of perceptual experiences. A central phenomenon in this…

计算与语言 · 计算机科学 2025-07-09 Amane Watahiki , Tomoki Doi , Taiga Shinozaki , Satoshi Nishida , Takuya Niikawa , Katsunori Miyahara , Hitomi Yanaka

Visual reasoning is a core component of human intelligence and a critical capability for advanced multimodal models. Yet current reasoning evaluations of multimodal large language models (MLLMs) often rely on text descriptions and allow…

计算机视觉与模式识别 · 计算机科学 2025-04-22 Weiye Xu , Jiahao Wang , Weiyun Wang , Zhe Chen , Wengang Zhou , Aijun Yang , Lewei Lu , Houqiang Li , Xiaohua Wang , Xizhou Zhu , Wenhai Wang , Jifeng Dai , Jinguo Zhu

Multi-modal Large Language Models (MLLMs) have significantly advanced video reasoning, yet Video Question Answering (VideoQA) remains challenging due to its demand for temporal causal reasoning and evidence-grounded answer generation.…

计算机视觉与模式识别 · 计算机科学 2026-03-17 Kaixin zhang , Xiaohe Li , Jiahao Li , Haohua Wu , Xinyu Zhao , Zide Fan , Lei Wang

Reading measurement instruments is effortless for humans and requires relatively little domain expertise, yet it remains surprisingly challenging for current vision-language models (VLMs) as we find in preliminary evaluation. In this work,…

计算机视觉与模式识别 · 计算机科学 2026-03-25 Fenfen Lin , Yesheng Liu , Haiyu Xu , Chen Yue , Zheqi He , Mingxuan Zhao , Miguel Hu Chen , Jiakang Liu , JG Yao , Xi Yang

Large Language Models (LLMs) have evolved from simple chatbots into sophisticated agents capable of automating complex real-world tasks, where browsing and reasoning over live web content is key to assessing retrieval and cognitive skills.…

人工智能 · 计算机科学 2025-12-19 Yumeng Wang , Tianyu Fan , Lingrui Xu , Chao Huang