中文
相关论文

相关论文: DeepScan: A Training-Free Framework for Visually G…

200 篇论文

Detecting DeepFakes has become a crucial research area as the widespread use of AI image generators enables the effortless creation of face-manipulated and fully synthetic content, while existing methods are often limited to binary…

计算机视觉与模式识别 · 计算机科学 2025-09-04 Rohit Kundu , Shan Jia , Vishal Mohanty , Athula Balachandran , Amit K. Roy-Chowdhury

Grounding large language models (LLMs) in domain-specific tasks like post-hoc dash-cam driving video analysis is challenging due to their general-purpose training and lack of structured inductive biases. As vision is often the sole modality…

计算机视觉与模式识别 · 计算机科学 2025-12-08 Manyi Yao , Bingbing Zhuang , Sparsh Garg , Amit Roy-Chowdhury , Christian Shelton , Manmohan Chandraker , Abhishek Aich

Large Multimodal Models (LMMs), or Vision-Language Models (VLMs), have shown impressive capabilities in a wide range of visual tasks. However, they often struggle with fine-grained visual reasoning, failing to identify domain-specific…

计算机视觉与模式识别 · 计算机科学 2025-02-26 Yucheng Shi , Quanzheng Li , Jin Sun , Xiang Li , Ninghao Liu

An increasing number of vision-language tasks can be handled with little to no training, i.e., in a zero and few-shot manner, by marrying large language models (LLMs) to vision encoders, resulting in large vision-language models (LVLMs).…

计算与语言 · 计算机科学 2024-04-03 Archiki Prasad , Elias Stengel-Eskin , Mohit Bansal

While reinforcement learning (RL) over chains of thought has significantly advanced language models in tasks such as mathematics and coding, visual reasoning introduces added complexity by requiring models to direct visual attention,…

计算机视觉与模式识别 · 计算机科学 2026-05-18 Gabriel Sarch , Snigdha Saha , Naitik Khandelwal , Ayush Jain , Michael J. Tarr , Aviral Kumar , Katerina Fragkiadaki

Large Vision-Language Models (LVLMs) face a tug-of-war between powerful linguistic priors and visual evidence, often leading to \emph{semantic drift}: a progressive detachment from the input image that can abruptly emerge at specific…

计算机视觉与模式识别 · 计算机科学 2026-03-17 Jiahe Chen , Jiaying He , Qiyuan Chen , Qian Shao , Jiahe Ying , Hongxia Xu , Jintai Chen , Jianwei Zheng , Jian Wu

Current video understanding models excel at recognizing "what" is happening but fall short in high-level cognitive tasks like causal reasoning and future prediction, a limitation rooted in their lack of commonsense world knowledge. To…

计算机视觉与模式识别 · 计算机科学 2025-12-30 L'ea Dubois , Klaus Schmidt , Chengyu Wang , Ji-Hoon Park , Lin Wang , Santiago Munoz

While Large Language Models (LLMs) achieve near-human performance on standard benchmarks, their capabilities often fail to generalize to complex, real-world problems. To bridge this gap, we introduce DeepQuestion, a scalable, automated…

The increasing demand for intelligent systems capable of interpreting and reasoning about visual content requires the development of large Vision-and-Language Models (VLMs) that are not only accurate but also have explicit reasoning…

Multimodal large language models (MLLMs) have achieved remarkable success across a broad range of vision tasks. However, constrained by the capacity of their internal world knowledge, prior work has proposed augmenting MLLMs by…

Building on the success of text-based reasoning models like DeepSeek-R1, extending these capabilities to multimodal reasoning holds great promise. While recent works have attempted to adapt DeepSeek-R1-style reinforcement learning (RL)…

计算机视觉与模式识别 · 计算机科学 2025-06-10 Jie Yang , Feipeng Ma , Zitian Wang , Dacheng Yin , Kang Rong , Fengyun Rao , Ruimao Zhang

Recent Large Vision-Language Models (LVLMs) have advanced multi-modal understanding by incorporating finer-grained visual perception and encoding. However, such methods incur significant computational costs due to longer visual token…

计算机视觉与模式识别 · 计算机科学 2026-02-02 Ce Zhang , Kaixin Ma , Tianqing Fang , Wenhao Yu , Hongming Zhang , Zhisong Zhang , Haitao Mi , Dong Yu

We introduce OpenVLThinker, one of the first open-source large vision-language models (LVLMs) to exhibit sophisticated chain-of-thought reasoning, achieving notable performance gains on challenging visual reasoning tasks. While text-based…

计算机视觉与模式识别 · 计算机科学 2025-11-12 Yihe Deng , Hritik Bansal , Fan Yin , Nanyun Peng , Wei Wang , Kai-Wei Chang

High-resolution (HR) image perception presents a key bottleneck for multimodal large language models (MLLMs). While visual search offers a promising solution, existing methods struggle with the trade-off between coverage and efficiency.…

计算机视觉与模式识别 · 计算机科学 2026-05-25 Liupeng Li , Haoqian Kang , Zhenyu Lu , Jinpeng Wang , Bin Chen , Ke Chen , Yaowei Wang

Human language is grounded on multimodal knowledge including visual knowledge like colors, sizes, and shapes. However, current large-scale pre-trained language models rely on text-only self-supervised training with massive text data, which…

计算与语言 · 计算机科学 2023-02-28 Weizhi Wang , Li Dong , Hao Cheng , Haoyu Song , Xiaodong Liu , Xifeng Yan , Jianfeng Gao , Furu Wei

Vision-Language Models often struggle with complex visual reasoning due to the visual information loss in textual CoT. Existing methods either add the cost of tool calls or rely on localized patch-based embeddings that are insufficient to…

计算与语言 · 计算机科学 2026-04-10 Mengdan Zhu , Senhao Cheng , Liang Zhao

Understanding long-form egocentric videos remains challenging for multimodal large language models (MLLMs) due to limited context length and insufficient grounding of fine-grained visual details. The recently proposed HD-EPIC benchmark…

计算机视觉与模式识别 · 计算机科学 2026-05-29 Yinsong Xu , Wei Jing , Liuxin Zhang , Wanjun Lv , Hui Li

The proliferation of deepfake faces poses huge potential negative impacts on our daily lives. Despite substantial advancements in deepfake detection over these years, the generalizability of existing methods against forgeries from unseen…

计算机视觉与模式识别 · 计算机科学 2025-04-14 Kaiqing Lin , Yuzhen Lin , Weixiang Li , Taiping Yao , Bin Li

Large Vision-Language Models (LVLMs) have become powerful general-purpose assistants, yet their predictions often lack reliability and interpretability due to insufficient grounding in visual evidence. The emerging thinking-with-images…

计算机视觉与模式识别 · 计算机科学 2026-02-04 Meng Cao , Haoze Zhao , Can Zhang , Xiaojun Chang , Ian Reid , Xiaodan Liang

While Vision-Language Models (VLMs) excel in many areas, they struggle with complex spatial reasoning, which requires problem decomposition and strategic tool use. Fine-tuning smaller, more deployable models offers an efficient path to…

机器学习 · 计算机科学 2025-11-04 Gio Huh , Dhruv Sheth , Rayhan Zirvi , Frank Xiao