中文
相关论文

相关论文: OR-VSKC: Resolving Visual-Semantic Knowledge Confl…

200 篇论文

Large Vision and Language Models (LVLMs) have shown strong performance across various vision-language tasks in natural image domains. However, their application to remote sensing (RS) remains underexplored due to significant domain…

计算机视觉与模式识别 · 计算机科学 2025-06-30 Sungjune Park , Yeongyun Kim , Se Yeon Kim , Yong Man Ro

The prevalence of vision-threatening eye diseases is a significant global burden, with many cases remaining undiagnosed or diagnosed too late for effective treatment. Large vision-language models (LVLMs) have the potential to assist in…

计算机视觉与模式识别 · 计算机科学 2025-02-06 Zhenyue Qin , Yu Yin , Dylan Campbell , Xuansheng Wu , Ke Zou , Yih-Chung Tham , Ninghao Liu , Xiuzhen Zhang , Qingyu Chen

Visual rating is an essential capability of artificial intelligence (AI) for multi-dimensional quantification of visual content, primarily applied in ordinal regression (OR) tasks such as image quality assessment, facial age estimation, and…

计算机视觉与模式识别 · 计算机科学 2025-06-03 Jinhong Wang , Shuo Tong , Jian liu , Dongqi Tang , Jintai Chen , Haochao Ying , Hongxia Xu , Danny Chen , Jian Wu

Vision-Language Models (VLMs) excel at understanding single images, aided by high-quality instruction datasets. However, multi-image reasoning remains underexplored in the open-source community due to two key challenges: (1) scaling…

计算机视觉与模式识别 · 计算机科学 2025-02-18 Andrew Li , Rahul Thapa , Rahul Chalamala , Qingyang Wu , Kezhen Chen , James Zou

Vision-language models (VLMs) excel in various visual benchmarks but are often constrained by the lack of high-quality visual fine-tuning data. To address this challenge, we introduce VisCon-100K, a novel dataset derived from interleaved…

计算与语言 · 计算机科学 2025-02-25 Gokul Karthik Kumar , Iheb Chaabane , Kebin Wu

Multimodal Large Language Models (MLLMs) are a major focus of recent AI research. However, most prior work focuses on static image understanding, while their ability to process sequential audio-video data remains underexplored. This gap…

人工智能 · 计算机科学 2026-05-28 Ahmed Y. Radwan , Christos Emmanouilidis , Hina Tabassum , Deval Pandya , Shaina Raza

Large Vision-Language Models (LVLMs) have achieved impressive performance across multimodal understanding and reasoning tasks, yet their internal safety mechanisms remain opaque and poorly controlled. In this work, we present a…

计算机视觉与模式识别 · 计算机科学 2026-03-31 Jinhu Fu , Yihang Lou , Qingyi Si , Shudong Zhang , Yan Bai , Sen Su

The surgical intervention is crucial to patient healthcare, and many studies have developed advanced algorithms to provide understanding and decision-making assistance for surgeons. Despite great progress, these algorithms are developed for…

计算机视觉与模式识别 · 计算机科学 2024-05-15 Zhen Chen , Xingjian Luo , Jinlin Wu , Danny T. M. Chan , Zhen Lei , Jinqiao Wang , Sebastien Ourselin , Hongbin Liu

DeepSeek-OCR utilizes an optical 2D mapping approach to achieve high-ratio vision-text compression, claiming to decode text tokens exceeding ten times the input visual tokens. While this suggests a promising solution for the LLM…

计算与语言 · 计算机科学 2026-01-09 Yunhao Liang , Ruixuan Ying , Bo Li , Hong Li , Kai Yan , Qingwen Li , Min Yang , Okamoto Satoshi , Zhe Cui , Shiwen Ni

We propose VISION-SLS, a method for nonlinear output-feedback control from high-resolution RGB images which provides robust constraint satisfaction guarantees under calibrated uncertainty bounds despite partial observability, sensor noise,…

机器人学 · 计算机科学 2026-04-29 Antoine P. Leeman , Shuyu Zhan , Melanie N. Zeilinger , Glen Chou

Recent studies in Large Vision-Language Models (LVLMs) have demonstrated impressive advancements in multimodal Out-of-Context (OOC) misinformation detection, discerning whether an authentic image is wrongly used in a claim. Despite their…

机器学习 · 计算机科学 2025-02-18 Junjie Wu , Yumeng Fu , Nan Yu , Guohong Fu

Multimodal large language models (MLLMs) have demonstrated impressive capabilities in visual reasoning and text generation. While previous studies have explored the application of MLLM for detecting out-of-context (OOC) misinformation, our…

多媒体 · 计算机科学 2025-10-28 Fanxiao Li , Jiaying Wu , Canyuan He , Wei Zhou

Large language model (LLM) agents are increasingly used to assist with operations research (OR) modeling, yet existing OR-oriented benchmarks often reduce evaluation to one-shot translation from a self-contained problem statement into a…

人工智能 · 计算机科学 2026-05-28 Chenyu Zhou , Xinyun Lu , Jiangyue Zhao , Jianghao Lin , Dongdong Ge , Yinyu Ye

Artificial Intelligence (AI) is revolutionizing scientific research, yet its growing integration into laboratory environments presents critical safety challenges. Large language models (LLMs) and vision language models (VLMs) now assist in…

Security concerns related to Large Language Models (LLMs) have been extensively explored, yet the safety implications for Multimodal Large Language Models (MLLMs), particularly in medical contexts (MedMLLMs), remain insufficiently studied.…

密码学与安全 · 计算机科学 2024-08-22 Xijie Huang , Xinyuan Wang , Hantao Zhang , Yinghao Zhu , Jiawen Xi , Jingkun An , Hao Wang , Hao Liang , Chengwei Pan

Accurate and timely identification of construction hazards around workers is essential for preventing workplace accidents. While large vision-language models (VLMs) demonstrate strong contextual reasoning capabilities, their high…

计算机视觉与模式识别 · 计算机科学 2026-04-08 Muhammad Adil , Mehmood Ahmed , Muhammad Aqib , Vicente A. Gonzalez , Gaang Lee , Qipei Mei

Multimodal large language models (MLLMs) hold promise for integrating diverse data modalities, but current medical adaptations such as LLaVA-Med often fail to fully exploit the synergy between color fundus photography (CFP) and optical…

Large-scale language models (LLMs) often offer clinical judgments based on incomplete information, increasing the risk of misdiagnosis. Existing studies have primarily evaluated confidence in single-turn, static settings, overlooking the…

计算与语言 · 计算机科学 2026-01-23 Zhiyao Ren , Yibing Zhan , Siyuan Liang , Guozheng Ma , Baosheng Yu , Dacheng Tao

Multimodal Large Language Models (MLLMs) have advanced VQA and now support Vision-DeepResearch systems that use search engines for complex visual-textual fact-finding. However, evaluating these visual and textual search abilities is still…

Complex Visual Question Answering (Complex VQA) tasks, which demand sophisticated multi-modal reasoning and external knowledge integration, present significant challenges for existing large vision-language models (LVLMs) often limited by…

计算机视觉与模式识别 · 计算机科学 2025-08-12 Jingwei Peng , Jiehao Chen , Mateo Alejandro Rojas , Meilin Zhang