中文
相关论文

相关论文: Fine-Tuning Vision-Language Models for Understandi…

200 篇论文

Safety-critical infrastructures, such as bridges, are periodically inspected to check for existing damage, such as fatigue cracks and corrosion, and to guarantee the safe use of the infrastructure. Visual inspection is the most frequent…

计算机视觉与模式识别 · 计算机科学 2024-03-29 Andrii Kompanets , Remco Duits , Davide Leonetti , Nicky van den Berg , H. H. , Snijder

Large language models (LLMs) exhibit cultural bias from overrepresented viewpoints in training data, yet cultural alignment remains a challenge due to limited cultural knowledge and a lack of exploration into effective learning approaches.…

计算与语言 · 计算机科学 2025-12-16 Chunhua Liu , Kabir Manandhar Shrestha , Sukai Huang

Heavy-duty trucks pose significant safety challenges due to their large size and limited maneuverability compared to passenger vehicles. A deeper understanding of truck characteristics is essential for enhancing the safety perspective of…

计算机视觉与模式识别 · 计算机科学 2025-04-14 Yiqiao Li , Jie Wei , Camille Kamga

Vision-language models (VLMs) have shown strong potential for scientific image understanding, but general-purpose models often lack the domain-specific visual knowledge required for reliable materials characterization. In this work, we…

材料科学 · 物理学 2026-05-11 Quanliang Liu , Jungtaek Kim , Kangwook Lee , Hyunseok Oh

Autonomous driving systems face significant challenges in handling unpredictable edge-case scenarios, such as adversarial pedestrian movements, dangerous vehicle maneuvers, and sudden environmental changes. Current end-to-end driving models…

计算机视觉与模式识别 · 计算机科学 2026-03-30 Dianwei Chen , Zifan Zhang , Lei Cheng , Yuchen Liu , Xianfeng Terry Yang

Recent progress in BIQA has been driven by VLMs, whose semantic reasoning abilities suggest that they might extract visual features, generate descriptive text, and infer quality in a human-like manner. However, these models often produce…

计算机视觉与模式识别 · 计算机科学 2025-12-11 Yuan Li , Zitang Sun , Yen-ju Chen , Shin'ya Nishida

Ensuring the safety of vulnerable road users (VRUs), such as pedestrians and cyclists, is a critical challenge for autonomous driving systems, as crashes involving VRUs often result in severe or fatal consequences. While multimodal large…

计算机视觉与模式识别 · 计算机科学 2025-07-23 Younggun Kim , Ahmed S. Abdelrahman , Mohamed Abdel-Aty

Large-scale Vision-Language Models (LVLMs) process both images and text, excelling in multimodal tasks such as image captioning and description generation. However, while these models excel at generating factual content, their ability to…

Systematic reviews traditionally have taken considerable amounts of human time and energy to complete, in part due to the extensive number of titles and abstracts that must be reviewed for potential inclusion. Recently, researchers have…

计算与语言 · 计算机科学 2026-03-27 Kweku Yamoah , Noah Schroeder , Emmanuel Dorley , Neha Rani , Caleb Schutz

Large Vision-Language Models (VLMs) are increasingly used to evaluate outputs of other models, for image-to-text (I2T) tasks such as visual question answering, and text-to-image (T2I) generation tasks. Despite this growing reliance, the…

计算机视觉与模式识别 · 计算机科学 2026-04-24 Mohammed Safi Ur Rahman Khan , Sanjay Suryanarayanan , Tushar Anand , Mitesh M. Khapra

Benefiting from the powerful capabilities of Large Language Models (LLMs), pre-trained visual encoder models connected to LLMs form Vision Language Models (VLMs). However, recent research shows that the visual modality in VLMs is highly…

计算机视觉与模式识别 · 计算机科学 2025-01-14 Zhendong Liu , Yuanbi Nie , Yingshui Tan , Jiaheng Liu , Xiangyu Yue , Qiushi Cui , Chongjun Wang , Xiaoyong Zhu , Bo Zheng

In this paper, we introduce Flash-VL 2B, a novel approach to optimizing Vision-Language Models (VLMs) for real-time applications, targeting ultra-low latency and high throughput without sacrificing accuracy. Leveraging advanced…

计算机视觉与模式识别 · 计算机科学 2025-05-15 Bo Zhang , Shuo Li , Runhe Tian , Yang Yang , Jixin Tang , Jinhao Zhou , Lin Ma

Quantized Large Language Models (LLMs) are used more often in qualitative analysis because they run fast and need fewer computing resources. This study examines how different lower bits quantization levels (8-bit, 4-bit, 3-bit, and 2-bit)…

计算与语言 · 计算机科学 2026-05-21 Aisvarya Adeseye , Jouni Isoaho , Adeyemi Adeseye

Vision-Language Models (VLMs) have shown strong performance in tasks like visual question answering and multimodal text generation, but their effectiveness in scientific domains such as materials science remains limited. While some machine…

机器学习 · 计算机科学 2025-11-11 An Vuong , Minh-Hao Van , Prateek Verma , Chen Zhao , Xintao Wu

Conventional construction safety inspection methods are often inefficient as they require navigating through large volume of information. Recent advances in large vision-language models (LVLMs) provide opportunities to automate safety…

计算机视觉与模式识别 · 计算机科学 2025-10-07 Chenxin Wang , Elyas Asadi Shamsabadi , Zhaohui Chen , Luming Shen , Alireza Ahmadian Fard Fini , Daniel Dias-da-Costa

Recent work applies Large Language Models (LLMs) to source-code vulnerability detection, but most evaluations still rely on random train-test splits that ignore time and overestimate real-world performance. In practice, detectors are…

密码学与安全 · 计算机科学 2026-03-02 Xuhui Dou , Hayretdin Bahsi , Alejandro Guerra-Manzanares

Benchmark accuracy is often implicitly assumed to reflect grounded visual understanding in vision-language models (VLMs), yet it remains unclear to what extent such scores truly reflect reliance on visual evidence. Motivated by a surprising…

计算机视觉与模式识别 · 计算机科学 2026-05-25 Zixuan Lan , Luzhe Sun , Matthew R. Walter , Jiawei Zhou

Process-supervised reward models serve as a fine-grained function that provides detailed step-wise feedback to model responses, facilitating effective selection of reasoning trajectories for complex tasks. Despite its advantages, evaluation…

计算机视觉与模式识别 · 计算机科学 2025-03-27 Haoqin Tu , Weitao Feng , Hardy Chen , Hui Liu , Xianfeng Tang , Cihang Xie

Recent Multimodal Large Language Models (MLLMs) excel on benchmark vision-language tasks, yet little is known about how input visual quality shapes their responses. Does higher perceptual quality of images already translate to better MLLM…

计算机视觉与模式识别 · 计算机科学 2025-06-19 Shuo Xing , Lanqing Guo , Hongyuan Hua , Seoyoung Lee , Peiran Li , Yufei Wang , Zhangyang Wang , Zhengzhong Tu

Construction safety inspection remains mostly manual, and automated approaches still rely on task-specific datasets that are hard to maintain in fast-changing construction environments due to frequent retraining. Meanwhile, field inspection…

机器人学 · 计算机科学 2025-12-17 Hossein Naderi , Alireza Shojaei , Philip Agee , Kereshmeh Afsari , Abiola Akanmu