English
Related papers

Related papers: Integration of Large Vision Language Models for Ef…

200 papers

Traditional industrial automation systems require specialized expertise to operate and complex reprogramming to adapt to new processes. Large language models offer the intelligence to make them more flexible and easier to use. However,…

Systems and Control · Electrical Eng. & Systems 2025-06-16 Yuchen Xia , Nasser Jazdi , Jize Zhang , Chaitanya Shah , Michael Weyrich

Recent advancements in Large Language Models (LLMs) have paved the way for Vision Large Language Models (VLLMs) capable of performing a wide range of visual understanding tasks. While LLMs have demonstrated impressive performance on…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Muhammad Ali , Salman Khan

Large Vision-Language Models (LVLMs) have shown significant progress in video understanding, yet they face substantial challenges in tasks requiring precise spatiotemporal localization at the instance level. Existing methods primarily rely…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Yiming Zhao , Yu Zeng , Wenxuan Huang , Zhen Fang , Qing Miao , Qisheng Su , Jiawei Zhao , Jiayin Cai , Lin Chen , Zehui Chen , Yukun Qi , Yao Hu , Xiaolong Jiang , Feng Zhao

Traditional autonomous driving systems often struggle with reasoning in complex, unexpected scenarios due to limited comprehension of spatial relationships. In response, this study introduces a Large Language Model (LLM)-based Autonomous…

Computer Vision and Pattern Recognition · Computer Science 2025-02-12 Namhee Kim , Woojin Park

This study addresses the vital issue of real-time flood detection and management. It innovatively combines advanced deep learning models with Large language models (LLM), enhancing flood monitoring and response capabilities. This approach…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Pranath Reddy Kumbam , Kshitij Maruti Vejre

Incident response plays a pivotal role in mitigating the impact of cyber attacks. In recent years, the intensity and complexity of global cyber threats have grown significantly, making it increasingly challenging for traditional threat…

Cryptography and Security · Computer Science 2025-10-31 Xihuan Lin , Jie Zhang , Gelei Deng , Tianzhe Liu , Tianwei Zhang , Qing Guo , Riqing Chen

Latent Action Models (LAMs) have rapidly gained traction as an important component in the pre-training pipelines of leading Vision-Language-Action models. However, they fail when observations contain action-correlated distractors, often…

Post-disaster assessments of buildings and infrastructure are crucial for both immediate recovery efforts and long-term resilience planning. This research introduces an innovative approach to automating post-disaster assessments through…

Computer Vision and Pattern Recognition · Computer Science 2025-02-21 Robinson Umeike , Thang Dao , Shane Crawford

Follow-up conversations with virtual assistants (VAs) enable a user to seamlessly interact with a VA without the need to repeatedly invoke it using a keyword (after the first query). Therefore, accurate Device-directed Speech Detection…

Audio and Speech Processing · Electrical Eng. & Systems 2024-11-06 Ognjen , Rudovic , Pranay Dighe , Yi Su , Vineet Garg , Sameer Dharur , Xiaochuan Niu , Ahmed H. Abdelaziz , Saurabh Adya , Ahmed Tewfik

LLMs excel at linguistic tasks but lack the inner geospatial capabilities needed for time-critical disaster response, where reasoning about road networks, coordinates, and access to essential infrastructure such as hospitals, shelters, and…

Computation and Language · Computer Science 2026-03-27 Ahmed El Fekih Zguir , Ferda Ofli , Muhammad Imran

With the advancements in Large Language Models (LLMs), Vision-Language Models (VLMs) have reached a new level of sophistication, showing notable competence in executing intricate cognition and reasoning tasks. However, existing evaluation…

Computer Vision and Pattern Recognition · Computer Science 2023-11-27 Yuanfeng Ji , Chongjian Ge , Weikai Kong , Enze Xie , Zhengying Liu , Zhengguo Li , Ping Luo

Large language model (LLM) agents have demonstrated impressive capabilities in utilizing external tools and knowledge to boost accuracy and reduce hallucinations. However, developing prompting techniques that enable LLM agents to…

Vision-language models (VLMs) have emerged as powerful tools for enabling automated traffic analysis; however, current approaches often demand substantial computational resources and struggle with fine-grained spatio-temporal understanding.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-20 Tinh-Anh Nguyen-Nhu , Triet Dao Hoang Minh , Dat To-Thanh , Phuc Le-Gia , Tuan Vo-Lan , Tien-Huy Nguyen

Operational disaster response goes beyond damage assessment, requiring responders to integrate multi-sensor signals, reason over road networks, populations and key facilities, plan evacuations, and produce actionable reports. However, prior…

Artificial Intelligence · Computer Science 2026-05-13 Junjue Wang , Weihao Xuan , Heli Qi , Pengyu Dai , Kunyi Liu , Hongruixuan Chen , Zhuo Zheng , Junshi Xia , Stefano Ermon , Naoto Yokoya

Large-scale disasters can often result in catastrophic consequences on people and infrastructure. Situation awareness about such disaster impacts generated by authoritative data from in-situ sensors, remote sensing imagery, and/or…

Computation and Language · Computer Science 2025-12-01 Sameeah Noreen Hameed , Surangika Ranathunga , Raj Prasanna , Kristin Stock , Christopher B. Jones

Large Vision and Language Models (LVLMs) have shown strong performance across various vision-language tasks in natural image domains. However, their application to remote sensing (RS) remains underexplored due to significant domain…

Computer Vision and Pattern Recognition · Computer Science 2025-06-30 Sungjune Park , Yeongyun Kim , Se Yeon Kim , Yong Man Ro

The development of Large Vision-Language Models (LVLMs) is striving to catch up with the success of Large Language Models (LLMs), yet it faces more challenges to be resolved. Very recent works enable LVLMs to localize object-level visual…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Zhipeng Huang , Zhizheng Zhang , Zheng-Jun Zha , Yan Lu , Baining Guo

Large Language Models (LLMs) have revolutionized the simulation of agent societies, enabling autonomous planning, memory formation, and social interactions. However, existing frameworks often overlook systematic evaluations for event…

Artificial Intelligence · Computer Science 2025-09-17 Yuyang Tian , Shunqiang Mao , Wenchang Gao , Lanlan Qiu , Tianxing He

Large-scale Vision Language Models (LVLMs) exhibit advanced capabilities in tasks that require visual information, including object detection. These capabilities have promising applications in various industrial domains, such as autonomous…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Haruki Sakajo , Hiroshi Takato , Hiroshi Tsutsui , Komei Soda , Hidetaka Kamigaito , Taro Watanabe

Large Language Models (LLMs) have achieved remarkable success across a wide range of natural language tasks, and recent efforts have sought to extend their capabilities to multimodal domains and resource-constrained environments. However,…

Machine Learning · Computer Science 2025-05-26 Yun-Da Tsai