English
Related papers

Related papers: MITS: A Large-Scale Multimodal Benchmark Dataset f…

200 papers

A robust and efficient traffic monitoring system is essential for smart cities and Intelligent Transportation Systems (ITS), using sensors and cameras to track vehicle movements, optimize traffic flow, reduce congestion, enhance road…

Artificial Intelligence · Computer Science 2026-01-23 Murat Arda Onsu , Poonam Lohan , Burak Kantarci , Aisha Syed , Matthew Andrews , Sean Kennedy

In this paper, we address the challenge of fine-grained video event understanding in traffic scenarios, vital for autonomous driving and safety. Traditional datasets focus on driver or vehicle behavior, often neglecting pedestrian…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Quan Kong , Yuki Kawana , Rajat Saini , Ashutosh Kumar , Jingjing Pan , Ta Gu , Yohei Ozao , Balazs Opra , David C. Anastasiu , Yoichi Sato , Norimasa Kobori

Large Vision-Language Models (LVLMs) show significant strides in general-purpose multimodal applications such as visual dialogue and embodied navigation. However, existing multimodal evaluation benchmarks cover a limited number of…

Intelligent Transportation Systems (ITS) are crucial for the development and operation of smart cities, addressing key challenges in efficiency, productivity, and environmental sustainability. This paper comprehensively reviews the…

Systems and Control · Electrical Eng. & Systems 2025-01-09 Doaa Mahmud , Hadeel Hajmohamed , Shamma Almentheri , Shamma Alqaydi , Lameya Aldhaheri , Ruhul Amin Khalil , Nasir Saeed

In the evolving landscape of transportation systems, integrating Large Language Models (LLMs) offers a promising frontier for advancing intelligent decision-making across various applications. This paper introduces a novel 3-dimensional…

Machine Learning · Computer Science 2024-12-17 Dexter Le , Aybars Yunusoglu , Karn Tiwari , Murat Isik , I. Can Dikmen

Large Multimodal Models (LMMs) have recently gained prominence in autonomous driving research, showcasing promising capabilities across various emerging benchmarks. LMMs specifically designed for this domain have demonstrated effective…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Ayesha Ishaq , Jean Lahoud , Fahad Shahbaz Khan , Salman Khan , Hisham Cholakkal , Rao Muhammad Anwer

Large language models (LLMs) and multimodal large models (MLLMs) are increasingly used for transportation tasks such as regulation question answering, traffic management support, engineering review, and autonomous-driving scene reasoning.…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Han Gong , Zhen Zhou , Yunyang Shi , Yan Tan , Jinbiao Huo , Qi Hong , Zhiyuan Liu

Multimodal interleaved datasets featuring free-form interleaved sequences of images and text are crucial for training frontier large multimodal models (LMMs). Despite the rapid progression of open-source LMMs, there remains a pronounced…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Anas Awadalla , Le Xue , Oscar Lo , Manli Shu , Hannah Lee , Etash Kumar Guha , Matt Jordan , Sheng Shen , Mohamed Awadalla , Silvio Savarese , Caiming Xiong , Ran Xu , Yejin Choi , Ludwig Schmidt

The integration of Large Language Models (LLMs) with computer vision is profoundly transforming perception tasks like image segmentation. For intelligent transportation systems (ITS), where accurate scene understanding is critical for…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Sanjeda Akter , Ibne Farabi Shihab , Anuj Sharma

We introduce MMIS, a novel dataset designed to advance MultiModal Interior Scene generation and recognition. MMIS consists of nearly 160,000 images. Each image within the dataset is accompanied by its corresponding textual description and…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Hozaifa Kassab , Ahmed Mahmoud , Mohamed Bahaa , Ammar Mohamed , Ali Hamdi

Due to the high complexity and occlusion, insufficient perception in the crowded urban intersection can be a serious safety risk for both human drivers and autonomous algorithms, whereas CVIS (Cooperative Vehicle Infrastructure System) is a…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Huanan Wang , Xinyu Zhang , Jun Li , Zhiwei Li , Lei Yang , Shuyue Pan , Yongqiang Deng

Multimodal Large Language Models (MLLMs) have achieved significant advances in integrating visual and linguistic information, yet their ability to reason about complex and real-world scenarios remains limited. The existing benchmarks are…

Traffic safety remains a critical global challenge, with traditional Advanced Driver-Assistance Systems (ADAS) often struggling in dynamic real-world scenarios due to fragmented sensor processing and susceptibility to adversarial…

Computer Vision and Pattern Recognition · Computer Science 2025-04-24 Mohammad Abu Tami , Mohammed Elhenawy , Huthaifa I. Ashqar

Recent advancements in Multimodal Large Language Models (MLLMs) have demonstrated impressive capabilities in general visual understanding. However, their application to safety-critical driving scenarios remains limited by an inability to…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Tomaso Trinci , Henrique Piñeiro Monteagudo , Leonardo Taccari

Large Vision-Language Models (VLMs) have achieved remarkable performance across a wide range of tasks. However, their deployment in safety-critical domains poses significant challenges. Existing safety fine-tuning methods, which focus on…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Yi Ding , Lijun Li , Bing Cao , Jing Shao

This paper introduces the Emirates Multi-Task (EMT) dataset, designed to support multi-task benchmarking within a unified framework. It comprises over 30,000 frames from a dash-camera perspective and 570,000 annotated bounding boxes,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-26 Nadya Abdel Madjid , Murad Mebrahtu , Abdulrahman Ahmad , Abdelmoamen Nasser , Bilal Hassan , Naoufel Werghi , Jorge Dias , Majid Khonji

Recent evaluations of Large Multimodal Models (LMMs) have explored their capabilities in various domains, with only few benchmarks specifically focusing on urban environments. Moreover, existing urban benchmarks have been limited to…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Baichuan Zhou , Haote Yang , Dairong Chen , Junyan Ye , Tianyi Bai , Jinhua Yu , Songyang Zhang , Dahua Lin , Conghui He , Weijia Li

The application of Multi-modal Large Language Models (MLLMs) in Autonomous Driving (AD) faces significant challenges due to their limited training on traffic-specific data and the absence of dedicated benchmarks for spatiotemporal…

Computer Vision and Pattern Recognition · Computer Science 2025-01-13 Korawat Charoenpitaks , Van-Quang Nguyen , Masanori Suganuma , Kentaro Arai , Seiji Totsuka , Hiroshi Ino , Takayuki Okatani

In Intelligent Transportation Systems (ITS), multi-object tracking is primarily based on frame-based cameras. However, these cameras tend to perform poorly under dim lighting and high-speed motion conditions. Event cameras, characterized by…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Mengyu Li , Xingcheng Zhou , Guang Chen , Alois Knoll , Hu Cao

Autonomous driving is a popular research area within the computer vision research community. Since autonomous vehicles are highly safety-critical, ensuring robustness is essential for real-world deployment. While several public multimodal…

‹ Prev 1 2 3 10 Next ›