English
Related papers

Related papers: ViT-DD: Multi-Task Vision Transformer for Semi-Sup…

200 papers

In the domain of autonomous vehicles, the human-vehicle co-pilot system has garnered significant research attention. To address the subjective uncertainties in driver state and interaction behaviors, which are pivotal to the safety of…

Robotics · Computer Science 2024-12-09 Jie Wang , Mobing Cai , Zhongpan Zhu , Hongjun Ding , Jiwei Yi , Aimin Du

Advanced Driver Assistance Systems (ADAS) need to understand human driver behavior while perceiving their navigation context, but jointly learning these heterogeneous tasks would cause inter-task negative transfer and impair system…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Wenzhuo Liu , Qiannan Guo , Zhen Wang , Wenshuo Wang , Lei Yang , Yicheng Qiao , Lening Wang , Zhiwei Li , Chen Lv , Shanghang Zhang , Junqiang Xi , Huaping Liu

During the process of driving, humans usually rely on multiple senses to gather information and make decisions. Analogously, in order to achieve embodied intelligence in autonomous driving, it is essential to integrate multidimensional…

This article presents a synthetic distracted driving (SynDD2 - a continuum of SynDD1) dataset for machine learning models to detect and analyze drivers' various distracted behavior and different gaze zones. We collected the data in a…

Computer Vision and Pattern Recognition · Computer Science 2023-04-11 Mohammed Shaiqur Rahman , Jiyang Wang , Senem Velipasalar Gursoy , David Anastasiu , Shuo Wang , Anuj Sharma

Law enforcement and city safety are significantly impacted by detecting violent incidents in surveillance systems. Although modern (smart) cameras are widely available and affordable, such technological solutions are impotent in most…

Computer Vision and Pattern Recognition · Computer Science 2022-11-11 Sanskar Singh , Shivaibhav Dewangan , Ghanta Sai Krishna , Vandit Tyagi , Sainath Reddy , Prathistith Raj Medi

Prior works have proposed several strategies to reduce the computational cost of self-attention mechanism. Many of these works consider decomposing the self-attention procedure into regional and local feature extraction procedures that each…

Computer Vision and Pattern Recognition · Computer Science 2022-07-13 Ting Yao , Yehao Li , Yingwei Pan , Yu Wang , Xiao-Ping Zhang , Tao Mei

Sensor fusion is an essential topic in many perception systems, such as autonomous driving and robotics. Transformers-based detection head and CNN-based feature encoder to extract features from raw sensor-data has emerged as one of the best…

Computer Vision and Pattern Recognition · Computer Science 2023-02-23 Apoorv Singh

The classification of distracted drivers is pivotal for ensuring safe driving. Previous studies demonstrated the effectiveness of neural networks in automatically predicting driver distraction, fatigue, and potential hazards. However,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Luigi Celona , Simone Bianco , Paolo Napoletano

Recently, a surge of interest in visual transformers is to reduce the computational cost by limiting the calculation of self-attention to a local window. Most current work uses a fixed single-scale window for modeling by default, ignoring…

Computer Vision and Pattern Recognition · Computer Science 2022-04-11 Pengzhen Ren , Changlin Li , Guangrun Wang , Yun Xiao , Qing Du , Xiaodan Liang , Xiaojun Chang

Learning efficient and expressive visual representation has long been the pursuit of computer vision research. While Vision Transformers (ViTs) gradually replace traditional Convolutional Neural Networks (CNNs) as more scalable vision…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Quan Kong , Yanru Xiao , Yuhao Shen , Cong Wang

Advanced driver assistance systems require a comprehensive understanding of the driver's mental/physical state and traffic context but existing works often neglect the potential benefits of joint learning between these tasks. This paper…

Computer Vision and Pattern Recognition · Computer Science 2025-04-04 Wenzhuo Liu , Wenshuo Wang , Yicheng Qiao , Qiannan Guo , Jiayin Zhu , Pengfei Li , Zilong Chen , Huiming Yang , Zhiwei Li , Lening Wang , Tiao Tan , Huaping Liu

The groundbreaking performance of transformers in Natural Language Processing (NLP) tasks has led to their replacement of traditional Convolutional Neural Networks (CNNs), owing to the efficiency and accuracy achieved through the…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Gousia Habib , Damandeep Singh , Ishfaq Ahmad Malik , Brejesh Lall

Pedestrian Intention prediction is one of the key technologies in the transition from level 3 to level 4 autonomous driving. To understand pedestrian crossing behaviour, several elements and features should be taken into consideration to…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Aly R. Elkammar , Karim M. Gamaleldin , Catherine M. Elias

Automatic Vehicle Detection (AVD) in diverse driving environments presents unique challenges due to varying lighting conditions, road types, and vehicle types. Traditional methods, such as YOLO and Faster R-CNN, often struggle to cope with…

Computer Vision and Pattern Recognition · Computer Science 2025-02-26 Istiaq Ahmed Fahad , Abdullah Ibne Hanif Arean , Nazmus Sakib Ahmed , Mahmudul Hasan

Vision Transformers (ViTs) have achieved state-of-the-art performance on various vision tasks. However, ViTs' self-attention module is still arguably a major bottleneck, limiting their achievable hardware efficiency. Meanwhile, existing…

Machine Learning · Computer Science 2025-03-04 Haoran You , Zhanyi Sun , Huihong Shi , Zhongzhi Yu , Yang Zhao , Yongan Zhang , Chaojian Li , Baopu Li , Yingyan Celine Lin

Many road accidents occur due to distracted drivers. Today, driver monitoring is essential even for the latest autonomous vehicles to alert distracted drivers in order to take over control of the vehicle in case of emergency. In this paper,…

Computer Vision and Pattern Recognition · Computer Science 2019-07-19 Neslihan Kose , Okan Kopuklu , Alexander Unnervik , Gerhard Rigoll

Autonomous driving technology is poised to transform transportation systems. However, achieving safe and accurate multi-task decision-making in complex scenarios, such as unsignalized intersections, remains a challenge for autonomous…

Robotics · Computer Science 2023-08-01 Jiaqi Liu , Peng Hang , Xiao qi , Jianqiang Wang , Jian Sun

End-to-end autonomous driving has witnessed remarkable progress. However, the extensive deployment of autonomous vehicles has yet to be realized, primarily due to 1) inefficient multi-modal environment perception: how to integrate data from…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Dongyang Xu , Haokun Li , Qingfan Wang , Ziying Song , Lei Chen , Hanming Deng

Vision Transformers (ViTs) have demonstrated remarkable capabilities in learning representations, but their performance is compromised when applied to unseen domains. Previous methods either engage in prompt learning during the training…

Computer Vision and Pattern Recognition · Computer Science 2024-09-11 Yunbei Zhang , Akshay Mehra , Jihun Hamm

Driver distraction remains a leading cause of road traffic accidents, contributing to thousands of fatalities annually across the globe. While deep learning-based driver activity recognition methods have shown promise in detecting such…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Aditi Bhalla , Christian Hellert , Enkelejda Kasneci