English
Related papers

Related papers: ViT-DD: Multi-Task Vision Transformer for Semi-Sup…

200 papers

Conventional wisdom suggests that pre-training Vision Transformers (ViT) improves downstream performance by learning useful representations. Is this actually true? We investigate this question and find that the features and representations…

Machine Learning · Computer Science 2024-11-15 Alexander C. Li , Yuandong Tian , Beidi Chen , Deepak Pathak , Xinlei Chen

In this paper, we presented a preliminary study for tactical driver behavior detection from untrimmed naturalistic driving recordings. While supervised learning based detection is a common approach, it suffers when labeled data is scarce.…

Computer Vision and Pattern Recognition · Computer Science 2018-07-04 Athma Narayanan , Yi-Ting Chen , Srikanth Malla

Vision Transformers (ViT) have been established as large-scale foundation models. However, because self-attention operates globally, they lack an explicit mechanism to distinguish foreground from background. As a result, ViT may learn…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Haruhiko Murata , Kazuhiro Hotta

The task of driver attention prediction has drawn considerable interest among researchers in robotics and the autonomous vehicle industry. Driver attention prediction can play an instrumental role in mitigating and preventing high-risk…

Computer Vision and Pattern Recognition · Computer Science 2022-07-11 Yuan Shen , Niviru Wijayaratne , Pranav Sriram , Aamir Hasan , Peter Du , Katherine Driggs-Campbell

Moving object Detection (MOD) is a critical task in autonomous driving as moving agents around the ego-vehicle need to be accurately detected for safe trajectory planning. It also enables appearance agnostic detection of objects based on…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Hazem Rashed , Ahmad El Sallab , Senthil Yogamani

Traffic light detection is crucial for environment perception and decision-making in autonomous driving. State-of-the-art detectors are built upon deep Convolutional Neural Networks (CNNs) and have exhibited promising performance. However,…

Human-Computer Interaction · Computer Science 2020-09-29 Liang Gou , Lincan Zou , Nanxiang Li , Michael Hofmann , Arvind Kumar Shekar , Axel Wendt , Liu Ren

Due to the success of Bidirectional Encoder Representations from Transformers (BERT) in natural language process (NLP), the multi-head attention transformer has been more and more prevalent in computer-vision researches (CV). However, it…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Weiqiang Jin , Hang Yu , Hang Yu

Traditional video-based human activity recognition has experienced remarkable progress linked to the rise of deep learning, but this effect was slower as it comes to the downstream task of driver behavior understanding. Understanding the…

Computer Vision and Pattern Recognition · Computer Science 2022-07-29 Kunyu Peng , Alina Roitberg , Kailun Yang , Jiaming Zhang , Rainer Stiefelhagen

3D object detection is a significant task for autonomous driving. Recently with the progress of vision transformers, the 2D object detection problem is being treated with the set-to-set loss. Inspired by these approaches on 2D object…

Computer Vision and Pattern Recognition · Computer Science 2022-10-28 Gopi Krishna Erabati , Helder Araujo

Vision Transformer (ViT) self-attention mechanism is characterized by feature collapse in deeper layers, resulting in the vanishing of low-level visual features. However, such features can be helpful to accurately represent and identify…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Anxhelo Diko , Danilo Avola , Marco Cascio , Luigi Cinque

Autonomous driving systems require real-time environmental perception to ensure user safety and experience. Streaming perception is a task of reporting the current state of the world, which is used to evaluate the delay and accuracy of…

Computer Vision and Pattern Recognition · Computer Science 2023-09-14 Yihui Huang , Ningjiang Chen

Vision Transformers (ViTs) have achieved significant advancement in computer vision tasks due to their powerful modeling capacity. However, their performance notably degrades when trained with insufficient data due to lack of inherent…

Image and Video Processing · Electrical Eng. & Systems 2025-03-04 Omar S. EL-Assiouti , Ghada Hamed , Dina Khattab , Hala M. Ebied

Vision Transformers (ViTs) have shown promising performance compared with Convolutional Neural Networks (CNNs), but the training of ViTs is much harder than CNNs. In this paper, we define several metrics, including Dynamic Data Proportion…

Computer Vision and Pattern Recognition · Computer Science 2022-09-30 Benjia Zhou , Pichao Wang , Jun Wan , Yanyan Liang , Fan Wang

The number of traffic accidents has been continuously increasing in recent years worldwide. Many accidents are caused by distracted drivers, who take their attention away from driving. Motivated by the success of Convolutional Neural…

Computer Vision and Pattern Recognition · Computer Science 2023-02-10 Dichao Liu , Toshihiko Yamasaki , Yu Wang , Kenji Mase , Jien Kato

Distracted driving is a major cause of traffic collisions, calling for robust and scalable detection methods. Vision-language models (VLMs) enable strong zero-shot image classification, but existing VLM-based distracted driver detectors…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Takamichi Miyata , Sumiko Miyata , Andrew Morris

Weakly supervised multimodal violence detection aims to learn a violence detection model by leveraging multiple modalities such as RGB, optical flow, and audio, while only video-level annotations are available. In the pursuit of effective…

Computer Vision and Pattern Recognition · Computer Science 2024-05-09 Shengyang Sun , Xiaojin Gong

Vision Transformers (ViTs) have achieved state-of-the-art results on various computer vision tasks, including 3D object detection. However, their end-to-end implementation also makes ViTs less explainable, which can be a challenge for…

Computer Vision and Pattern Recognition · Computer Science 2023-12-25 Till Beemelmanns , Wassim Zahr , Lutz Eckstein

Vision Transformers (ViTs) have become prominent models for solving various vision tasks. However, the interpretability of ViTs has not kept pace with their promising performance. While there has been a surge of interest in developing {\it…

Computer Vision and Pattern Recognition · Computer Science 2025-05-02 Yao Qiang , Chengyin Li , Prashant Khanduri , Dongxiao Zhu

Biomedical image classification requires capturing of bio-informatics based on specific feature distribution. In most of such applications, there are mainly challenges due to limited availability of samples for diseased cases and imbalanced…

Computer Vision and Pattern Recognition · Computer Science 2025-10-23 Arun K. Sharma , Nishchal K. Verma

Ensuring traffic safety and preventing accidents is a critical goal in daily driving, where the advancement of computer vision technologies can be leveraged to achieve this goal. In this paper, we present a multi-view, multi-scale framework…

Computer Vision and Pattern Recognition · Computer Science 2023-05-17 Yunsheng Ma , Liangqi Yuan , Amr Abdelraouf , Kyungtae Han , Rohit Gupta , Zihao Li , Ziran Wang