English
Related papers

Related papers: Interpretable Self-Attention Temporal Reasoning fo…

200 papers

Abnormal driving behaviour is one of the leading cause of terrible traffic accidents endangering human life. Therefore, study on driving behaviour surveillance has become essential to traffic security and public management. In this paper,…

Computer Vision and Pattern Recognition · Computer Science 2018-12-04 Yaocong Hu , MingQi Lu , Xiaobo Lu

Lane-changing is an important driving behavior and unreasonable lane changes can result in potentially dangerous traffic collisions. Advanced Driver Assistance System (ADAS) can assist drivers to change lanes safely and efficiently. To…

Machine Learning · Computer Science 2021-08-03 Yue Zhang , Yajie Zou , Jinjun Tang , Jian Liang

With over 50 million car sales annually and over 1.3 million deaths every year due to motor accidents we have chosen this space. India accounts for 11 per cent of global death in road accidents. Drivers are held responsible for 78% of…

Computer Vision and Pattern Recognition · Computer Science 2022-04-08 Narayana Darapaneni , Jai Arora , MoniShankar Hazra , Naman Vig , Simrandeep Singh Gandhi , Saurabh Gupta , Anwesh Reddy Paduri

In autonomous driving, perceiving the driving behaviors of surrounding agents is important for the ego-vehicle to make a reasonable decision. In this paper, we propose a neural network model based on trajectories information for driving…

Computer Vision and Pattern Recognition · Computer Science 2021-03-02 He Zhang , Zhixiong Nan , Tao Yang , Yifan Liu , Nanning Zheng

Understanding driver activity is vital for in-vehicle systems that aim to reduce the incidence of car accidents rooted in cognitive distraction. Automating real-time behavior recognition while ensuring actions classification with high…

Computer Vision and Pattern Recognition · Computer Science 2021-02-23 Chaoyun Zhang , Rui Li , Woojin Kim , Daesub Yoon , Paul Patras

Lane change (LC) is one of the safety-critical manoeuvres in highway driving according to various road accident records. Thus, reliably predicting such manoeuvre in advance is critical for the safe and comfortable operation of automated…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Sajjad Mozaffari , Eduardo Arnold , Mehrdad Dianati , Saber Fallah

In the rapidly evolving landscape of transportation, the proliferation of automobiles has made road traffic more complex, necessitating advanced vision-assisted technologies for enhanced safety and navigation. These technologies are…

Computer Vision and Pattern Recognition · Computer Science 2024-03-14 Dhruv Toshniwal , Saurabh Loya , Anuj Khot , Yash Marda

While recent multimodal models have shown progress in vision-language tasks, small-scale variants still struggle with the fine-grained temporal reasoning required for video understanding. We introduce ReasonAct, a method that enhances video…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Jiaxin Liu , Zhaolu Kang

The ability to reason about temporal and causal events from videos lies at the core of human intelligence. Most video reasoning benchmarks, however, focus on pattern recognition from complex visual and language input, instead of on causal…

Computer Vision and Pattern Recognition · Computer Science 2020-03-10 Kexin Yi , Chuang Gan , Yunzhu Li , Pushmeet Kohli , Jiajun Wu , Antonio Torralba , Joshua B. Tenenbaum

Motivated by the previous success of Two-Dimensional Convolutional Neural Network (2D CNN) on image recognition, researchers endeavor to leverage it to characterize videos. However, one limitation of applying 2D CNN to analyze videos is…

Computer Vision and Pattern Recognition · Computer Science 2020-07-16 Junwu Weng , Donghao Luo , Yabiao Wang , Ying Tai , Chengjie Wang , Jilin Li , Feiyue Huang , Xudong Jiang , Junsong Yuan

We propose Trusted Neural Network (TNN) models, which are deep neural network models that satisfy safety constraints critical to the application domain. We investigate different mechanisms for incorporating rule-based knowledge in the form…

Machine Learning · Computer Science 2018-05-21 Shalini Ghosh , Amaury Mercier , Dheeraj Pichapati , Susmit Jha , Vinod Yegneswaran , Patrick Lincoln

Understanding human driving behavior is important for autonomous vehicles. In this paper, we propose an interpretable human behavior model in interactive driving scenarios based on the cumulative prospect theory (CPT). As a non-expected…

Artificial Intelligence · Computer Science 2019-07-23 Liting Sun , Wei Zhan , Yeping Hu , Masayoshi Tomizuka

Visual understanding requires comprehending complex visual relations between objects within a scene. Here, we seek to characterize the computational demands for abstract visual reasoning. We do this by systematically assessing the ability…

Computer Vision and Pattern Recognition · Computer Science 2022-03-03 Mohit Vaishnav , Remi Cadene , Andrea Alamia , Drew Linsley , Rufin VanRullen , Thomas Serre

Convolutional Neural Networks (CNN) have been successfully applied to autonomous driving tasks, many in an end-to-end manner. Previous end-to-end steering control methods take an image or an image sequence as the input and directly predict…

Computer Vision and Pattern Recognition · Computer Science 2018-02-06 Zhengyuan Yang , Yixuan Zhang , Jerry Yu , Junjie Cai , Jiebo Luo

Since the advent of autonomous driving technology, it has experienced remarkable progress over the last decade. However, most existing research still struggles to address the challenges posed by environments where multiple vehicles have to…

Multiagent Systems · Computer Science 2025-08-01 Jing Wang , Yan Jin , Fei Ding , Chongfeng Wei

We propose a causal interpretation of self-attention in the Transformer neural network architecture. We interpret self-attention as a mechanism that estimates a structural equation model for a given input sequence of symbols (tokens). The…

Artificial Intelligence · Computer Science 2023-11-01 Raanan Y. Rohekar , Yaniv Gurwicz , Shami Nisimov

Trajectory prediction models in autonomous driving are vulnerable to perturbations from non-causal agents whose actions should not affect the ego-agent's behavior. Such perturbations can lead to incorrect predictions of other agents'…

Robotics · Computer Science 2026-05-19 Ehsan Ahmadi , Ray Mercurius , Soheil Alizadeh , Kasra Rezaee , Amir Rasouli

The ability to identify and temporally segment fine-grained human actions throughout a video is crucial for robotics, surveillance, education, and beyond. Typical approaches decouple this problem by first extracting local spatiotemporal…

Computer Vision and Pattern Recognition · Computer Science 2016-11-17 Colin Lea , Michael D. Flynn , Rene Vidal , Austin Reiter , Gregory D. Hager

Naturalistic driving action recognition is essential for vehicle cabin monitoring systems. However, the complexity of real-world backgrounds presents significant challenges for this task, and previous approaches have struggled with…

Computer Vision and Pattern Recognition · Computer Science 2025-03-07 Qing Chang , Wei Dai , Zhihao Shuai , Limin Yu , Yutao Yue

Accurately detecting and predicting lane change (LC)processes of human-driven vehicles can help autonomous vehicles better understand their surrounding environment, recognize potential safety hazards, and improve traffic safety. This paper…

Machine Learning · Computer Science 2023-07-21 Renteng Yuan , Mohamed Abdel-Aty , Xin Gu , Ou Zheng , Qiaojun Xiang