English
Related papers

Related papers: Multimodal Learning for Just-In-Time Software Defe…

200 papers

Autonomous vehicles (AVs) are poised to redefine transportation by enhancing road safety, minimizing human error, and optimizing traffic efficiency. The success of AVs depends on their ability to interpret complex, dynamic environments…

Multimedia · Computer Science 2025-07-11 Abolfazl Zarghani , Amirhossein Ebrahimi , Amir Malekesfandiari

Distracted driving remains a significant global challenge with severe human and economic repercussions, demanding improved detection and intervention strategies. While previous studies have extensively explored single-modality approaches,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Anthony. Dontoh , Stephanie. Ivey , Logan. Sirbaugh , Armstrong. Aboah

To improve the security and robustness of autonomous driving models, this paper presents SMET, a scenariobased metamorphic testing tool for autonomous driving models. The metamorphic relationship is divided into three dimensions (time,…

Robotics · Computer Science 2021-04-09 Haiyang Ao , Ya Pan

We present JointMotion, a self-supervised pre-training method for joint motion prediction in self-driving vehicles. Our method jointly optimizes a scene-level objective connecting motion and environments, and an instance-level objective to…

Computer Vision and Pattern Recognition · Computer Science 2024-10-24 Royden Wagner , Omer Sahin Tas , Marvin Klemp , Carlos Fernandez

This paper introduces a novel deep learning-based multimodal fusion architecture aimed at enhancing the perception capabilities of autonomous navigation robots in complex environments. By utilizing innovative feature extraction modules,…

Machine Learning · Computer Science 2025-04-29 Delun Lai , Yeyubei Zhang , Yunchong Liu , Chaojie Li , Huadong Mo

Accurate travel time estimation (TTE) plays a crucial role in intelligent transportation systems. However, it remains challenging due to heterogeneous data sources and complex traffic dynamics. Moreover, traditional approaches typically…

Machine Learning · Computer Science 2026-01-27 Zhi Liu , Xuyuan Hu , Xiao Han , Zhehao Dai , Zhaolin Deng , Guojiang Shen , Xiangjie Kong

Accurate classification of medical device risk levels is essential for regulatory oversight and clinical safety. We present a Transformer-based multimodal framework that integrates textual descriptions and visual information to predict…

Machine Learning · Computer Science 2025-05-02 Yu Han , Aaron Ceross , Jeroen H. M. Bergmann

End-to-end autonomous driving increasingly leverages self-supervised video pretraining to learn transferable planning representations. However, pretraining video world models for scene understanding has so far brought only limited…

Computer Vision and Pattern Recognition · Computer Science 2026-01-30 Linhan Wang , Zichong Yang , Chen Bai , Guoxiang Zhang , Xiaotong Liu , Xiaoyin Zheng , Xiao-Xiao Long , Chang-Tien Lu , Cheng Lu

Ensuring traffic safety and mitigating accidents in modern driving is of paramount importance, and computer vision technologies have the potential to significantly contribute to this goal. This paper presents a multi-modal Vision…

Computer Vision and Pattern Recognition · Computer Science 2024-02-07 Yunsheng Ma , Ziran Wang

With the development and the increasing interests in ML/DL fields, companies are eager to apply Machine Learning/Deep Learning approaches to increase service quality and customer experience. Federated Learning was implemented as an…

Machine Learning · Computer Science 2022-01-02 Hongyi Zhang , Jan Bosch , Helena Holmström Olsson

In the field of autonomous Unmanned Aerial Vehicles (UAVs) landing, conventional approaches fall short in delivering not only the required precision but also the resilience against environmental disturbances. Yet, learning-based algorithms…

Computer Vision and Pattern Recognition · Computer Science 2024-05-22 Francisco Neves , Luís Branco , Maria Pereira , Rafael Claro , Andry Pinto

Multimodal learning, which integrates data from diverse sensory modes, plays a pivotal role in artificial intelligence. However, existing multimodal learning methods often struggle with challenges where some modalities appear more dominant…

Machine Learning · Computer Science 2024-04-02 Xiaohui Zhang , Jaehong Yoon , Mohit Bansal , Huaxiu Yao

Multimodal Continual Instruction Tuning (MCIT) enables Multimodal Large Language Models (MLLMs) to meet continuously emerging requirements without expensive retraining. MCIT faces two major obstacles: catastrophic forgetting (where old…

Machine Learning · Computer Science 2024-06-28 Junhao Zheng , Qianli Ma , Zhen Liu , Binquan Wu , Huawen Feng

Autonomous driving technology is poised to transform transportation systems. However, achieving safe and accurate multi-task decision-making in complex scenarios, such as unsignalized intersections, remains a challenge for autonomous…

Robotics · Computer Science 2023-08-01 Jiaqi Liu , Peng Hang , Xiao qi , Jianqiang Wang , Jian Sun

Model Predictive Control lacks the ability to escape local minima in nonconvex problems. Furthermore, in fast-changing, uncertain environments, the conventional warmstart, using the optimal trajectory from the last timestep, often falls…

Systems and Control · Electrical Eng. & Systems 2023-10-05 Mohamed-Khalil Bouzidi , Yue Yao , Daniel Goehring , Joerg Reichardt

With the rapid development of machine learning, autonomous driving has become a hot issue, making urgent demands for more intelligent perception and planning systems. Self-driving cars can avoid traffic crashes with precisely predicted…

Robotics · Computer Science 2021-11-01 Jianbang Liu , Xinyu Mao , Yuqi Fang , Delong Zhu , Max Q. -H. Meng

Attacks against computer systems exploiting software vulnerabilities can cause substantial damage to the cyber-infrastructure of our modern society and economy. To minimize the consequences, it is vital to detect and fix vulnerabilities as…

Software Engineering · Computer Science 2023-04-18 Son Nguyen , Thu-Trang Nguyen , Thanh Trong Vu , Thanh-Dat Do , Kien-Tuan Ngo , Hieu Dinh Vo

Autonomous driving systems continue to face safety-critical failures, often triggered by rare and unpredictable corner cases that evade conventional testing. We present the Autonomous Driving Digital Twin (ADDT) framework, a high-fidelity…

Robotics · Computer Science 2025-04-15 Bo Yu , Chaoran Yuan , Zishen Wan , Jie Tang , Fadi Kurdahi , Shaoshan Liu

Autonomous driving systems require real-time environmental perception to ensure user safety and experience. Streaming perception is a task of reporting the current state of the world, which is used to evaluate the delay and accuracy of…

Computer Vision and Pattern Recognition · Computer Science 2023-09-14 Yihui Huang , Ningjiang Chen

Autonomous driving requires operation in different behavioral modes ranging from lane following and intersection crossing to turning and stopping. However, most existing deep learning approaches to autonomous driving do not consider the…

Machine Learning · Computer Science 2019-01-15 Sauhaarda Chowdhuri , Tushar Pankaj , Karl Zipser