English
Related papers

Related papers: Transformer-Driven Multimodal Fusion for Explainab…

200 papers

Human state recognition is a critical topic with pervasive and important applications in human-machine systems. Multi-modal fusion, the combination of metrics from multiple data sources, has been shown as a sound method for improving the…

Human-Computer Interaction · Computer Science 2023-04-12 Ruiqi Wang , Wonse Jo , Dezhong Zhao , Weizheng Wang , Baijian Yang , Guohua Chen , Byung-Cheol Min

Deep neural networks (DNNs) provide state-of-the-art results for a multitude of applications, but the approaches using DNNs for multimodal audiovisual applications do not consider predictive uncertainty associated with individual…

Neural and Evolutionary Computing · Computer Science 2019-09-23 Mahesh Subedar , Ranganath Krishnan , Paulo Lopez Meyer , Omesh Tickoo , Jonathan Huang

Nowadays advanced image editing tools and technical skills produce tampered images more realistically, which can easily evade image forensic systems and make authenticity verification of images more difficult. To tackle this challenging…

Computer Vision and Pattern Recognition · Computer Science 2021-08-10 Jing Hao , Zhixin Zhang , Shicai Yang , Di Xie , Shiliang Pu

Unsupervised object discovery (UOD) has recently shown encouraging progress with the adoption of pre-trained Transformer features. However, current methods based on Transformers mainly focus on designing the localization head (e.g., seed…

Computer Vision and Pattern Recognition · Computer Science 2022-10-25 Zhiwei Lin , Zengyu Yang , Yongtao Wang

The recent wave of AI research has enabled a new brand of synthetic media, called deepfakes. Deepfakes have impressive photorealism, which has generated exciting new use cases but also raised serious threats to our increasingly digital…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Nikolaos Giatsoglou , Symeon Papadopoulos , Ioannis Kompatsiaris

With the rapid development of generation model, AI-based face manipulation technology, which called DeepFakes, has become more and more realistic. This means of face forgery can attack any target, which poses a new threat to personal…

Computer Vision and Pattern Recognition · Computer Science 2021-11-16 Yuyang Sun , Zhiyong Zhang , Changzhen Qiu , Liang Wang , Zekai Wang

Pedestrian Detection is the most critical module of an Autonomous Driving system. Although a camera is commonly used for this purpose, its quality degrades severely in low-light night time driving scenarios. On the other hand, the quality…

Computer Vision and Pattern Recognition · Computer Science 2022-01-25 Kinjal Dasgupta , Arindam Das , Sudip Das , Ujjwal Bhattacharya , Senthil Yogamani

Deepfakes are synthetically generated images, videos or audios, which fraudsters use to manipulate legitimate information. Current deepfake detection systems struggle against unseen data. To address this, we employ three different deep…

Computer Vision and Pattern Recognition · Computer Science 2021-02-12 Sohail Ahmed Khan , Alessandro Artusi , Hang Dai

Deepfake is a widely used technology employed in recent years to create pernicious content such as fake news, movies, and rumors by altering and substituting facial information from various sources. Given the ongoing evolution of deepfakes…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Ruchika Sharma , Rudresh Dwivedi

The growing diversity of digital face manipulation techniques has led to an urgent need for a universal and robust detection technology to mitigate the risks posed by malicious forgeries. We present a blended-based detection approach that…

Computer Vision and Pattern Recognition · Computer Science 2023-12-14 Yuyang Sun , Huy H. Nguyen , Chun-Shien Lu , ZhiYong Zhang , Lu Sun , Isao Echizen

The rapid advancement of deep learning models that can generate and synthesis hyper-realistic videos known as Deepfakes and their ease of access to the general public have raised concern from all concerned bodies to their possible malicious…

Computer Vision and Pattern Recognition · Computer Science 2021-03-12 Deressa Wodajo , Solomon Atnafu

Detecting user interface (UI) controls from software screenshots is a critical task for automated testing, accessibility, and software analytics, yet it remains challenging due to visual ambiguities, design variability, and the lack of…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Milad Moradi , Ke Yan , David Colwell , Matthias Samwald , Rhona Asgari

Driver Monitoring Systems (DMSs) are crucial for safe hand-over actions in Level-2+ self-driving vehicles. State-of-the-art DMSs leverage multiple sensors mounted at different locations to monitor the driver and the vehicle's interior scene…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Yiming Ma , Victor Sanchez , Soodeh Nikan , Devesh Upadhyay , Bhushan Atote , Tanaya Guha

In this work we aim to predict the driver's focus of attention. The goal is to estimate what a person would pay attention to while driving, and which part of the scene around the vehicle is more critical for the task. To this end we propose…

Computer Vision and Pattern Recognition · Computer Science 2018-06-07 Andrea Palazzi , Davide Abati , Simone Calderara , Francesco Solera , Rita Cucchiara

With the rapid development of deep learning, a variety of change detection methods based on deep learning have emerged in recent years. However, these methods usually require a large number of training samples to train the network model, so…

Computer Vision and Pattern Recognition · Computer Science 2023-11-08 Weidong Yan , Pei Yan , Li Cao

Object detection is an essential task for autonomous robots operating in dynamic and changing environments. A robot should be able to detect objects in the presence of sensor noise that can be induced by changing lighting conditions for…

Robotics · Computer Science 2019-11-20 Oier Mees , Andreas Eitel , Wolfram Burgard

In this work, we present an uncertainty-based method for sensor fusion with camera and radar data. The outputs of two neural networks, one processing camera and the other one radar data, are combined in an uncertainty aware manner. To this…

Computer Vision and Pattern Recognition · Computer Science 2020-11-24 Kamil Kowol , Matthias Rottmann , Stefan Bracke , Hanno Gottschalk

Reliable stress recognition is critical in applications such as medical monitoring and safety-critical systems, including real-world driving. While stress is commonly detected using physiological signals such as perinasal perspiration and…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Paraskevi Valergaki , Vassilis C. Nicodemou , Iason Oikonomidis , Antonis Argyros , Anastasios Roussos

Multi-sensor frameworks provide opportunities for ensemble learning and sensor fusion to make use of redundancy and supplemental information, helpful in real-world safety applications such as continuous driver state monitoring which…

Machine Learning · Computer Science 2023-10-02 Ross Greer , Mohan Trivedi

Existing DeepFake detection techniques primarily focus on facial manipulations, such as face-swapping or lip-syncing. However, advancements in text-to-video (T2V) and image-to-video (I2V) generative models now allow fully AI-generated…

Computer Vision and Pattern Recognition · Computer Science 2025-09-04 Rohit Kundu , Hao Xiong , Vishal Mohanty , Athula Balachandran , Amit K. Roy-Chowdhury