中文
相关论文

相关论文: EMO-BOOST: Emotion-Augmented Audio-Visual Features…

200 篇论文

In recent years, deep learning has achieved innovative advancements in various fields, including the analysis of human emotions and behaviors. Initiatives such as the Affective Behavior Analysis in-the-wild (ABAW) competition have been…

计算机视觉与模式识别 · 计算机科学 2024-08-06 Seongjae Min , Junseok Yang , Sangjun Lim , Junyong Lee , Sangwon Lee , Sejoon Lim

In this work, we investigate multimodal foundation models (MFMs) for EmoFake detection (EFD) and hypothesize that they will outperform audio foundation models (AFMs). MFMs due to their cross-modal pre-training, learns emotional patterns…

The rapid progress of visual generative models has made AI-generated images increasingly difficult to distinguish from authentic ones, posing growing risks to social trust and information integrity. This motivates detectors that are not…

计算机视觉与模式识别 · 计算机科学 2026-04-09 Huangsen Cao , Qin Mei , Zhiheng Li , Yuxi Li , Zhan Meng , Ying Zhang , Chen Li , Zhimeng Zhang , Xin Ding , Yongwei Wang , Jing Lyu , Fei Wu

Deepfake technology has rapidly advanced and poses significant threats to information integrity and trust in online multimedia. While significant progress has been made in detecting deepfakes, the simultaneous manipulation of audio and…

计算机视觉与模式识别 · 计算机科学 2025-04-14 Christos Koutlis , Symeon Papadopoulos

Detecting fake news in large datasets is challenging due to its diversity and complexity, with traditional approaches often focusing on textual features while underutilizing semantic and emotional elements. Current methods also rely heavily…

计算与语言 · 计算机科学 2024-10-22 Xiaoman Xu , Xiangrun Li , Taihang Wang , Ye Jiang

Deep generative models can create remarkably photorealistic fake images while raising concerns about misinformation and copyright infringement, known as deepfake threats. Deepfake detection technique is developed to distinguish between real…

计算机视觉与模式识别 · 计算机科学 2024-08-22 You-Ming Chang , Chen Yeh , Wei-Chen Chiu , Ning Yu

Lack of large, well-annotated emotional speech corpora continues to limit the performance and robustness of speech emotion recognition (SER), particularly as models grow more complex and the demand for multimodal systems increases. While…

声音 · 计算机科学 2026-02-13 Chung-Soo Ahn , Rajib Rana , Sunil Sivadas , Carlos Busso , Jagath C. Rajapakse

Recent generative models demonstrate impressive performance on synthesizing photographic images, which makes humans hardly to distinguish them from pristine ones, especially on realistic-looking synthetic facial images. Previous works…

计算机视觉与模式识别 · 计算机科学 2025-01-15 Hao Wang , Cheng Deng , Zhidong Zhao

Deception detection is an important task that has been a hot research topic due to its potential applications. It can be applied in many areas, from national security (e.g., airport security, jurisprudence, and law enforcement) to real-life…

计算机视觉与模式识别 · 计算机科学 2022-08-02 Jun-Teng Yang , Guei-Ming Liu , Scott C. -H Huang

Recent progress in audio-language modeling, such as automated audio captioning, has benefited from training on synthetic data generated with the aid of large-language models. However, such approaches for environmental sound captioning have…

声音 · 计算机科学 2024-10-17 Mithun Manivannan , Vignesh Nethrapalli , Mark Cartwright

Recent advances in video diffusion models have unlocked new potential for realistic audio-driven talking video generation. However, achieving seamless audio-lip synchronization, maintaining long-term identity consistency, and producing…

计算机视觉与模式识别 · 计算机科学 2024-12-06 Longtao Zheng , Yifan Zhang , Hanzhong Guo , Jiachun Pan , Zhenxiong Tan , Jiahao Lu , Chuanxin Tang , Bo An , Shuicheng Yan

Media forensics has attracted a lot of attention in the last years in part due to the increasing concerns around DeepFakes. Since the initial DeepFake databases from the 1st generation such as UADFV and FaceForensics++ up to the latest…

计算机视觉与模式识别 · 计算机科学 2020-11-13 Ruben Tolosana , Sergio Romero-Tapiador , Julian Fierrez , Ruben Vera-Rodriguez

We present a novel approach for the detection of deepfake videos using a pair of vision transformers pre-trained by a self-supervised masked autoencoding setup. Our method consists of two distinct components, one of which focuses on…

计算机视觉与模式识别 · 计算机科学 2024-02-12 Sayantan Das , Mojtaba Kolahdouzi , Levent Özparlak , Will Hickie , Ali Etemad

This paper introduces RawBoost, a data boosting and augmentation method for the design of more reliable spoofing detection solutions which operate directly upon raw waveform inputs. While RawBoost requires no additional data sources, e.g.…

音频与语音处理 · 电气工程与系统科学 2022-02-23 Hemlata Tak , Madhu Kamble , Jose Patino , Massimiliano Todisco , Nicholas Evans

Natural Language Processing has recently made understanding human interaction easier, leading to improved sentimental analysis and behaviour prediction. However, the choice of words and vocal cues in conversations presents an underexplored…

计算机与社会 · 计算机科学 2022-06-24 Amna Anwar , Eiman Kanjo , Dario Ortega Anderez

With recent developments in smart technologies, there has been a growing focus on the use of artificial intelligence and machine learning for affective computing to further enhance the user experience through emotion recognition. Typically,…

机器学习 · 计算机科学 2020-08-26 Kyle Ross , Paul Hungler , Ali Etemad

Deepfakes, created using advanced AI techniques such as Variational Autoencoder and Generative Adversarial Networks, have evolved from research and entertainment applications into tools for malicious activities, posing significant threats…

计算机视觉与模式识别 · 计算机科学 2025-05-06 Yamini Sri Krubha , Aryana Hou , Braden Vester , Web Walker , Xin Wang , Li Lin , Shu Hu

The rapid development of audio-driven talking head generators and advanced Text-To-Speech (TTS) models has led to more sophisticated temporal deepfakes. These advances highlight the need for robust methods capable of detecting and…

音频与语音处理 · 电气工程与系统科学 2025-08-12 Ivan Kukanov , Jun Wah Ng

The rapid and unrestrained advancement of generative artificial intelligence (AI) presents a double-edged sword. While enabling unprecedented creativity, it also facilitates the generation of highly convincing content, undermining societal…

计算机视觉与模式识别 · 计算机科学 2026-03-17 Yixuan Li , Yu Tian , Yipo Huang , Wei Lu , Shiqi Wang , Weisi Lin , Anderson Rocha

Eye movement biometrics (EMB) use subject-specific gaze dynamics for user authentication and identification. Recent deep learning-based EMB systems achieve strong performance by modeling temporal eye movement behavior. However, these…

人机交互 · 计算机科学 2026-05-11 Hashim Aziz , Mehedi Hasan Raju , Oleg V. Komogortsev