English
Related papers

Related papers: Localizing Speech Deepfakes Beyond Transitions via…

200 papers

Thanks to recent advancements in end-to-end speech modeling technology, it has become increasingly feasible to imitate and clone a user`s voice. This leads to a significant challenge in differentiating between authentic and fabricated audio…

Sound · Computer Science 2023-06-28 Jie Liu , Zhiba Su , Hui Huang , Caiyan Wan , Quanxiu Wang , Jiangli Hong , Benlai Tang , Fengjie Zhu

Audio deepfake detection has recently garnered public concern due to its implications for security and reliability. Traditional deep learning methods have been widely applied to this task but often lack generalisability when confronted with…

Sound · Computer Science 2025-12-16 Yupei Li , Li Wang , Yuxiang Wang , Lei Wang , Rizhao Cai , Jie Shi , Björn W. Schuller , Zhizheng Wu

Recent advances in voice cloning and text-to-speech synthesis have made partial speech manipulation - where an adversary replaces a few words within an utterance to alter its meaning while preserving the speaker's identity - an increasingly…

Sound · Computer Science 2026-05-20 Tung Vu , Yen Nguyen , Hai Nguyen , Cuong Pham , Cong Tran

The lack of labeled data is a common challenge in speech classification tasks, particularly those requiring extensive subjective assessment, such as cognitive state classification. In this work, we propose a Semi-Supervised Learning (SSL)…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-01 Yuanchao Li , Zixing Zhang , Jing Han , Peter Bell , Catherine Lai

Learning semantic segmentation models under image-level supervision is far more challenging than under fully supervised setting. Without knowing the exact pixel-label correspondence, most weakly-supervised methods rely on external models to…

Computer Vision and Pattern Recognition · Computer Science 2018-10-17 Zi-Yi Ke , Chiou-Ting Hsu

Semi-supervised learning aims to leverage a large amount of unlabeled data for performance boosting. Existing works primarily focus on image classification. In this paper, we delve into semi-supervised learning for object detection, where…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Zhenyu Wang , Yali Li , Ye Guo , Shengjin Wang

Semantic segmentation plays an important role in intelligent vehicles, providing pixel-level semantic information about the environment. However, the labeling budget is expensive and time-consuming when semantic segmentation model is…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Weihao Yan , Yeqiang Qian , Yueyuan Li , Tao Li , Chunxiang Wang , Ming Yang

End-to-end approaches to anti-spoofing, especially those which operate directly upon the raw signal, are starting to be competitive with their more traditional counterparts. Until recently, all such approaches consider only the learning of…

Audio and Speech Processing · Electrical Eng. & Systems 2021-10-07 Wanying Ge , Jose Patino , Massimiliano Todisco , Nicholas Evans

Deep neural networks have been widely used in communication signal recognition and achieved remarkable performance, but this superiority typically depends on using massive examples for supervised learning, whereas training a deep neural…

Signal Processing · Electrical Eng. & Systems 2023-11-15 Weidong Wang , Hongshu Liao , Lu Gan

In semi-supervised semantic segmentation, a model is trained with a limited number of labeled images along with a large corpus of unlabeled images to reduce the high annotation effort. While previous methods are able to learn good…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Lukas Hoyer , David Joseph Tan , Muhammad Ferjad Naeem , Luc Van Gool , Federico Tombari

Active learning aims to address the paucity of labeled data by finding the most informative samples. However, when applying to semantic segmentation, existing methods ignore the segmentation difficulty of different semantic areas, which…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Shuai Xie , Zunlei Feng , Ying Chen , Songtao Sun , Chao Ma , Mingli Song

Speech deepfake detection has recently gained significant attention within the multimedia forensics community. Related issues have also been explored, such as the identification of partially fake signals, i.e., tracks that include both real…

Sound · Computer Science 2024-08-27 Viola Negroni , Davide Salvi , Paolo Bestagini , Stefano Tubaro

The ability to understand visual information from limited labeled data is an important aspect of machine learning. While image-level classification has been extensively studied in a semi-supervised setting, dense pixel-level classification…

Computer Vision and Pattern Recognition · Computer Science 2019-08-19 Sudhanshu Mittal , Maxim Tatarchenko , Thomas Brox

Deep learning approaches for semantic segmentation rely primarily on supervised learning approaches and require substantial efforts in producing pixel-level annotations. Further, such approaches may perform poorly when applied to unseen…

Computer Vision and Pattern Recognition · Computer Science 2021-10-22 Ying Chen , Xu Ouyang , Kaiyue Zhu , Gady Agam

Human action understanding is crucial for the advancement of multimodal systems. While recent developments, driven by powerful large language models (LLMs), aim to be general enough to cover a wide range of categories, they often overlook…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Yongle Huang , Haodong Chen , Zhenbang Xu , Zihan Jia , Haozhou Sun , Dian Shao

Presently, self-training stands as a prevailing approach in cross-domain semantic segmentation, enhancing model efficacy by training with pixels assigned with reliable pseudo-labels. However, we find two critical limitations in this…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Dong Zhao , Ruizhi Yang , Shuang Wang , Qi Zang , Yang Hu , Licheng Jiao , Nicu Sebe , Zhun Zhong

Recent progress in generative AI technology has made audio deepfakes remarkably more realistic. While current research on anti-spoofing systems primarily focuses on assessing whether a given audio sample is fake or genuine, there has been…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-26 Nicholas Klein , Tianxiang Chen , Hemlata Tak , Ricardo Casal , Elie Khoury

In this paper, we present our overall efforts to improve the performance of a code-switching speech recognition system using semi-supervised training methods from lexicon learning to acoustic modeling, on the South East Asian…

Computation and Language · Computer Science 2018-06-19 Pengcheng Guo , Haihua Xu , Lei Xie , Eng Siong Chng

Video anomaly detection under video-level labels is currently a challenging task. Previous works have made progresses on discriminating whether a video sequencecontains anomalies. However, most of them fail to accurately localize the…

Computer Vision and Pattern Recognition · Computer Science 2021-04-15 Hui Lv , Chuanwei Zhou , Chunyan Xu , Zhen Cui , Jian Yang

Deep learning has enabled highly realistic synthetic speech, raising concerns about fraud, impersonation, and disinformation. Despite rapid progress in neural detectors, transparent baselines are needed to reveal which acoustic cues…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-16 Faheem Ahmad , Ajan Ahmed , Masudul Imtiaz