English
Related papers

Related papers: Comprehensive Layer-wise Analysis of SSL Models fo…

200 papers

In recent years, self-supervised learning (SSL) frameworks have been extensively applied to sensor-based Human Activity Recognition (HAR) in order to learn deep representations without data annotations. While SSL frameworks reach…

Machine Learning · Computer Science 2023-08-01 Bulat Khaertdinov , Stylianos Asteriadis

Universal sound separation (USS) is a task of separating mixtures of arbitrary sound sources. Typically, universal separation models are trained from scratch in a supervised manner, using labeled data. Self-supervised learning (SSL) is an…

Audio and Speech Processing · Electrical Eng. & Systems 2024-11-07 Junqi Zhao , Xubo Liu , Jinzheng Zhao , Yi Yuan , Qiuqiang Kong , Mark D. Plumbley , Wenwu Wang

Self-supervised learning (SSL) has emerged as a promising solution for addressing the challenge of limited labeled data in deep neural networks (DNNs), offering scalability potential. However, the impact of design dependencies within the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Shruthi Gowda , Elahe Arani , Bahram Zonooz

This paper addresses the challenge of developing a robust audio-visual deepfake detection model. In practical use cases, new generation algorithms are continually emerging, and these algorithms are not encountered during the development of…

Sound · Computer Science 2024-08-20 Kyungbok Lee , You Zhang , Zhiyao Duan

This paper describes a submission to the Environment-Aware Speech and Sound Deepfake Detection Challenge (ESDD2) 2026, which addresses component-level deepfake detection using the CompSpoofV2 dataset, where speech and environmental sounds…

Sound · Computer Science 2026-05-06 Khalid Zaman , Qixuan Huang , Muhammad Uzair , Masashi Unoki

In this work, we explore Self-supervised Learning (SSL) as an auxiliary task to blend the texture-based local descriptors into feature modelling for efficient face analysis. Combining a primary task and a self-supervised auxiliary task is…

Computer Vision and Pattern Recognition · Computer Science 2024-11-06 Shukesh Reddy , Nishit Poddar , Srijan Das , Abhijit Das

Self-supervised learning (SSL), which utilizes the input data itself for representation learning, has achieved state-of-the-art results for various downstream speech tasks. However, most of the previous studies focused on offline…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-11 Zili Huang , Zhuo Chen , Naoyuki Kanda , Jian Wu , Yiming Wang , Jinyu Li , Takuya Yoshioka , Xiaofei Wang , Peidong Wang

Self-supervised learning (SSL) methods which learn representations of data without explicit supervision have gained popularity in speech-processing tasks, particularly for single-talker applications. However, these models often have…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-02 Zili Huang , Desh Raj , Paola García , Sanjeev Khudanpur

Conventional spoofing detection systems have heavily relied on the use of handcrafted features derived from speech data. However, a notable shift has recently emerged towards the direct utilization of raw speech waveforms, as demonstrated…

Speech enhancement and separation are two fundamental tasks for robust speech processing. Speech enhancement suppresses background noise while speech separation extracts target speech from interfering speakers. Despite a great number of…

Audio and Speech Processing · Electrical Eng. & Systems 2022-03-16 Zili Huang , Shinji Watanabe , Shu-wen Yang , Paola Garcia , Sanjeev Khudanpur

Automatic detection of speaker confidence is critical for adaptive computing but remains constrained by limited labelled data and the subjectivity of paralinguistic annotations. This paper proposes a semi-supervised hybrid framework that…

Sound · Computer Science 2026-05-13 Adam Wynn , Jingyun Wang

This perspective calls for scholars across disciplines to address the challenge of audio deepfake detection and discernment through an interdisciplinary lens across Artificial Intelligence methods and linguistics. With an avalanche of tools…

Sound · Computer Science 2024-11-12 Vandana P. Janeja , Christine Mallinson

Semantic segmentation of various tissue and nuclei types in histology images is fundamental to many downstream tasks in the area of computational pathology (CPath). In recent years, Deep Learning (DL) methods have been shown to perform well…

Computer Vision and Pattern Recognition · Computer Science 2023-02-14 Raja Muhammad Saad Bashir , Talha Qaiser , Shan E Ahmed Raza , Nasir M. Rajpoot

Semi-supervised learning (SSL) methods effectively leverage unlabeled data to improve model generalization. However, SSL models often underperform in open-set scenarios, where unlabeled data contain outliers from novel categories that do…

Computer Vision and Pattern Recognition · Computer Science 2023-11-20 Yue Fan , Anna Kukleva , Dengxin Dai , Bernt Schiele

Recent studies have highlighted the potential of discrete tokens derived from self-supervised learning (SSL) models for various speech-related tasks. These tokens serve not only as substitutes for text in language modeling but also as…

Sound · Computer Science 2025-05-23 Kentaro Onda , Yosuke Kashiwagi , Emiru Tsunoo , Hayato Futami , Shinji Watanabe

This paper evaluates the impact of training undergraduate students to improve their audio deepfake discernment ability by listening for expert-defined linguistic features. Such features have been shown to improve performance of AI…

Sound · Computer Science 2024-11-25 Noshaba N. Bhalli , Nehal Naqvi , Chloe Evered , Christine Mallinson , Vandana P. Janeja

Self-supervised learning (SSL) has achieved great success in various areas including speech processing. Recently, it is proven that speech based SSL models are able to extract superior universal representations on a range of downstream…

Sound · Computer Science 2022-12-21 Changli Tang , Yujin Wang , Xie Chen , Wei-Qiang Zhang

Detecting digital face manipulation in images and video has attracted extensive attention due to the potential risk to public trust. To counteract the malicious usage of such techniques, deep learning-based deepfake detection methods have…

Computer Vision and Pattern Recognition · Computer Science 2023-04-14 Yuhang Lu , Touradj Ebrahimi

Self-supervised learning (SSL) is the latest breakthrough in speech processing, especially for label-scarce downstream tasks by leveraging massive unlabeled audio data. The noise robustness of the SSL is one of the important challenges to…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-25 Hiroshi Sato , Ryo Masumura , Tsubasa Ochiai , Marc Delcroix , Takafumi Moriya , Takanori Ashihara , Kentaro Shinayama , Saki Mizuno , Mana Ihori , Tomohiro Tanaka , Nobukatsu Hojo

The proliferation of audio deepfakes poses a growing threat to trust in digital communications. While detection methods have advanced, attributing audio deepfakes to their source models remains an underexplored yet crucial challenge. In…

Sound · Computer Science 2025-10-13 Andrea Di Pierno , Luca Guarnera , Dario Allegra , Sebastiano Battiato