English
Related papers

Related papers: Joint Generative-Contrastive Representation Learni…

200 papers

Semi-supervised learning is sought for leveraging the unlabelled data when labelled data is difficult or expensive to acquire. Deep generative models (e.g., Variational Autoencoder (VAE)) and semisupervised Generative Adversarial Networks…

Machine Learning · Computer Science 2019-05-09 Xiang Zhang , Lina Yao , Feng Yuan

Developing a reliable anomalous sound detection (ASD) system requires robustness to noise, adaptation to domain shifts, and effective performance with limited training data. Current leading methods rely on extensive labeled data for each…

Sound · Computer Science 2024-09-10 Phurich Saengthong , Takahiro Shinozaki

Anomalous sound detection (ASD) in the wild requires robustness to distribution shifts such as unseen low-SNR input mixtures of machine and noise types. State-of-the-art systems extract embeddings from an adapted audio encoder and detect…

Audio and Speech Processing · Electrical Eng. & Systems 2025-10-30 Phurich Saengthong , Tomoya Nishida , Kota Dohi , Natsuo Yamashita , Yohei Kawaguchi

The rise of video-sharing platforms has attracted more and more people to shoot videos and upload them to the Internet. These videos mostly contain a carefully-edited background audio track, where serious speech change, pitch shifting and…

Sound · Computer Science 2020-10-27 Zhesong Yu , Xingjian Du , Bilei Zhu , Zejun Ma

The generalization of Fake Audio Detection (FAD) is critical due to the emergence of new spoofing techniques. Traditional FAD methods often focus solely on distinguishing between genuine and known spoofed audio. We propose a Genuine-Focused…

Unsupervised anomalous sound detection aims to detect unknown abnormal sounds of machines from normal sounds. However, the state-of-the-art approaches are not always stable and perform dramatically differently even for machines of the same…

Sound · Computer Science 2022-05-02 Youde Liu , Jian Guan , Qiaoxi Zhu , Wenwu Wang

Although graph neural networks (GNNs) have achieved impressive achievements in graph classification, they often need abundant task-specific labels, which could be extensively costly to acquire. A credible solution is to explore additional…

Machine Learning · Computer Science 2025-07-15 Nan Yin , Li Shen , Mengzhu Wang , Long Lan , Zeyu Ma , Chong Chen , Xian-Sheng Hua , Xiao Luo

Novelty detection is the process of determining whether a query example differs from the learned training distribution. Previous methods attempt to learn the representation of the normal samples via generative adversarial networks (GANs).…

Computer Vision and Pattern Recognition · Computer Science 2021-06-21 Chengwei Chen , Yuan Xie , Shaohui Lin , Ruizhi Qiao , Jian Zhou , Xin Tan , Yi Zhang , Lizhuang Ma

Unsupervised anomalous sound detection (ASD) aims to detect unknown anomalous sounds of devices when only normal sound data is available. The autoencoder (AE) and self-supervised learning based methods are two mainstream methods. However,…

Sound · Computer Science 2023-10-16 Jian Guan , Youde Liu , Qiuqiang Kong , Feiyang Xiao , Qiaoxi Zhu , Jiantong Tian , Wenwu Wang

Image-level contrastive representation learning has proven to be highly effective as a generic model for transfer learning. Such generality for transfer learning, however, sacrifices specificity if we are interested in a certain downstream…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Fangyun Wei , Yue Gao , Zhirong Wu , Han Hu , Stephen Lin

Contrastive learning has been shown to produce generalizable representations of audio and visual data by maximizing the lower bound on the mutual information (MI) between different views of an instance. However, obtaining a tight lower…

Machine Learning · Computer Science 2021-04-20 Shuang Ma , Zhaoyang Zeng , Daniel McDuff , Yale Song

Unsupervised anomaly detection in medical imaging aims to detect and localize arbitrary anomalies without requiring annotated anomalous data during training. Often, this is achieved by learning a data distribution of normal samples and…

Computer Vision and Pattern Recognition · Computer Science 2023-01-06 Carsten T. Lüth , David Zimmerer , Gregor Koehler , Paul F. Jaeger , Fabian Isensee , Jens Petersen , Klaus H. Maier-Hein

We propose a combined generative and contrastive neural architecture for learning latent representations of 3D volumetric shapes. The architecture uses two encoder branches for voxel grids and multi-view images from the same underlying…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Chengzhi Wu , Julius Pfrommer , Mingyuan Zhou , Jürgen Beyerer

Generic Event Boundary Detection (GEBD) is a newly introduced task that aims to detect "general" event boundaries that correspond to natural human perception. In this paper, we introduce a novel contrastive learning based approach to deal…

Computer Vision and Pattern Recognition · Computer Science 2021-06-23 Hyolim Kang , Jinwoo Kim , Kyungmin Kim , Taehyun Kim , Seon Joo Kim

This technical report describes two methods that were developed for Task 2 of the DCASE 2020 challenge. The challenge involves an unsupervised learning to detect anomalous sounds, thus only normal machine working condition samples are…

Audio and Speech Processing · Electrical Eng. & Systems 2020-06-22 Alexandrine Ribeiro , Luis Miguel Matos , Pedro Jose Pereira , Eduardo C. Nunes , Andre L. Ferreira , Paulo Cortez , Andre Pilastri

This paper presents a novel framework for Speech Activity Detection (SAD). Inspired by the recent success of multi-task learning approaches in the speech processing domain, we propose a novel joint learning framework for SAD. We utilise…

Audio and Speech Processing · Electrical Eng. & Systems 2020-04-06 Tharindu Fernando , Sridha Sridharan , Mitchell McLaren , Darshana Priyasad , Simon Denman , Clinton Fookes

Unsupervised anomalous sound detection aims to detect unknown anomalous sounds by training a model using only normal audio data. Despite advancements in self-supervised methods, the issue of frequent false alarms when handling samples of…

Sound · Computer Science 2025-09-19 Shun Huang , Zhihua Fang , Liang He

Though offering amazing contextualized token-level representations, current pre-trained language models actually take less attention on acquiring sentence-level representation during its self-supervised pre-training. If self-supervised…

Computation and Language · Computer Science 2022-10-24 Bohong Wu , Hai Zhao

Graph anomaly detection (GAD) is a vital task in graph-based machine learning and has been widely applied in many real-world applications. The primary goal of GAD is to capture anomalous nodes from graph datasets, which evidently deviate…

Machine Learning · Computer Science 2022-12-05 Jingcan Duan , Siwei Wang , Pei Zhang , En Zhu , Jingtao Hu , Hu Jin , Yue Liu , Zhibin Dong

As textual attributes like font are core design elements of document format and page style, automatic attributes recognition favor comprehensive practical applications. Existing approaches already yield satisfactory performance in…

Computer Vision and Pattern Recognition · Computer Science 2022-08-23 Chang Nie , Yiqing Hu , Yanqiu Qu , Hao Liu , Deqiang Jiang , Bo Ren