English
Related papers

Related papers: Unsupervised Representation Learning with Future O…

200 papers

We propose a novel unsupervised object localization method that allows us to explain the predictions of the model by utilizing self-supervised pre-trained models without additional finetuning. Existing unsupervised and self-supervised…

Computer Vision and Pattern Recognition · Computer Science 2023-09-11 Yeonghwan Song , Seokwoo Jang , Dina Katabi , Jeany Son

Speech representation learning approaches for non-semantic tasks such as language recognition have either explored supervised embedding extraction methods using a classifier model or self-supervised representation learning approaches using…

Computation and Language · Computer Science 2023-06-08 Shikhar Vashishth , Shikhar Bharadwaj , Sriram Ganapathy , Ankur Bapna , Min Ma , Wei Han , Vera Axelrod , Partha Talukdar

Training SER models in natural, spontaneous speech is especially challenging due to the subtle expression of emotions and the unpredictable nature of real-world audio. In this paper, we present a robust system for the INTERSPEECH 2025…

Speech Emotion Captioning (SEC) has emerged as a notable research direction. The inherent complexity of emotional content in human speech makes it challenging for traditional discrete classification methods to provide an adequate…

Existing approaches for learning word embeddings often assume there are sufficient occurrences for each word in the corpus, such that the representation of words can be accurately estimated from their contexts. However, in real-world…

Computation and Language · Computer Science 2019-07-02 Ziniu Hu , Ting Chen , Kai-Wei Chang , Yizhou Sun

Learning the latent representation of data in unsupervised fashion is a very interesting process that provides relevant features for enhancing the performance of a classifier. For speech emotion recognition tasks, generating effective…

Sound · Computer Science 2020-07-29 Siddique Latif , Rajib Rana , Junaid Qadir , Julien Epps

Unsupervised 3D representation learning reduces the burden of labeling multimodal 3D data for fusion perception tasks. Among different pre-training paradigms, differentiable-rendering-based methods have shown most promise. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Runjian Chen , Hang Zhang , Avinash Ravichandran , Hyoungseob Park , Wenqi Shao , Alex Wong , Ping Luo

Self-supervised representation learning is able to learn semantically meaningful features; however, much of its recent success relies on multiple crops of an image with very few objects. Instead of learning view-invariant representation…

Computer Vision and Pattern Recognition · Computer Science 2021-10-13 Yuwen Xiong , Mengye Ren , Wenyuan Zeng , Raquel Urtasun

Learning representation from unlabeled time series data is a challenging problem. Most existing self-supervised and unsupervised approaches in the time-series domain do not capture low and high-frequency features at the same time. Further,…

Computer Vision and Pattern Recognition · Computer Science 2023-11-27 Vandan Gorade , Azad Singh , Deepak Mishra

Unseen data conditions can inflict serious performance degradation on systems relying on supervised machine learning algorithms. Because data can often be unseen, and because traditional machine learning algorithms are trained in a…

Machine Learning · Computer Science 2017-09-01 Vikramjit Mitra , Horacio Franco

The performance of speech emotion recognition (SER) is limited by the insufficient emotion information in unimodal systems and the feature alignment difficulties in multimodal systems. Recently, multimodal large language models (MLLMs) have…

Sound · Computer Science 2025-09-22 Yiqing Yang , Man-Wai Mak

Speech evaluation measures a learners oral proficiency using automatic models. Corpora for training such models often pose sparsity challenges given that there often is limited scored data from teachers, in addition to the score…

Artificial Intelligence · Computer Science 2024-09-24 Huayun Zhang , Jeremy H. M. Wong , Geyu Lin , Nancy F. Chen

Recently, self-supervised learning methods based on masked latent prediction have proven to encode input data into powerful representations. However, during training, the learned latent space can be further transformed to extract…

Sound · Computer Science 2025-06-05 Aurian Quelennec , Pierre Chouteau , Geoffroy Peeters , Slim Essid

Machine unlearning aims to remove information derived from forgotten data while preserving that of the remaining dataset in a well-trained model. With the increasing emphasis on data privacy, several approaches to machine unlearning have…

Machine Learning · Computer Science 2024-05-08 Shaofei Shen , Chenhao Zhang , Yawen Zhao , Alina Bialkowski , Weitong Tony Chen , Miao Xu

In this paper, we propose a unified pre-training approach called UniSpeech to learn speech representations with both unlabeled and labeled data, in which supervised phonetic CTC learning and phonetically-aware contrastive self-supervised…

Computation and Language · Computer Science 2021-06-11 Chengyi Wang , Yu Wu , Yao Qian , Kenichi Kumatani , Shujie Liu , Furu Wei , Michael Zeng , Xuedong Huang

Self-supervised representation learning can mitigate the limitations in recognition tasks with few manually labeled data but abundant unlabeled data---a common scenario in sound event research. In this work, we explore unsupervised…

Sound · Computer Science 2020-11-17 Eduardo Fonseca , Diego Ortego , Kevin McGuinness , Noel E. O'Connor , Xavier Serra

Recent advancements in Deep and Self-Supervised Learning (SSL) have led to substantial improvements in Speech Emotion Recognition (SER) performance, reaching unprecedented levels. However, obtaining sufficient amounts of accurately labeled…

Computation and Language · Computer Science 2025-02-25 Bulat Khaertdinov , Pedro Jeuris , Annanda Sousa , Enrique Hortal

Unsupervised methods for learning distributed representations of words are ubiquitous in today's NLP research, but far less is known about the best ways to learn distributed phrase or sentence representations from unlabelled data. This…

Computation and Language · Computer Science 2016-02-11 Felix Hill , Kyunghyun Cho , Anna Korhonen

Representation learning from unlabeled data has been extensively studied in statistics, data science and signal processing with a rich literature on techniques for dimension reduction, compression, multi-dimensional scaling among others.…

Machine Learning · Computer Science 2025-10-03 Pascal Esser , Maximilian Fleissner , Debarghya Ghoshdastidar

Speech emotion recognition is a challenging research topic that plays a critical role in human-computer interaction. Multimodal inputs further improve the performance as more emotional information is used. However, existing studies learn…

Sound · Computer Science 2023-02-28 Weidong Chen , Xiaofeng Xing , Xiangmin Xu , Jichen Yang , Jianxin Pang