English
Related papers

Related papers: Analysis of Self-Supervised Learning and Dimension…

200 papers

Dimensionality reduction is often used as an initial step in data exploration, either as preprocessing for classification or regression or for visualization. Most dimensionality reduction techniques to date are unsupervised; they do not…

Machine Learning · Statistics 2020-06-17 Jake S. Rhodes , Adele Cutler , Guy Wolf , Kevin R. Moon

Deep neural networks (DNNs) offer a means of addressing the challenging task of clustering high-dimensional data. DNNs can extract useful features, and so produce a lower dimensional representation, which is more amenable to clustering…

Machine Learning · Computer Science 2021-07-23 Louis Mahon , Thomas Lukasiewicz

Clustering is one of the fundamental tasks in computer vision and pattern recognition. Recently, deep clustering methods (algorithms based on deep learning) have attracted wide attention with their impressive performance. Most of these…

Computer Vision and Pattern Recognition · Computer Science 2021-06-14 Yanhai Gan , Xinghui Dong , Huiyu Zhou , Feng Gao , Junyu Dong

Semi-supervised clustering seeks to augment traditional clustering methods by incorporating side information provided via human expertise in order to increase the semantic meaningfulness of the resulting clusters. However, most current…

Machine Learning · Computer Science 2014-02-17 Caiming Xiong , David Johnson , Jason J. Corso

Modern automatic speech recognition (ASR) systems are typically trained on more than tens of thousands hours of speech data, which is one of the main factors for their great success. However, the distribution of such data is typically…

Sound · Computer Science 2024-08-06 Jaeyoung Kim , Han Lu , Soheil Khorram , Anshuman Tripathi , Qian Zhang , Hasim Sak

Discovering the semantics of multimodal utterances is essential for understanding human language and enhancing human-machine interactions. Existing methods manifest limitations in leveraging nonverbal information for discerning complex…

Multimedia · Computer Science 2024-05-22 Hanlei Zhang , Hua Xu , Fei Long , Xin Wang , Kai Gao

Recent advances in unsupervised representation learning have demonstrated the impact of pretraining on large amounts of read speech. We adapt these techniques for domain adaptation in low-resource -- both in terms of data and compute --…

Computation and Language · Computer Science 2022-02-14 Chak-Fai Li , Francis Keith , William Hartmann , Matthew Snover

In this paper, we propose a novel active learning approach integrated with an improved semi-supervised learning framework to reduce the cost of manual annotation and enhance model performance. Our proposed approach effectively leverages…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Wanli Ma , Oktay Karakus , Paul L. Rosin

We study supervised learning problems using clustering constraints to impose structure on either features or samples, seeking to help both prediction and interpretation. The problem of clustering features arises naturally in text…

Machine Learning · Computer Science 2016-09-20 Vincent Roulet , Fajwel Fogel , Alexandre d'Aspremont , Francis Bach

Multidimensional scaling is an important dimension reduction tool in statistics and machine learning. Yet few theoretical results characterizing its statistical performance exist, not to mention any in high dimensions. By considering a…

Methodology · Statistics 2022-03-30 Xiucai Ding , Qiang Sun

Deriving value from a conversational AI system depends on the capacity of a user to translate the prior knowledge into a configuration. In most cases, discovering the set of relevant turn-level speaker intents is often one of the key steps.…

Computation and Language · Computer Science 2024-10-22 Mrinal Rawat , Hithesh Sankararaman , Victor Barres

Recently, clustering with deep network framework has attracted attention of several researchers in the computer vision community. Deep framework gains extensive attention due to its efficiency and scalability towards large-scale and…

Computer Vision and Pattern Recognition · Computer Science 2019-06-18 Jayasree Saha , Jayanta Mukhopadhyay

State-of-the-art methods for semantic segmentation are based on deep neural networks trained on large-scale labeled datasets. Acquiring such datasets would incur large annotation costs, especially for dense pixel-level prediction tasks like…

Computer Vision and Pattern Recognition · Computer Science 2025-07-24 Lile Cai , Xun Xu , Lining Zhang , Chuan-Sheng Foo

In this paper, we propose a one-stage online clustering method called Contrastive Clustering (CC) which explicitly performs the instance- and cluster-level contrastive learning. To be specific, for a given dataset, the positive and negative…

Machine Learning · Computer Science 2020-09-22 Yunfan Li , Peng Hu , Zitao Liu , Dezhong Peng , Joey Tianyi Zhou , Xi Peng

A feature learning task involves training models that are capable of inferring good representations (transformations of the original space) from input data alone. When working with limited or unlabelled data, and also when multiple visual…

Computer Vision and Pattern Recognition · Computer Science 2018-11-02 Gabriel B. Cavallari , Leonardo Sampaio Ferraz Ribeiro , Moacir Antonelli Ponti

Contrastive learning has been applied to Human Activity Recognition (HAR) based on sensor data owing to its ability to achieve performance comparable to supervised learning with a large amount of unlabeled data and a small amount of labeled…

Computer Vision and Pattern Recognition · Computer Science 2022-03-24 Jinqiang Wang , Tao Zhu , Liming Chen , Huansheng Ning , Yaping Wan

In semi-supervised domain adaptation, a few labeled samples per class in the target domain guide features of the remaining target samples to aggregate around them. However, the trained model cannot produce a highly discriminative feature…

Computer Vision and Pattern Recognition · Computer Science 2021-04-20 Jichang Li , Guanbin Li , Yemin Shi , Yizhou Yu

Unsupervised disentangled representation learning is a long-standing problem in computer vision. This work proposes a novel framework for performing image clustering from deep embeddings by combining instance-level contrastive learning with…

Machine Learning · Computer Science 2021-10-05 Ramakrishnan Sundareswaran , Jansel Herrera-Gerena , John Just , Ali Jannesari

Speech emotion recognition (SER) systems find applications in various fields such as healthcare, education, and security and defense. A major drawback of these systems is their lack of generalization across different conditions. This…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-15 Srinivas Parthasarathy , Carlos Busso

A major challenge that prevents the training of DL models is the limited availability of accurately labeled data. This shortcoming is highlighted in areas where data annotation becomes a time-consuming and error-prone task. In this regard,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 David Aparco-Cardenas , Jancarlo F. Gomes , Alexandre X. Falcão , Pedro J. de Rezende