English
Related papers

Related papers: Analysis of Self-Supervised Learning and Dimension…

200 papers

One of the main problems in applying deep learning techniques to recognize activities of daily living (ADLs) based on inertial sensors is the lack of appropriately large labelled datasets to train deep learning-based models. A large amount…

Computer Vision and Pattern Recognition · Computer Science 2023-11-15 Hamza Amrani , Daniela Micucci , Paolo Napoletano

In recent years, speech-based self-supervised learning (SSL) has made significant progress in various tasks, including automatic speech recognition (ASR). An ASR model with decent performance can be realized by fine-tuning an SSL model with…

Audio and Speech Processing · Electrical Eng. & Systems 2023-08-30 Zhisheng Zheng , Ziyang Ma , Yu Wang , Xie Chen

Speech Emotion Recognition (SER) is fundamental to affective computing and human-computer interaction, yet existing models struggle to generalize across diverse acoustic conditions. While Contrastive Language-Audio Pretraining (CLAP)…

Sound · Computer Science 2025-07-08 Jiacheng Shi , Yanfu Zhang , Ye Gao

Dimensionality reduction is a critical preprocessing step for clustering high-dimensional data, yet comprehensive evaluation of its impact across diverse methods and data types remains limited. In this study, we systematically assess the…

Machine Learning · Computer Science 2026-05-13 Ousmane Assani-Amate , Mohammadreza Bakhtyari , Émilie Roy , Vladimir Makarenkov

There exist many high-dimensional data in real-world applications such as biology, computer vision, and social networks. Feature selection approaches are devised to confront with high-dimensional data challenges with the aim of efficient…

Machine Learning · Computer Science 2021-06-22 Mohsen Ghassemi Parsa , Hadi Zare , Mehdi Ghatee

Training a supervised neural network classifier typically requires many annotated training samples. Collecting and annotating a large number of data points are costly and sometimes even infeasible. Traditional annotation process uses a…

Computation and Language · Computer Science 2020-10-02 Weixin Liang , James Zou , Zhou Yu

Deep learning-based techniques have proven effective in polyp segmentation tasks when provided with sufficient pixel-wise labeled data. However, the high cost of manual annotation has created a bottleneck for model generalization. To…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Duojun Huang , Xinyu Xiong , De-Jun Fan , Feng Gao , Xiao-Jian Wu , Guanbin Li

Autoencoders offer a general way of learning low-dimensional, non-linear representations from data without labels. This is achieved without making any particular assumptions about the data type or other domain knowledge. The generality and…

Machine Learning · Computer Science 2025-05-27 Collin Leiber , Lukas Miklautz , Claudia Plant , Christian Böhm

In recent years, deep neural networks (DNNs) have been found very successful for multi-label classification (MLC) of remote sensing (RS) images. Self-supervised pre-training combined with fine-tuning on a randomly selected small training…

Computer Vision and Pattern Recognition · Computer Science 2023-06-22 Lars Möllenbrok , Begüm Demir

Aligning general-purpose large language models (LLMs) to downstream tasks often incurs significant training adjustment costs. Prior research has explored various avenues to enhance alignment efficiency, primarily through minimal-data…

Computation and Language · Computer Science 2025-06-19 Hao Chen , Haoze Li , Zhiqing Xiao , Lirong Gao , Qi Zhang , Xiaomeng Hu , Ningtao Wang , Xing Fu , Junbo Zhao

Subspace clustering is the classical problem of clustering a collection of data samples that approximately lie around several low-dimensional subspaces. The current state-of-the-art approaches for this problem are based on the…

Machine Learning · Computer Science 2023-01-26 Maryam Abdolali , Nicolas Gillis

The success of deep learning comes from its ability to capture the hierarchical structure of data by learning high-level representations defined in terms of low-level ones. In this paper we explore self-supervised learning of hierarchical…

In sentiment classification, the enormous amount of textual data, its immense dimensionality, and inherent noise make it extremely difficult for machine learning classifiers to extract high-level and complex abstractions. In order to make…

Information Retrieval · Computer Science 2020-06-09 Aftab Anjum , Mazharul Islam , Lin Wang

While word error rates of automatic speech recognition (ASR) systems have consistently fallen, natural language understanding (NLU) applications built on top of ASR systems still attribute significant numbers of failures to low-quality…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-05 David M. Chan , Shalini Ghosh , Hitesh Tulsiani , Ariya Rastrow , Björn Hoffmeister

Identifying new user intents is an essential task in the dialogue system. However, it is hard to get satisfying clustering results since the definition of intents is strongly guided by prior knowledge. Existing methods incorporate prior…

Computation and Language · Computer Science 2019-11-21 Ting-En Lin , Hua Xu , Hanlei Zhang

To further reduce the cost of semi-supervised domain adaptation (SSDA) labeling, a more effective way is to use active learning (AL) to annotate a selected subset with specific properties. However, domain adaptation tasks are always…

Computer Vision and Pattern Recognition · Computer Science 2022-05-26 Hao Zhang , Ruimao Zhang , Zhanglin Peng , Junle Wang , Yanqing Jing

Cued Speech (CS) is a communication system for deaf people or hearing impaired people, in which a speaker uses it to aid a lipreader in phonetic level by clarifying potentially ambiguous mouth movements with hand shape and positions.…

Multimedia · Computer Science 2021-06-29 Jianrong Wang , Nan Gu , Mei Yu , Xuewei Li , Qiang Fang , Li Liu

Continuous emotion recognition (CER) aims to track the dynamic changes in a person's emotional state over time. This paper proposes a novel approach to translating CER into a prediction problem of dynamic affect-contour clusters from…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-06 Gökhan Kuşçu , Engin Erzin

Continuous monitoring with an ever-increasing number of sensors has become ubiquitous across many application domains. However, acquired time series are typically high-dimensional and difficult to interpret. Expressive deep learning (DL)…

Machine Learning · Computer Science 2023-05-26 Iris A. M. Huijben , Arthur A. Nijdam , Sebastiaan Overeem , Merel M. van Gilst , Ruud J. G. van Sloun

Modern high-dimensional methods often adopt the "bet on sparsity" principle, while in supervised multivariate learning statisticians may face "dense" problems with a large number of nonzero coefficients. This paper proposes a novel…

Machine Learning · Statistics 2022-02-10 Yiyuan She , Jiahui Shen , Chao Zhang