English
Related papers

Related papers: Deep Embeddings for Robust User-Based Amateur Voca…

200 papers

Our objective is to transform a video into a set of discrete audio-visual objects using self-supervised learning. To this end, we introduce a model that uses attention to localize and group sound sources, and optical flow to aggregate…

Computer Vision and Pattern Recognition · Computer Science 2020-08-11 Triantafyllos Afouras , Andrew Owens , Joon Son Chung , Andrew Zisserman

Natural Language Processing enables computers to understand human language by analysing and classifying text efficiently with deep-level grammatical and semantic features. Existing models capture features by learning from large corpora with…

Computation and Language · Computer Science 2026-02-25 Azrin Sultana , Firoz Ahmed

Self-supervised learning has become increasingly important to leverage the abundance of unlabeled data available on platforms like YouTube. Whereas most existing approaches learn low-level representations, we propose a joint…

Computer Vision and Pattern Recognition · Computer Science 2019-09-13 Chen Sun , Austin Myers , Carl Vondrick , Kevin Murphy , Cordelia Schmid

Vision Transformer (ViT) architectures represent images as collections of high-dimensional vectorized tokens, each corresponding to a rectangular non-overlapping patch. This representation trades spatial granularity for embedding…

Computer Vision and Pattern Recognition · Computer Science 2024-05-08 Dong Lao , Yangchao Wu , Tian Yu Liu , Alex Wong , Stefano Soatto

Support vector machines (SVMs) have been successful in solving many computer vision tasks including image and video category recognition especially for small and mid-scale training problems. The principle of these non-parametric models is…

Computer Vision and Pattern Recognition · Computer Science 2019-12-13 Hichem Sahbi

Image classification has achieved unprecedented advance with the the rapid development of deep learning. However, the classification of tiny object images is still not well investigated. In this paper, we first briefly review the…

Computer Vision and Pattern Recognition · Computer Science 2021-06-10 Ao Chen , Chen Li , Haoyuan Chen , Hechen Yang , Peng Zhao , Weiming Hu , Wanli Liu , Shuojia Zou , Marcin Grzegorzek

Intro: Vocal cord ultrasound (VCUS) has emerged as a less invasive and better tolerated examination technique, but its accuracy is operator dependent. This research aims to apply a machine learning-assisted algorithm to automatically…

Machine Learning · Computer Science 2025-12-30 Will Sebelik-Lassiter , Evan Schubert , Muhammad Alliyu , Quentin Robbins , Excel Olatunji , Mustafa Barry

Estimating the number of clusters and cluster structures in unlabeled, complex, and high-dimensional datasets (like images) is challenging for traditional clustering algorithms. In recent years, a matrix reordering-based algorithm called…

In recent years, machine learning has been widely adopted to automate the audio mixing process. Automatic mixing systems have been applied to various audio effects such as gain-adjustment, equalization, and reverberation. These systems can…

Sound · Computer Science 2022-09-21 Satvik Venkatesh , David Moffat , Eduardo Reck Miranda

Proprietary and closed APIs are becoming increasingly common to process natural language, and are impacting the practical applications of natural language processing, including few-shot classification. Few-shot classification involves…

Computation and Language · Computer Science 2023-10-24 Pierre Colombo , Victor Pellegrain , Malik Boudiaf , Victor Storchan , Myriam Tami , Ismail Ben Ayed , Celine Hudelot , Pablo Piantanida

The performance of deep learning models depends significantly on their capacity to encode input features efficiently and decode them into meaningful outputs. Better input and output representation has the potential to boost models'…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-10 Ahmed Adel Attia , Yashish M. Siriwardena , Carol Espy-Wilson

We propose a variational Bayesian (VB) approach to learning distributions of latent variables in deep neural network (DNN) models for cross-domain knowledge transfer, to address acoustic mismatches between training and testing conditions.…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-22 Hu Hu , Sabato Marco Siniscalchi , Chao-Han Huck Yang , Chin-Hui Lee

Deep audio representation learning using multi-modal audio-visual data often leads to a better performance compared to uni-modal approaches. However, in real-world scenarios both modalities are not always available at the time of inference,…

Sound · Computer Science 2023-02-07 Amirhossein Hajavi , Ali Etemad

Sentiment classification involves quantifying the affective reaction of a human to a document, media item or an event. Although researchers have investigated several methods to reliably infer sentiment from lexical, speech and body language…

Information Retrieval · Computer Science 2018-06-11 Rahul Gupta , Saurabh Sahu , Carol Espy-Wilson , Shrikanth Narayanan

Many approaches have been used in bird species classification from their sound in order to provide labels for the whole of a recording. However, a more precise classification of each bird vocalization would be of great importance to the use…

Sound · Computer Science 2016-03-24 Veronica Morfi , Dan Stowell

Supervised deep learning has been widely used in the studies of automatic ECG classification, which largely benefits from sufficient annotation of large datasets. However, most of the existing large ECG datasets are roughly annotated, so…

Machine Learning · Computer Science 2020-12-11 Yang Liu , Kuanquan Wang , Qince Li , Runnan He , Yongfeng Yuan , Henggui Zhang

There are individual differences in expressive behaviors driven by cultural norms and personality. This between-person variation can result in reduced emotion recognition performance. Therefore, personalization is an important step in…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-06 Minh Tran , Yufeng Yin , Mohammad Soleymani

Acoustic scene classification (ASC) predominantly relies on supervised approaches. However, acquiring labeled data for training ASC models is often costly and time-consuming. Recently, self-supervised learning (SSL) has emerged as a…

Sound · Computer Science 2024-08-28 Yiqiang Cai , Shengchen Li , Xi Shao

Pre-trained word embeddings are widely used for transfer learning in natural language processing. The embeddings are continuous and distributed representations of the words that preserve their similarities in compact Euclidean spaces.…

Computation and Language · Computer Science 2020-06-25 Halid Ziya Yerebakan , Parmeet Bhatia , Yoshihisa Shinagawa

The assessment of children at risk of autism typically involves a clinician observing, taking notes, and rating children's behaviors. A machine learning model that can label adult and child audio may largely save labor in coding children's…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-07 Jialu Li , Mark Hasegawa-Johnson , Karrie Karahalios