English
Related papers

Related papers: Weakly Supervised Scalable Audio Content Analysis

200 papers

Sequential sensor data is generated in a wide variety of practical applications. A fundamental challenge involves learning effective classifiers for such sequential data. While deep learning has led to impressive performance gains in recent…

Machine Learning · Computer Science 2020-10-07 Nauman Ahad , Mark A. Davenport

Weakly supervised object detection has recently received much attention, since it only requires image-level labels instead of the bounding-box labels consumed in strongly supervised learning. Nevertheless, the save in labeling expense is…

Computer Vision and Pattern Recognition · Computer Science 2018-02-13 Jiajie Wang , Jiangchao Yao , Ya Zhang , Rui Zhang

Weakly supervised learning has emerged as a compelling tool for object detection by reducing the need for strong supervision during training. However, major challenges remain: (1) differentiation of object instances can be ambiguous; (2)…

Computer Vision and Pattern Recognition · Computer Science 2020-10-22 Zhongzheng Ren , Zhiding Yu , Xiaodong Yang , Ming-Yu Liu , Yong Jae Lee , Alexander G. Schwing , Jan Kautz

Text-to-audio grounding (TAG) task aims to predict the onsets and offsets of sound events described by natural language. This task can facilitate applications such as multimodal information retrieval. This paper focuses on weakly-supervised…

Sound · Computer Science 2024-07-18 Xuenan Xu , Ziyang Ma , Mengyue Wu , Kai Yu

Despite the recent advances in video classification, progress in spatio-temporal action recognition has lagged behind. A major contributing factor has been the prohibitive cost of annotating videos frame-by-frame. In this paper, we present…

Computer Vision and Pattern Recognition · Computer Science 2020-07-22 Anurag Arnab , Chen Sun , Arsha Nagrani , Cordelia Schmid

Audio-visual source localization is a challenging task that aims to predict the location of visual sound sources in a video. Since collecting ground-truth annotations of sounding objects can be costly, a plethora of weakly-supervised…

Sound · Computer Science 2022-09-21 Shentong Mo , Pedro Morgado

Sound event detection (SED) entails identifying the type of sound and estimating its temporal boundaries from acoustic signals. These events are uniquely characterized by their spatio-temporal features, which are determined by the way they…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-19 Tanmay Khandelwal , Rohan Kumar Das

Detecting musical versions (different renditions of the same piece) is a challenging task with important applications. Because of the ground truth nature, existing approaches match musical versions at the track level (e.g., whole song).…

Sound · Computer Science 2025-05-19 Joan Serrà , R. Oguz Araz , Dmitry Bogdanov , Yuki Mitsufuji

This paper proposes a segregated temporal assembly recurrent (STAR) network for weakly-supervised multiple action detection. The model learns from untrimmed videos with only supervision of video-level labels and makes prediction of…

Computer Vision and Pattern Recognition · Computer Science 2018-11-20 Yunlu Xu , Chengwei Zhang , Zhanzhan Cheng , Jianwen Xie , Yi Niu , Shiliang Pu , Fei Wu

Target sound detection (TSD) aims to detect the target sound from mixture audio given the reference information. Previous works have shown that TSD models can be trained on fully-annotated (frame-level label) or weakly-annotated (clip-level…

Sound · Computer Science 2022-07-20 Dongchao Yang , Helin Wang , Yuexian Zou , Wenwu Wang

Fully-supervised salient object detection (SOD) methods have made great progress, but such methods often rely on a large number of pixel-level annotations, which are time-consuming and labour-intensive. In this paper, we focus on a new…

Computer Vision and Pattern Recognition · Computer Science 2022-09-08 Runmin Cong , Qi Qin , Chen Zhang , Qiuping Jiang , Shiqi Wang , Yao Zhao , Sam Kwong

Limited labeled data is becoming the largest bottleneck for supervised learning systems. This is especially the case for many real-world tasks where large scale annotated examples are either too expensive to acquire or unavailable due to…

Social and Information Networks · Computer Science 2020-05-28 Kai Shu , Ahmed Hassan Awadallah , Susan Dumais , Huan Liu

Many datasets and approaches in ambient sound analysis use weakly labeled data.Weak labels are employed because annotating every data sample with a strong label is too expensive.Yet, their impact on the performance in comparison to strong…

Sound · Computer Science 2020-12-08 Nicolas Turpault , Romain Serizel , Emmanuel Vincent

State-of-the-art speaker verification systems are inherently dependent on some kind of human supervision as they are trained on massive amounts of labeled data. However, manually annotating utterances is slow, expensive and not scalable to…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-25 Théo Lepage , Réda Dehak

Deep learning based salient object detection has recently achieved great success with its performance greatly outperforms any other unsupervised methods. However, annotating per-pixel saliency masks is a tedious and inefficient procedure.…

Computer Vision and Pattern Recognition · Computer Science 2018-03-20 Guanbin Li , Yuan Xie , Liang Lin

Accurate detection of offensive content on social media demands high-quality labeled data; however, such data is often scarce due to the low prevalence of offensive instances and the high cost of manual annotation. To address this…

Machine Learning · Computer Science 2025-11-19 Han Wang , Deyi Ji , Junyu Lu , Lanyun Zhu , Hailong Zhang , Haiyang Wu , Liqun Liu , Peng Shu , Roy Ka-Wei Lee

Consider a classification problem where we do not have access to labels for individual training examples, but only have average labels over subpopulations. We give practical examples of this setup and show how such a classification task can…

Machine Learning · Statistics 2015-09-16 Stefan Wager , Alexander Blocker , Niall Cardin

Long-tailed data is prevalent in real-world classification tasks and heavily relies on supervised information, which makes the annotation process exceptionally labor-intensive and time-consuming. Unfortunately, despite being a common…

Machine Learning · Computer Science 2024-12-04 Meng Wei , Zhongnian Li , Yong Zhou , Xinzheng Xu

Audio Event Detection (AED) aims to recognize sounds within audio and video recordings. AED employs machine learning algorithms commonly trained and tested on annotated datasets. However, available datasets are limited in number of samples…

This paper proposes a benchmark of submissions to Detection and Classification Acoustic Scene and Events 2021 Challenge (DCASE) Task 4 representing a sampling of the state-of-the-art in Sound Event Detection task. The submissions are…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-02 Francesca Ronchini , Romain Serizel