English
Related papers

Related papers: Language-based Audio Retrieval Task in DCASE 2022 …

200 papers

As multimodal content continues to expand at a rapid pace, audio retrieval has emerged as a key enabling technology for media search, content organization, and intelligent assistants. However, most existing benchmarks concentrate on…

Artificial Intelligence · Computer Science 2026-05-07 Honglei Zhang , Yuting Chen , Chenpeng Hu , Siyue Zhang , Yilei Shi

In this paper, we present a gated convolutional recurrent neural network based approach to solve task 4, large-scale weakly labelled semi-supervised sound event detection in domestic environments, of the DCASE 2018 challenge. Gated linear…

Sound · Computer Science 2018-10-17 Robert Harb , Franz Pernkopf

The AutoSpeech challenge calls for automated machine learning (AutoML) solutions to automate the process of applying machine learning to speech processing tasks. These tasks, which cover a large variety of domains, will be shown to the…

Artificial Intelligence · Computer Science 2020-10-27 Jingsong Wang , Tom Ko , Zhen Xu , Xiawei Guo , Souxiang Liu , Wei-Wei Tu , Lei Xie

This paper introduces the acoustic scene classification task of DCASE 2018 Challenge and the TUT Urban Acoustic Scenes 2018 dataset provided for the task, and evaluates the performance of a baseline system in the task. As in previous years…

Audio and Speech Processing · Electrical Eng. & Systems 2018-10-12 Annamaria Mesaros , Toni Heittola , Tuomas Virtanen

Most existing text-video retrieval methods focus on cross-modal matching between the visual content of videos and textual query sentences. However, in real-world scenarios, online videos are often accompanied by relevant text information…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Wenhao Wu , Haipeng Luo , Bo Fang , Jingdong Wang , Wanli Ouyang

Audio captioning is the task of automatically creating a textual description for the contents of a general audio signal. Typical audio captioning methods rely on deep neural networks (DNNs), where the target of the DNN is to map the input…

Audio and Speech Processing · Electrical Eng. & Systems 2020-07-08 Khoa Nguyen , Konstantinos Drossos , Tuomas Virtanen

The SAFE Challenge evaluates synthetic speech detection across three tasks: unmodified audio, processed audio with compression artifacts, and laundered audio designed to evade detection. We systematically explore self-supervised learning…

Audio and Speech Processing · Electrical Eng. & Systems 2025-10-08 Hashim Ali , Surya Subramani , Lekha Bollinani , Nithin Sai Adupa , Sali El-Loh , Hafiz Malik

This paper describes our submitted systems to the 2022 ADD challenge withing the tracks 1 and 2. Our approach is based on the combination of a pre-trained wav2vec2 feature extractor and a downstream classifier to detect spoofed audio. This…

Audio and Speech Processing · Electrical Eng. & Systems 2022-03-04 Juan M. Martín-Doñas , Aitor Álvarez

Event-based image retrieval from free-form captions presents a significant challenge: models must understand not only visual features but also latent event semantics, context, and real-world knowledge. Conventional vision-language retrieval…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Dinh-Khoi Vo , Van-Loc Nguyen , Minh-Triet Tran , Trung-Nghia Le

SemEval-2025 Task 7: Multilingual and Crosslingual Fact-Checked Claim Retrieval is approached as a Learning-to-Rank task using a bi-encoder model fine-tuned from a pre-trained transformer optimized for sentence similarity. Training used…

Computation and Language · Computer Science 2025-08-06 Pranshu Rastogi

Automatic Speech Scoring (ASS) is the computer-assisted evaluation of a candidate's speaking proficiency in a language. ASS systems face many challenges like open grammar, variable pronunciations, and unstructured or semi-structured…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-07 Yaman Kumar Singla , Avykat Gupta , Shaurya Bagga , Changyou Chen , Balaji Krishnamurthy , Rajiv Ratn Shah

Dialog response ranking is used to rank response candidates by considering their relation to the dialog history. Although researchers have addressed this concept for open-domain dialogs, little attention has been focused on task-oriented…

Computation and Language · Computer Science 2018-11-29 Junki Ohmura , Maxine Eskenazi

Following the recent progress in image classification and captioning using deep learning, we develop a novel natural language person retrieval system based on an attention mechanism. More specifically, given the description of a person, the…

Computer Vision and Pattern Recognition · Computer Science 2017-05-26 Tao Zhou , Muhao Chen , Jie Yu , Demetri Terzopoulos

Large language models (LLMs) have shown great promise for capturing contextual information in natural language processing tasks. We propose a novel approach to speaker diarization that incorporates the prowess of LLMs to exploit contextual…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-15 Tae Jin Park , Kunal Dhawan , Nithin Koluguri , Jagadeesh Balam

Vehicle search is one basic task for the efficient traffic management in terms of the AI City. Most existing practices focus on the image-based vehicle matching, including vehicle re-identification and vehicle tracking. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2021-06-01 Shuai Bai , Zhedong Zheng , Xiaohan Wang , Junyang Lin , Zhu Zhang , Chang Zhou , Yi Yang , Hongxia Yang

With the increasing number of clinical trial reports generated every day, it is becoming hard to keep up with novel discoveries that inform evidence-based healthcare recommendations. To help automate this process and assist medical experts,…

Computation and Language · Computer Science 2023-05-03 Juraj Vladika , Florian Matthes

The query-based moment retrieval is a problem of localising a specific clip from an untrimmed video according a query sentence. This is a challenging task that requires interpretation of both the natural language query and the video…

Computer Vision and Pattern Recognition · Computer Science 2020-10-08 Mayu Otani , Yuta Nakashima , Esa Rahtu , Janne Heikkilä

We introduce the task of expressive speech retrieval, where the goal is to retrieve speech utterances spoken in a given style based on a natural language description of that style. While prior work has primarily focused on performing speech…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-18 Wonjune Kang , Deb Roy

Automated audio captioning (AAC) is the task of automatically creating textual descriptions (i.e. captions) for the contents of a general audio signal. Most AAC methods are using existing datasets to optimize and/or evaluate upon. Given the…

Sound · Computer Science 2021-07-19 Jan Berg , Konstantinos Drossos

The ICASSP 2022 Acoustic Echo Cancellation Challenge is intended to stimulate research in acoustic echo cancellation (AEC), which is an important area of speech enhancement and still a top issue in audio communication. This is the third AEC…

Audio and Speech Processing · Electrical Eng. & Systems 2022-03-01 Ross Cutler , Ando Saabas , Tanel Parnamaa , Marju Purin , Hannes Gamper , Sebastian Braun , Karsten Sørensen , Robert Aichner