中文
相关论文

相关论文: Investigating Local and Global Information for Aut…

200 篇论文

Automated audio captioning (AAC), a task that mimics human perception as well as innovatively links audio processing and natural language processing, has overseen much progress over the last few years. AAC requires recognizing contents such…

声音 · 计算机科学 2023-11-17 Xuenan Xu , Zeyu Xie , Mengyue Wu , Kai Yu

Automated audio captioning (AAC) is the task of automatically creating textual descriptions (i.e. captions) for the contents of a general audio signal. Most AAC methods are using existing datasets to optimize and/or evaluate upon. Given the…

声音 · 计算机科学 2021-07-19 Jan Berg , Konstantinos Drossos

Automated audio captioning (AAC) has developed rapidly in recent years, involving acoustic signal processing and natural language processing to generate human-readable sentences for audio clips. The current models are generally based on the…

声音 · 计算机科学 2021-10-13 Zhongjie Ye , Helin Wang , Dongchao Yang , Yuexian Zou

Automated audio captioning (AAC) is a novel task, where a method takes as an input an audio sample and outputs a textual description (i.e. a caption) of its contents. Most AAC methods are adapted from from image captioning of machine…

声音 · 计算机科学 2020-10-22 An Tran , Konstantinos Drossos , Tuomas Virtanen

Automated audio captioning is a cross-modal translation task that aims to generate natural language descriptions for given audio clips. This task has received increasing attention with the release of freely available datasets in recent…

音频与语音处理 · 电气工程与系统科学 2022-09-28 Xinhao Mei , Xubo Liu , Mark D. Plumbley , Wenwu Wang

Automated Audio Captioning (AAC) is the task of generating natural language descriptions given an audio stream. A typical AAC system requires manually curated training data of audio segments and corresponding text caption annotations. The…

音频与语音处理 · 电气工程与系统科学 2023-09-15 Soham Deshmukh , Benjamin Elizalde , Dimitra Emmanouilidou , Bhiksha Raj , Rita Singh , Huaming Wang

Audio captioning is an important research area that aims to generate meaningful descriptions for audio clips. Most of the existing research extracts acoustic features of audio clips as input to encoder-decoder and transformer architectures…

声音 · 计算机科学 2022-04-20 Ayşegül Özkaya Eren , Mustafa Sert

Automated audio captioning (AAC) is the task of automatically generating textual descriptions for general audio signals. A captioning system has to identify various information from the input signal and express it with natural language.…

机器学习 · 计算机科学 2021-10-15 Benno Weck , Xavier Favory , Konstantinos Drossos , Xavier Serra

Automated Audio captioning (AAC) is a cross-modal task that generates natural language to describe the content of input audio. Most prior works usually extract single-modality acoustic features and are therefore sub-optimal for the…

声音 · 计算机科学 2022-04-13 Chen Chen , Nana Hou , Yuchen Hu , Heqing Zou , Xiaofeng Qi , Eng Siong Chng

Automated audio captioning (AAC) is an audio-to-text task to describe audio contents in natural language. Recently, the advancements in large language models (LLMs), with improvements in training approaches for audio encoders, have opened…

声音 · 计算机科学 2024-06-26 Jizhong Liu , Gang Li , Junbo Zhang , Heinrich Dinkel , Yongqing Wang , Zhiyong Yan , Yujun Wang , Bin Wang

Automated audio captioning aims to describe audio data with captions using natural language. Existing methods often employ an encoder-decoder structure, where the attention-based decoder (e.g., Transformer decoder) is widely used and…

声音 · 计算机科学 2022-08-10 Feiyang Xiao , Jian Guan , Haiyan Lan , Qiaoxi Zhu , Wenwu Wang

Speech samples recorded in both indoor and outdoor environments are often contaminated with secondary audio sources. Most end-to-end monaural speech recognition systems either remove these background sounds using speech enhancement or train…

音频与语音处理 · 电气工程与系统科学 2022-02-04 Chaitanya Narisetty , Emiru Tsunoo , Xuankai Chang , Yosuke Kashiwagi , Michael Hentschel , Shinji Watanabe

Automatic Audio Captioning (AAC) refers to the task of translating audio into a natural language that describes the audio events, source of the events and their relationships. The limited samples in AAC datasets at present, has set up a…

声音 · 计算机科学 2022-02-01 Swapnil Bhosale , Rupayan Chakraborty , Sunil Kumar Kopparapu

Automated Audio Captioning is a multimodal task that aims to convert audio content into natural language. The assessment of audio captioning systems is typically based on quantitative metrics applied to text data. Previous studies have…

声音 · 计算机科学 2024-03-28 Gijs Wijngaard , Elia Formisano , Bruno L. Giordano , Michel Dumontier

Automated audio captioning (AAC) is an important cross-modality translation task, aiming at generating descriptions for audio clips. However, captions generated by previous AAC models have faced ``false-repetition'' errors due to the…

音频与语音处理 · 电气工程与系统科学 2023-06-21 Hanxue Zhang , Zeyu Xie , Xuenan Xu , Mengyue Wu , Kai Yu

Discrete audio representations, termed audio tokens, are broadly categorized into semantic and acoustic tokens, typically generated through unsupervised tokenization of continuous audio representations. However, their applicability to…

声音 · 计算机科学 2025-05-22 Jingguang Tian , Haoqin Sun , Xinhui Hu , Xinkang Xu

Automated Audio captioning (AAC) is a cross-modal translation task that aims to use natural language to describe the content of an audio clip. As shown in the submissions received for Task 6 of the DCASE 2021 Challenges, this problem has…

音频与语音处理 · 电气工程与系统科学 2021-11-23 Xubo Liu , Qiushi Huang , Xinhao Mei , Tom Ko , H Lilian Tang , Mark D. Plumbley , Wenwu Wang

Automated audio captioning is multi-modal translation task that aim to generate textual descriptions for a given audio clip. In this paper we propose a full Transformer architecture that utilizes Patchout as proposed in [1], significantly…

Automated audio captioning aims to use natural language to describe the content of audio data. This paper presents an audio captioning system with an encoder-decoder architecture, where the decoder predicts words based on audio features…

音频与语音处理 · 电气工程与系统科学 2021-08-06 Xinhao Mei , Qiushi Huang , Xubo Liu , Gengyun Chen , Jingqian Wu , Yusong Wu , Jinzheng Zhao , Shengchen Li , Tom Ko , H Lilian Tang , Xi Shao , Mark D. Plumbley , Wenwu Wang

Audio captioning aims to automatically generate a natural language description of an audio clip. Most captioning models follow an encoder-decoder architecture, where the decoder predicts words based on the audio features extracted by the…

音频与语音处理 · 电气工程与系统科学 2021-07-22 Xinhao Mei , Xubo Liu , Qiushi Huang , Mark D. Plumbley , Wenwu Wang
‹ 上一页 1 2 3 10 下一页 ›