English
Related papers

Related papers: Comprehensive Audio Query Handling System with Int…

200 papers

Heart sound diagnosis and classification play an essential role in detecting cardiovascular disorders, especially when the remote diagnosis becomes standard clinical practice. Most of the current work is designed for single category based…

Sound · Computer Science 2022-04-25 Li Guo , Steven Davenport , Yonghong Peng

This research introduces a novel approach to textual and multimodal Hate Speech Detection (HSD), using Large Language Models (LLMs) as dynamic knowledge bases to generate background context and incorporate it into the input of HSD…

Computation and Language · Computer Science 2025-10-20 Joshua Wolfe Brook , Ilia Markov

AudioSet is a widely used benchmark in the audio research community and has significantly advanced various audio-related tasks. However, persistent issues with label accuracy and completeness remain critical bottlenecks that limit…

Sound · Computer Science 2025-08-25 Yulin Sun , Qisheng Xu , Yi Su , Qian Zhu , Yong Dou , Xinwang Liu , Kele Xu

This paper focuses on the development of an advanced intelligent article scoring system that not only assesses the overall quality of written work but also offers detailed feature-based scoring tailored to various article genres. By…

Computation and Language · Computer Science 2024-10-21 Chihang Wang , Yuxin Dong , Zhenhong Zhang , Ruotong Wang , Shuo Wang , Jiajing Chen

Existing audio question answering benchmarks largely emphasize sound event classification or caption-grounded queries, often enabling models to succeed through shortcut strategies, short-duration cues, lexical priors, dataset-specific…

Computation and Language · Computer Science 2026-04-24 Tasnim Kabir , Dmytro Kurdydyk , Aadi Palnitkar , Liam Dorn , Ahmed Haj Ahmed , Jordan Lee Boyd-Graber

Query understanding in Conversational Information Seeking (CIS) involves accurately interpreting user intent through context-aware interactions. This includes resolving ambiguities, refining queries, and adapting to evolving information…

Computation and Language · Computer Science 2025-04-10 Yifei Yuan , Zahra Abbasiantaeb , Yang Deng , Mohammad Aliannejadi

Recent multi-modal Large Language Models (LLMs) such as GPT-4o have demonstrated strong capabilities of direct speech interaction. However, the lack of specialized and comprehensive benchmarks for end-to-end speech LLM evaluation hinders…

Computation and Language · Computer Science 2025-09-29 Linhao Zhang , Jian Zhang , Bokai Lei , Chuhan Wu , Aiwei Liu , Wei Jia , Xiao Zhou

Building Spoken Language Understanding (SLU) systems that do not rely on language specific Automatic Speech Recognition (ASR) is an important yet less explored problem in language processing. In this paper, we present a comparative study…

Computation and Language · Computer Science 2022-04-19 Hemant Yadav , Akshat Gupta , Sai Krishna Rallabandi , Alan W Black , Rajiv Ratn Shah

Today's Automatic Speech Recognition systems only rely on acoustic signals and often don't perform well under noisy conditions. Performing multi-modal speech recognition - processing acoustic speech signals and lip-reading video…

Computer Vision and Pattern Recognition · Computer Science 2018-03-14 Matthijs Van keirsbilck , Bert Moons , Marian Verhelst

By incorporating additional contextual information, deep biasing methods have emerged as a promising solution for speech recognition of personalized words. However, for real-world voice assistants, always biasing on such personalized words…

Sound · Computer Science 2023-08-16 Tianyi Xu , Zhanheng Yang , Kaixun Huang , Pengcheng Guo , Ao Zhang , Biao Li , Changru Chen , Chao Li , Lei Xie

The attention-based Transformers have been increasingly applied to audio classification because of their global receptive field and ability to handle long-term dependency. However, the existing frameworks which are mainly extended from the…

Sound · Computer Science 2023-03-15 Xiaoyu Liu , Hanlin Lu , Jianbo Yuan , Xinyu Li

The paper describes a system that uses large language model (LLM) technology to support the automatic learning of new entries in an intelligent agent's semantic lexicon. The process is bootstrapped by an existing non-toy lexicon and a…

Computation and Language · Computer Science 2023-12-29 Sanjay Oruganti , Sergei Nirenburg , Jesse English , Marjorie McShane

Large Language Models (LLMs) have proven immensely beneficial in education by capturing vast amounts of literature-based information, allowing them to generate context without relying on external sources. In this paper, we propose a…

Information Retrieval · Computer Science 2025-07-03 Umar Ali Khan , Ekram Khan , Fiza Khan , Athar Ali Moinuddin

Language model pre-training has shown promising results in various downstream tasks. In this context, we introduce a cross-modal pre-trained language model, called Speech-Text BERT (ST-BERT), to tackle end-to-end spoken language…

Computation and Language · Computer Science 2021-04-13 Minjeong Kim , Gyuwan Kim , Sang-Woo Lee , Jung-Woo Ha

Long-duration audio is increasingly common in industrial and consumer settings, yet reviewing multi-hour recordings is impractical, motivating systems that answer natural-language queries with precise temporal grounding and minimal…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-10 Naveen Vakada , Kartik Hegde , Arvind Krishna Sridhar , Yinyi Guo , Erik Visser

Automatically and accurately identifying user intents and filling the associated slots from their spoken language are critical to the success of dialogue systems. Traditional methods require manually defining the DOMAIN-INTENT-SLOT schema…

Artificial Intelligence · Computer Science 2021-03-17 Zengfeng Zeng , Dan Ma , Haiqin Yang , Zhen Gou , Jianping Shen

Speech classification tasks often require powerful language understanding models to grasp useful features, which becomes problematic when limited training data is available. To attain superior classification performance, we propose to…

Computation and Language · Computer Science 2024-07-26 Nicolae-Catalin Ristea , Andrei Anghel , Radu Tudor Ionescu

Machine learning techniques have proved useful for classifying and analyzing audio content. However, recent methods typically rely on abstract and high-dimensional representations that are difficult to interpret. Inspired by…

Precisely understanding users' contextual search intent has been an important challenge for conversational search. As conversational search sessions are much more diverse and long-tailed, existing methods trained on limited data still show…

Information Retrieval · Computer Science 2023-10-23 Kelong Mao , Zhicheng Dou , Fengran Mo , Jiewen Hou , Haonan Chen , Hongjin Qian

Healthcare systems around the world are grappling with issues like inefficient diagnostics, rising costs, and limited access to specialists. These problems often lead to delays in treatment and poor health outcomes. Most current AI and deep…

Artificial Intelligence · Computer Science 2025-12-22 Maliha Tabassum , M Shamim Kaiser