中文
相关论文

相关论文: Attention Is Not Always the Answer: Optimizing Voi…

200 篇论文

Active speaker detection plays a vital role in human-machine interaction. Recently, a few end-to-end audiovisual frameworks emerged. However, these models' inference time was not explored and are not applicable for real-time applications…

声音 · 计算机科学 2022-11-24 Fiseha B. Tesema , Zheyuan Lin , Shiqiang Zhu , Wei Song , Jason Gu , Hong Wu

Voice activity detection (VAD) is the task of detecting speech in an audio stream, which is challenging due to numerous unseen noises and low signal-to-noise ratios in real environments. Recently, neural network-based VADs have alleviated…

声音 · 计算机科学 2024-05-28 Jidong Jia , Pei Zhao , Di Wang

Visual voice activity detection (V-VAD) uses visual features to predict whether a person is speaking or not. V-VAD is useful whenever audio VAD (A-VAD) is inefficient either because the acoustic signal is difficult to analyze or because it…

计算机视觉与模式识别 · 计算机科学 2020-10-19 Sylvain Guy , Stéphane Lathuilière , Pablo Mesejo , Radu Horaud

It is now well established from a variety of studies that there is a significant benefit from combining video and audio data in detecting active speakers. However, either of the modalities can potentially mislead audiovisual fusion by…

Audio-visual speech enhancement system is regarded to be one of promising solutions for isolating and enhancing speech of desired speaker. Conventional methods focus on predicting clean speech spectrum via a naive convolution neural network…

音频与语音处理 · 电气工程与系统科学 2022-09-28 Xinmeng Xu , Jianjun Hao

DeepFake Audio, unlike DeepFake images and videos, has been relatively less explored from detection perspective, and the solutions which exist for the synthetic speech classification either use complex networks or dont generalize to…

声音 · 计算机科学 2022-10-24 Vardhan Dongre , Abhinav Thimma Reddy , Nikhitha Reddeddy

Distracted driving is deadly, claiming 3,477 lives in the U.S. in 2015 alone. Although there has been a considerable amount of research on modeling the distracted behavior of drivers under various conditions, accurate automatic detection…

计算机视觉与模式识别 · 计算机科学 2018-10-26 Yulun Du , Chirag Raman , Alan W Black , Louis-Philippe Morency , Maxine Eskenazi

Concurrent Speaker Detection (CSD), the task of identifying active speakers and their overlaps in an audio signal, is essential for various audio applications, including meeting transcription, speaker diarization, and speech separation.…

音频与语音处理 · 电气工程与系统科学 2025-01-16 Amit Eliav , Sharon Gannot

Voice activity detection (VAD) is an important pre-processing step for speech technology applications. The task consists of deriving segment boundaries of audio signals which contain voicing information. In recent years, it has been shown…

音频与语音处理 · 电气工程与系统科学 2023-03-28 Eklavya Sarkar , RaviShankar Prasad , Mathew Magimai. -Doss

Voice disorders significantly impact patient quality of life, yet non-invasive automated diagnosis remains under-explored due to both the scarcity of pathological voice data, and the variability in recording sources. This work introduces…

Wearable Human Activity Recognition (WHAR) is a prominent research area within ubiquitous computing, whose core lies in effectively modeling intra- and inter-sensor spatio-temporal relationships from multi-modal time series data. Existing…

人机交互 · 计算机科学 2026-04-13 Wang Chenglong , Zhuo Yan , Ding Wenbo , Chen Xinlei

Voice activity detection (VAD) is essential for speech-driven applications, but remains far from perfect in noisy and resource-limited environments. Existing methods often lack robustness to noise, and their frame-wise classification losses…

声音 · 计算机科学 2025-08-29 Chien-Chun Wang , En-Lun Yu , Jeih-Weih Hung , Shih-Chieh Huang , Berlin Chen

Voice activity detection (VAD) is a critical component in various applications such as speech recognition, speech enhancement, and hands-free communication systems. With the increasing demand for personalized and context-aware technologies,…

音频与语音处理 · 电气工程与系统科学 2024-06-17 Satyam Kumar , Sai Srujana Buddi , Utkarsh Oggy Sarawgi , Vineet Garg , Shivesh Ranjan , Ognjen , Rudovic , Ahmed Hussen Abdelaziz , Saurabh Adya

A distributed multi-speaker voice activity detection (DM-VAD) method for wireless acoustic sensor networks (WASNs) is proposed. DM-VAD is required in many signal processing applications, e.g. distributed speech enhancement based on…

Voice Activity Detection (VAD) is the process of automatically determining whether a person is speaking and identifying the timing of their speech in an audiovisual data. Traditionally, this task has been tackled by processing either audio…

计算机视觉与模式识别 · 计算机科学 2024-10-21 Andrea Appiani , Cigdem Beyan

In cooperative perception studies, there is often a trade-off between communication bandwidth and perception performance. While current feature fusion solutions are known for their excellent object detection performance, transmitting the…

计算机视觉与模式识别 · 计算机科学 2024-08-29 Deyuan Qu , Qi Chen , Yongqi Zhu , Yihao Zhu , Sergei S. Avedisov , Song Fu , Qing Yang

Voice activity detection (VAD) improves the performance of speaker verification (SV) by preserving speech segments and attenuating the effects of non-speech. However, this scheme is not ideal: (1) it fails in noisy environments or…

声音 · 计算机科学 2023-06-01 Zuheng Kang , Jianzong Wang , Junqing Peng , Jing Xiao

Voice activity detection (VAD) remains a challenge in noisy environments. With access to multiple microphones, prior studies have attempted to improve the noise robustness of VAD by creating multi-channel VAD (MVAD) methods. However, MVAD…

Phase-based features related to vocal source characteristics can be incorporated into magnitude-based speaker recognition systems to improve the system performance. However, traditional feature-level fusion methods typically ignore the…

音频与语音处理 · 电气工程与系统科学 2025-10-20 Rongfeng Su , Mengjie Du , Xiaokang Liu , Lan Wang , Nan Yan

Voice activity detection (VAD), which classifies frames as speech or non-speech, is an important module in many speech applications including speaker verification. In this paper, we propose a novel method, called self-adaptive soft VAD, to…

音频与语音处理 · 电气工程与系统科学 2020-02-25 Youngmoon Jung , Yeunju Choi , Hoirin Kim