English
Related papers

Related papers: A DenseNet-based method for decoding auditory spat…

200 papers

This work proposes a neural network to extensively exploit spatial information for multichannel joint speech separation, denoising and dereverberation, named SpatialNet. In the short-time Fourier transform (STFT) domain, the proposed…

Sound · Computer Science 2023-12-25 Changsheng Quan , Xiaofei Li

Acoustic Echo Cancellation (AEC) plays a key role in speech interaction by suppressing the echo received at microphone introduced by acoustic reverberations from loudspeakers. Since the performance of linear adaptive filter (AF) would…

Sound · Computer Science 2021-06-02 Lu Ma , Song Yang , Yaguang Gong , Zhongqin Wu

Machine lipreading is a special type of automatic speech recognition (ASR) which transcribes human speech by visually interpreting the movement of related face regions including lips, face, and tongue. Recently, deep neural network based…

Computer Vision and Pattern Recognition · Computer Science 2018-03-15 Kai Xu , Dawei Li , Nick Cassimatis , Xiaolong Wang

In this paper, we propose a computational efficient end-to-end training deep neural network (CEDNN) model and spatial attention maps based on difference images. Firstly, the difference image is generated by image processing. Then five…

Computer Vision and Pattern Recognition · Computer Science 2020-11-30 Jing Chen , Chenhui Wang , Kejun Wang , Meichen Liu

Deep learning has emerged as a transformative tool in healthcare, offering significant advancements in dental diagnostics by analyzing complex imaging data. This paper presents an enhanced ResNet50 architecture, integrated with the SimAM…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Shahriar Rezaie , Neda Saberitabar , Elnaz Salehi

Previous works have shown that convolutional neural networks can achieve good performance in image denoising tasks. However, limited by the local rigid convolutional operation, these methods lead to oversmoothing artifacts. A deeper network…

Image and Video Processing · Electrical Eng. & Systems 2020-07-15 Meng Chang , Qi Li , Huajun Feng , Zhihai Xu

Recognizing the feelings of human beings plays a critical role in our daily communication. Neuroscience has demonstrated that different emotion states present different degrees of activation in different brain regions, EEG frequency bands…

Signal Processing · Electrical Eng. & Systems 2021-11-09 Jiyao Liu , Yanxi Zhao , Hao Wu , Dongmei Jiang

Detecting breast lesion in videos is crucial for computer-aided diagnosis. Existing video-based breast lesion detection approaches typically perform temporal feature aggregation of deep backbone features based on the self-attention…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Chao Qin , Jiale Cao , Huazhu Fu , Rao Muhammad Anwer , Fahad Shahbaz Khan

Deep neural networks face several challenges in hyperspectral image classification, including insufficient utilization of joint spatial-spectral information, gradient vanishing with increasing depth, and overfitting. To enhance feature…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Guandong Li , Mengxia Ye

Learning the spatial topology of electroencephalogram (EEG) channels and their temporal dynamics is crucial for decoding attention states. This paper introduces EEG-PatchFormer, a transformer-based deep learning framework designed…

Signal Processing · Electrical Eng. & Systems 2025-05-20 Yi Ding , Joon Hei Lee , Shuailei Zhang , Tianze Luo , Cuntai Guan

In this paper, we propose an effective sound event detection (SED) method based on the audio spectrogram transformer (AST) model, pretrained on the large-scale AudioSet for audio tagging (AT) task, termed AST-SED. Pretrained AST models have…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-08 Kang Li , Yan Song , Li-Rong Dai , Ian McLoughlin , Xin Fang , Lin Liu

The rapid development of auditory attention decoding (AAD) based on electroencephalography (EEG) signals offers the possibility EEG-driven target speaker extraction. However, how to effectively utilize the target-speaker common information…

Sound · Computer Science 2025-10-15 Youhao Si , Yuan Liao , Qiushi Han , Yuhang Yang , Rui Dai , Liya Huang

Recognizing the sounding objects in scenes is a longstanding objective in embodied AI, with diverse applications in robotics and AR/VR/MR. To that end, Audio-Visual Segmentation (AVS), taking as condition an audio signal to identify the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 Artem Sokolov , Swapnil Bhosale , Xiatian Zhu

The electroencephalography (EEG), which is one of the easiest modes of recording brain activations in a non-invasive manner, is often distorted due to recording artifacts which adversely impacts the stimulus-response analysis. The most…

Audio and Speech Processing · Electrical Eng. & Systems 2021-11-30 Jaswanth Reddy Katthi , Sriram Ganapathy

Automated fetal head segmentation in ultrasound images is critical for accurate biometric measurements in prenatal care. While existing deep learning approaches have achieved a reasonable performance, they struggle with issues like low…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Ammar Bhilwarawala , Mainak Bandyopadhyay

The recent rapid development of auditory attention decoding (AAD) offers the possibility of using electroencephalography (EEG) as auxiliary information for target speaker extraction. However, effectively modeling long sequences of speech…

Sound · Computer Science 2025-01-06 Cunhang Fan , Youdian Gao , Zexu Pan , Jingjing Zhang , Hongyu Zhang , Jie Zhang , Zhao Lv

This paper introduces an innovative approach to Attention-deficit/hyperactivity disorder (ADHD) diagnosis by employing deep learning (DL) techniques on electroencephalography (EEG) signals. This method addresses the limitations of current…

Computers and Society · Computer Science 2024-12-04 Medha Pappula , Syed Muhammad Anwar

Eye movements can reveal valuable insights into various aspects of human mental processes, physical well-being, and actions. Recently, several datasets have been made available that simultaneously record EEG activity and eye movements. This…

Signal Processing · Electrical Eng. & Systems 2023-08-14 Nina Weng , Martyna Plomecka , Manuel Kaufmann , Ard Kastrati , Roger Wattenhofer , Nicolas Langer

The human gaze is a cost-efficient physiological data that reveals human underlying attentional patterns. The selective attention mechanism helps the cognition system focus on task-relevant visual clues by ignoring the presence of…

Computer Vision and Pattern Recognition · Computer Science 2021-12-03 Yifei Huang , Xiaoxiao Li , Lijin Yang , Lin Gu , Yingying Zhu , Hirofumi Seo , Qiuming Meng , Tatsuya Harada , Yoichi Sato

Deep convolutional neural networks (CNNs) have been applied to extracting speaker embeddings with significant success in speaker verification. Incorporating the attention mechanism has shown to be effective in improving the model…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-01 Jingyu Li , Yusheng Tian , Tan Lee