English
Related papers

Related papers: Attention Is Not Always the Answer: Optimizing Voi…

200 papers

Facial expression recognition (FER) in the wild is a challenging task affected by the image quality and has attracted broad interest in computer vision. There is no research using feature fusion and ensemble strategy for FER simultaneously.…

Computer Vision and Pattern Recognition · Computer Science 2024-11-22 Guangyao Zhou , Yuanlun Xie , Yiqin Fu , Zhaokun Wang

Model fusion is a key strategy for robust recognition in unconstrained scenarios, as different models provide complementary strengths. This is especially important for whole-body human recognition, where biometric cues such as face, gait,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Jie Zhu , Xiao Guo , Yiyang Su , Anil Jain , Xiaoming Liu

Recently, weakly supervised video anomaly detection (WS-VAD) has emerged as a contemporary research direction to identify anomaly events like violence and nudity in videos using only video-level labels. However, this task has substantial…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Ayush Ghadiya , Purbayan Kar , Vishal Chudasama , Pankaj Wasnik

Speech activity detection (SAD) plays an important role in current speech processing systems, including automatic speech recognition (ASR). SAD is particularly difficult in environments with acoustic noise. A practical solution is to…

Computation and Language · Computer Science 2023-05-15 Fei Tao , Carlos Busso

Early and accurate interpretation of screening mammograms is essential for effective breast cancer detection, yet it remains a complex challenge due to subtle imaging findings and diagnostic ambiguity. Many existing AI approaches fall short…

Image and Video Processing · Electrical Eng. & Systems 2025-07-24 Yalda Zafari , Roaa Elalfy , Mohamed Mabrok , Somaya Al-Maadeed , Tamer Khattab , Essam A. Rashed

Facial Expression Recognition (FER) is a critical task within computer vision with diverse applications across various domains. Addressing the challenge of limited FER datasets, which hampers the generalization capability of expression…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Bach Nguyen-Xuan , Thien Nguyen-Hoang , Thanh-Huy Nguyen , Nhu Tai-Do

Traditional sentiment analysis has long been a unimodal task, relying solely on text. This approach overlooks non-verbal cues such as vocal tone and prosody that are essential for capturing true emotional intent. We introduce Dynamic…

Computation and Language · Computer Science 2025-09-30 Sadia Abdulhalim , Muaz Albaghdadi , Moshiur Farazi

Recent advancements in multimodal fusion have witnessed the remarkable success of vision-language (VL) models, which excel in various multimodal applications such as image captioning and visual question answering. However, building VL…

Computer Vision and Pattern Recognition · Computer Science 2024-10-24 Zhiwei Hao , Jianyuan Guo , Li Shen , Yong Luo , Han Hu , Yonggang Wen

Event classification is inherently sequential and multimodal. Therefore, deep neural models need to dynamically focus on the most relevant time window and/or modality of a video. In this study, we propose the Multi-level Attention Fusion…

Computer Vision and Pattern Recognition · Computer Science 2021-06-15 Mathilde Brousmiche , Jean Rouat , Stéphane Dupont

Few-shot object detection (FSOD) aims at learning a detector that can fast adapt to previously unseen objects with scarce annotated examples, which is challenging and demanding. Existing methods solve this problem by performing subtasks of…

Computer Vision and Pattern Recognition · Computer Science 2021-04-20 Longyao Liu , Bo Ma , Yulin Zhang , Xin Yi , Haozhi Li

Voice Activity Detection (VAD) in the presence of background noise remains a challenging problem in speech processing. Accurate VAD is essential in automatic speech recognition, voice-to-text, conversational agents, etc, where noise can…

Audio and Speech Processing · Electrical Eng. & Systems 2025-07-31 Hamed Jafarzadeh Asl , Mahsa Ghazvini Nejad , Amin Edraki , Masoud Asgharian , Vahid Partovi Nia

We study the problem of learning association between face and voice, which is gaining interest in the computer vision community lately. Prior works adopt pairwise or triplet loss formulations to learn an embedding space amenable for…

Computer Vision and Pattern Recognition · Computer Science 2021-12-21 Muhammad Saad Saeed , Muhammad Haris Khan , Shah Nawaz , Muhammad Haroon Yousaf , Alessio Del Bue

Many existing speaker verification systems are reported to be vulnerable against different spoofing attacks, for example speaker-adapted speech synthesis, voice conversion, play back, etc. In order to detect these spoofed speech signals as…

Sound · Computer Science 2015-07-30 Shitao Weng , Shushan Chen , Lei Yu , Xuewei Wu , Weicheng Cai , Zhi Liu , Ming Li

Feature fusion modules from encoder and self-attention module have been adopted in semantic segmentation. However, the computation of these modules is costly and has operational limitations in real-time environments. In addition,…

Computer Vision and Pattern Recognition · Computer Science 2022-10-05 Jaehyun Park , Subin Lee , Eon Kim , Byeongjun Moon , Dabeen Yu , Yeonseung Yu , Junghwan Kim

LIDAR point clouds and RGB-images are both extremely essential for 3D object detection. So many state-of-the-art 3D detection algorithms dedicate in fusing these two types of data effectively. However, their fusion methods based on Birds…

Computer Vision and Pattern Recognition · Computer Science 2019-12-03 Liang Xie , Chao Xiang , Zhengxu Yu , Guodong Xu , Zheng Yang , Deng Cai , Xiaofei He

Overlapped speech detection (OSD) is critical for speech applications in scenario of multi-party conversion. Despite numerous research efforts and progresses, comparing with speech activity detection (VAD), OSD remains an open challenge and…

Sound · Computer Science 2022-09-27 Ziqing Du , Kai Liu , Xucheng Wan , Huan Zhou

In recent years, End-to-End speech recognition technology based on deep learning has developed rapidly. Due to the lack of Turkish speech data, the performance of Turkish speech recognition system is poor. Firstly, this paper studies a…

Sound · Computer Science 2023-03-23 Zeyu Ren , Nurmement Yolwas , Huiru Wang , Wushour Slamu

The objective of this work is to investigate complementary features which can aid the quintessential Mel frequency cepstral coefficients (MFCCs) in the task of closed, limited set word recognition for non-native English speakers of…

Sound · Computer Science 2022-06-16 Pierre Berjon , Rajib Sharma , Avishek Nag , Soumyabrata Dev

Deep convolutional neural networks (CNNs) have been applied to extracting speaker embeddings with significant success in speaker verification. Incorporating the attention mechanism has shown to be effective in improving the model…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-01 Jingyu Li , Yusheng Tian , Tan Lee

Speech activity detection (SAD) is an essential component for a variety of speech processing applications. It has been observed that performances of various speech based tasks are very much dependent on the efficiency of the SAD. In this…

Multimedia · Computer Science 2012-10-09 Md. Sahidullah , Goutam Saha