English
Related papers

Related papers: Spatiotemporal Emotion Recognition using Deep CNN …

200 papers

We propose an audio-visual spatial-temporal deep neural network with: (1) a visual block containing a pretrained 2D-CNN followed by a temporal convolutional network (TCN); (2) an aural block containing several parallel TCNs; and (3) a…

Computer Vision and Pattern Recognition · Computer Science 2021-08-18 Su Zhang , Yi Ding , Ziquan Wei , Cuntai Guan

Convolutional neural networks (CNN) have been frequently used to extract subject-invariant features from electroencephalogram (EEG) for classification tasks. This approach holds the underlying assumption that electrodes are equidistant…

Machine Learning · Computer Science 2021-06-18 Andac Demir , Toshiaki Koike-Akino , Ye Wang , Masaki Haruna , Deniz Erdogmus

Scene recognition is currently one of the top-challenging research fields in computer vision. This may be due to the ambiguity between classes: images of several scene classes may share similar objects, which causes confusion among them.…

Computer Vision and Pattern Recognition · Computer Science 2020-02-28 Alejandro López-Cifuentes , Marcos Escudero-Viñolo , Jesús Bescós , Álvaro García-Martín

Speech Emotion Recognition is a crucial area of research in human-computer interaction. While significant work has been done in this field, many state-of-the-art networks struggle to accurately recognize emotions in speech when the data is…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-23 Rashedul Hasan , Meher Nigar , Nursadul Mamun , Sayan Paul

Structural Health Monitoring (SHM) is vital for evaluating structural condition, aiming to detect damage through sensor data analysis. It aligns with predictive maintenance in modern industry, minimizing downtime and costs by addressing…

Machine Learning · Computer Science 2023-11-10 Ishan Pathak , Ishan Jha , Aditya Sadana , Basuraj Bhowmik

Real-time EEG-based Emotion Recognition (EEG-ER) with consumer-grade EEG devices involves classification of emotions using a reduced number of channels. These devices typically provide only four or five channels, unlike the high number of…

Machine Learning · Computer Science 2021-11-15 Josef Bajada , Francesco Borg Bonello

In order to develop more precise and functional affective applications, it is necessary to achieve a balance between the psychology and the engineering applied to emotions. Signals from the central and peripheral nervous systems have been…

Human-Computer Interaction · Computer Science 2019-05-02 Jennifer Sorinas , Jose Manuel Ferrández , Eduardo Fernandez

Emotion recognition in user-generated videos plays an important role in human-centered computing. Existing methods mainly employ traditional two-stage shallow pipeline, i.e. extracting visual and/or audio features and training classifiers.…

Computer Vision and Pattern Recognition · Computer Science 2020-03-03 Sicheng Zhao , Yunsheng Ma , Yang Gu , Jufeng Yang , Tengfei Xing , Pengfei Xu , Runbo Hu , Hua Chai , Kurt Keutzer

There is increasing interest in using deep learning approach for EEG analysis as there are still rooms for the improvement of EEG analysis in its accuracy. Convolutional long short-term (CNNLSTM) has been successfully applied in time series…

Signal Processing · Electrical Eng. & Systems 2019-12-20 Lingling Yang , Leanne Lai Hang Chan , Yao Lu

In this paper we report results for recognizing colorectal NBI endoscopic images by using features extracted from convolutional neural network (CNN). In this comparative study, we extract features from different layers from different CNN…

Computer Vision and Pattern Recognition · Computer Science 2016-08-25 Toru Tamaki , Shoji Sonoyama , Tsubasa Hirakawa , Bisser Raytchev , Kazufumi Kaneda , Tetsushi Koide , Shigeto Yoshida , Hiroshi Mieno , Shinji Tanaka

Human brain performs remarkably well in segregating a particular speaker from interfering ones in a multi-speaker scenario. It has been recently shown that we can quantitatively evaluate the segregation capability by modelling the…

Sound · Computer Science 2021-07-12 Ivine Kuruvila , Jan Muncke , Eghart Fischer , Ulrich Hoppe

Automatic classification of electrocardiogram (ECG) signals plays a crucial role in the early prevention and diagnosis of cardiovascular diseases. While ECG signals can be used for the diagnosis of various diseases, their pathological…

Signal Processing · Electrical Eng. & Systems 2023-06-22 Renjie Cheng , Zhemin Zhuang , Shuxin Zhuang , Lei Xie , Jingfeng Guo

Recent behavioral and electroencephalograph (EEG) studies have defined ways that auditory spatial attention can be allocated over large regions of space. As with most experimental studies, behavior EEG was averaged over 10s of minutes…

Signal Processing · Electrical Eng. & Systems 2019-05-07 Zhentao Liu , Jeffrey Mock , Yufei Huang , Edward Golob

Mental fatigue increases the risk of operator error in language comprehension tasks. In order to prevent operator performance degradation, we used EEG signals to assess the mental fatigue of operators in human-computer systems. This study…

Artificial Intelligence · Computer Science 2021-04-20 Chunhua Ye , Zhong Yin , Chenxi Wu , Xiayidai Abulaiti , Yixing Zhang , Zhenqi Sun , Jianhua Zhang

One of the challenges in modeling cognitive events from electroencephalogram (EEG) data is finding representations that are invariant to inter- and intra-subject differences, as well as to inherent noise associated with such data. Herein,…

Machine Learning · Computer Science 2016-03-02 Pouya Bashivan , Irina Rish , Mohammed Yeasin , Noel Codella

Multivariant time series (MTS) data are usually incomplete in real scenarios, and imputing the incomplete MTS is practically important to facilitate various time series mining tasks. Recently, diffusion model-based MTS imputation methods…

Machine Learning · Computer Science 2024-05-24 S. Zhang , S. Wang , H. Miao , H. Chen , C. Fan , J. Zhang

Emotion recognition (ER) from speech signals is a robust approach since it cannot be imitated like facial expression or text based sentiment analysis. Valuable information underlying the emotions are significant for human-computer…

Sound · Computer Science 2023-12-19 David Hason Rudd , Huan Huo , Guandong Xu

This paper proposes a speech-based method for automatic depression classification. The system is based on ensemble learning for Convolutional Neural Networks (CNNs) and is evaluated using the data and the experimental protocol provided in…

Audio and Speech Processing · Electrical Eng. & Systems 2024-02-06 Adrián Vázquez-Romero , Ascensión Gallardo-Antolín

Facial expression recognition in videos is an active area of research in computer vision. However, fake facial expressions are difficult to be recognized even by humans. On the other hand, facial micro-expressions generally represent the…

Computer Vision and Pattern Recognition · Computer Science 2019-04-03 Sai Prasanna Teja Reddy , Surya Teja Karri , Shiv Ram Dubey , Snehasis Mukherjee

Mind wandering (MW) is a ubiquitous phenomenon which reflects a shift in attention from task-related to task-unrelated thoughts. There is a need for intelligent interfaces that can reorient attention when MW is detected due to its…

Machine Learning · Computer Science 2019-02-06 Seyedroohollah Hosseini , Xuan Guo