English
Related papers

Related papers: Music theme recognition using CNN and self-attenti…

200 papers

While the Self-Attention mechanism in the Transformer model has proven to be effective in many domains, we observe that it is less effective in more diverse settings (e.g. multimodality) due to the varying granularity of each token and the…

Computer Vision and Pattern Recognition · Computer Science 2024-06-06 Wayner Barrios , SouYoung Jin

This study presents a novel Multi-Modal Graph Neural Network (MM-GNN) framework for socially aware music recommendation, designed to enhance personalization and foster community-based engagement. The proposed model introduces a fusion-free…

Information Retrieval · Computer Science 2025-11-11 Kajwan Ziaoddini

Social tags inherent in online music services such as Last.fm provide a rich source of information on musical moods. The abundance of social tags makes this data highly beneficial for developing techniques to manage and retrieve mood…

Multimedia · Computer Science 2013-08-09 Pasi Saari , Tuomas Eerola

While emotion and mood interchangeably used, they differ in terms of duration, intensity and attributes. Even as multiple psychology studies examine the mood-emotion relationship, mood prediction has barely been studied. Recent machine…

Human-Computer Interaction · Computer Science 2023-03-14 Soujanya Narayana , Ramanathan Subramanian , Ibrahim Radwan , Roland Goecke

We propose an end-to-end-trainable attention module for convolutional neural network (CNN) architectures built for image classification. The module takes as input the 2D feature vector maps which form the intermediate representations of the…

Computer Vision and Pattern Recognition · Computer Science 2018-05-01 Saumya Jetley , Nicholas A. Lord , Namhoon Lee , Philip H. S. Torr

Nowadays, listening music has been and will always be an indispensable part of our daily life. In recent years, sentiment analysis of music has been widely used in the information retrieval systems, personalized recommendation systems and…

Computation and Language · Computer Science 2019-06-18 Jie Wang , Yilin Yang

Analysing music in the field of machine learning is a very difficult problem with numerous constraints to consider. The nature of audio data, with its very high dimensionality and widely varying scales of structure, is one of the primary…

Sound · Computer Science 2022-05-17 Tracy Qian , Jackson Kaunismaa , Tony Chung

In this work, we present a novel method for music emotion recognition that leverages Large Language Model (LLM) embeddings for label alignment across multiple datasets and zero-shot prediction on novel categories. First, we compute LLM…

Sound · Computer Science 2024-10-18 Renhang Liu , Abhinaba Roy , Dorien Herremans

Emotion recognition has become an important research topic in the field of human-computer interaction. Studies on sound and videos to understand emotions focused mainly on analyzing facial expressions and classified 6 basic emotions. In…

Machine Learning · Computer Science 2023-06-23 Ege Kesim , Selahattin Serdar Helli , Sena Nur Cavsak

Emotion recognition is a critical aspect of human interaction. This topic garnered significant attention in the field of artificial intelligence. In this study, we investigate the performance of convolutional neural network (CNN) and…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Samay Nathani

Recently, substantial research effort has focused on how to apply CNNs or RNNs to better extract temporal patterns from videos, so as to improve the accuracy of video classification. In this paper, however, we show that temporal…

Computer Vision and Pattern Recognition · Computer Science 2017-11-28 Xiang Long , Chuang Gan , Gerard de Melo , Jiajun Wu , Xiao Liu , Shilei Wen

Automatic modulation classification (AMC) is an essential technique for noncooperative spectrum monitoring and intelligent wireless receivers. However, practical AMC models must identify modulation formats from short and noisy I/Q…

Signal Processing · Electrical Eng. & Systems 2026-05-26 Ruixiang Zhang , Zinan Zhou , Yezhuo Zhang , Guangyu Li , Xuanpeng Li

Mental stress has become a pervasive factor affecting cognitive health and overall well-being, necessitating the development of robust, non-invasive diagnostic tools. Electroencephalogram (EEG) signals provide a direct window into neural…

Signal Processing · Electrical Eng. & Systems 2025-06-16 Md Mynoddin , Troyee Dev , Rishita Chakma

Recently, self-supervised pre-training has shown significant improvements in many areas of machine learning, including speech and NLP. We propose using large self-supervised pre-trained models for both audio and text modality with…

Audio and Speech Processing · Electrical Eng. & Systems 2021-08-24 Krishna D N

Modulation classification is an essential step of signal processing and has been regularly applied in the field of tele-communication. Since variations of frequency with respect to time remains a vital distinction among radio signals having…

Signal Processing · Electrical Eng. & Systems 2023-06-09 Muhammad Waqas , Muhammad Ashraf , Muhammad Zakwan

We consider the design of two-pass voice trigger detection systems. We focus on the networks in the second pass that are used to re-score candidate segments obtained from the first-pass. Our baseline is an acoustic model(AM), with BiLSTM…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-07 Saurabh Adya , Vineet Garg , Siddharth Sigtia , Pramod Simha , Chandra Dhir

This paper explores the application of Convolutional Neural Networks CNNs for classifying emotions in speech through Mel Spectrogram representations of audio files. Traditional methods such as Gaussian Mixture Models and Hidden Markov…

Sound · Computer Science 2025-03-26 Niketa Penumajji

Dynamic Text-Attributed Graphs (DyTAGs) are a novel graph paradigm that captures evolving temporal events (edges) alongside rich textual attributes. Existing studies can be broadly categorized into TGNN-driven and LLM-driven approaches,…

Machine Learning · Computer Science 2025-08-04 Yuanyuan Xu , Wenjie Zhang , Ying Zhang , Xuemin Lin , Xiwei Xu

Multimodal sentiment analysis has attracted increasing attention with broad application prospects. The existing methods focuses on single modality, which fails to capture the social media content for multiple modalities. Moreover, in…

Multimedia · Computer Science 2022-05-11 Ashima Yadav , Dinesh Kumar Vishwakarma

Efficiency is an important issue in designing video architectures for action recognition. 3D CNNs have witnessed remarkable progress in action recognition from videos. However, compared with their 2D counterparts, 3D convolutions often…

Computer Vision and Pattern Recognition · Computer Science 2019-11-22 Zhaoyang Liu , Donghao Luo , Yabiao Wang , Limin Wang , Ying Tai , Chengjie Wang , Jilin Li , Feiyue Huang , Tong Lu