English
Related papers

Related papers: Dynamic Graph Neural ODE Network for Multi-modal E…

200 papers

Dynamic graphs capture evolving interactions between entities, such as in social networks, online learning platforms, and crowdsourcing projects. For dynamic graph modeling, dynamic graph neural networks (DGNNs) have emerged as a mainstream…

Machine Learning · Computer Science 2025-03-04 Xingtong Yu , Zhenghao Liu , Xinming Zhang , Yuan Fang

Multimodal Emotion Recognition (MER) aims to accurately identify human emotional states by integrating heterogeneous modalities such as visual, auditory, and textual data. Existing approaches predominantly rely on unified emotion labels to…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Wen Yin , Siyu Zhan , Cencen Liu , Xin Hu , Guiduo Duan , Xiurui Xie , Yuan-Fang Li , Tao He

Human beings have rich ways of emotional expressions, including facial action, voice, and natural languages. Due to the diversity and complexity of different individuals, the emotions expressed by various modalities may be semantically…

Artificial Intelligence · Computer Science 2023-02-06 Chuan Zhang , Daoxin Zhang , Ruixiu Zhang , Jiawei Li , Jianke Zhu

This paper addresses the problem of automatic emotion recognition in the scope of the One-Minute Gradual-Emotional Behavior challenge (OMG-Emotion challenge). The underlying objective of the challenge is the automatic estimation of emotion…

Artificial Intelligence · Computer Science 2018-05-04 Pedro M. Ferreira , Diogo Pernes , Kelwin Fernandes , Ana Rebelo , Jaime S. Cardoso

Graph neural networks (GNNs) are gaining popularity for processing graph-structured data. In real-world scenarios, graph data within the same dataset can vary significantly in scale. This variability leads to depth-sensitivity, where the…

Machine Learning · Computer Science 2024-11-06 Zelin Yao , Chuang Liu , Xianke Meng , Yibing Zhan , Jia Wu , Shirui Pan , Wenbin Hu

While online advertising is highly dependent on implicit interaction networks of anonymous users for engagement inference, and for the selection and optimization of delivery strategies, existing graph models seldom can capture the…

Information Retrieval · Computer Science 2025-06-18 Yanjun Dai , Haoyang Feng , Yuan Gao

Over the past few years, deep learning methods have shown remarkable results in many face-related tasks including automatic facial expression recognition (FER) in-the-wild. Meanwhile, numerous models describing the human emotional states…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Panagiotis Antoniadis , Panagiotis P. Filntisis , Petros Maragos

Many irregular domains such as social networks, financial transactions, neuron connections, and natural language constructs are represented using graph structures. In recent years, a variety of graph neural networks (GNNs) have been…

Machine Learning · Computer Science 2021-05-03 Osman Asif Malik , Shashanka Ubaru , Lior Horesh , Misha E. Kilmer , Haim Avron

In this study, we focus on automated approaches to detect depression from clinical interviews using multi-modal machine learning (ML). Our approach differentiates from other successful ML methods such as context-aware analysis through…

Machine Learning · Computer Science 2024-12-30 Genevieve Lam , Huang Dongyan , Weisi Lin

Accurate temporal segmentation of human actions is critical for intelligent robots in collaborative settings, where a precise understanding of sub-activity labels and their temporal structure is essential. However, the inherent noise in…

Computer Vision and Pattern Recognition · Computer Science 2025-12-12 Hao Xing , Kai Zhe Boey , Yuankai Wu , Darius Burschka , Gordon Cheng

Intelligent monitoring systems and affective computing applications have emerged in recent years to enhance healthcare. Examples of these applications include assessment of affective states such as Major Depressive Disorder (MDD). MDD…

Human-Computer Interaction · Computer Science 2020-11-19 Alice Othmani , Daoud Kadoch , Kamil Bentounes , Emna Rejaibi , Romain Alfred , Abdenour Hadid

Multimodal emotion recognition aims to integrate text, audio, and video sources to understand human affective states. Although multimodal large language models excel at multimodal reasoning, they typically treat emotion categories as…

Machine Learning · Computer Science 2026-05-20 Zeheng Wang , Bo Zhao , Yijie Zhu , Zhishu Liu , Hui Ma , Ruixin Zhang , Shouhong Ding , Qianyu Xie , Zitong Yu

Multimodal Emotion Recognition in Conversation (MERC) aims to enhance emotion understanding by integrating complementary cues from text, audio, and visual modalities. Existing MERC approaches predominantly focus on cross-modal shared…

Multimedia · Computer Science 2025-12-16 Xinyi Che , Wenbo Wang , Yuanbo Hou , Mingjie Xie , Qijun Zhao , Jian Guan

We present an innovative framework for traffic dynamics analysis using High-Order Evolving Graphs, designed to improve spatio-temporal representations in autonomous driving contexts. Our approach constructs temporal bidirectional bipartite…

Computer Vision and Pattern Recognition · Computer Science 2024-09-19 Aditya Humnabadkar , Arindam Sikdar , Benjamin Cave , Huaizhong Zhang , Paul Bakaki , Ardhendu Behera

Music emotion recognition (MER) is usually regarded as a multi-label tagging task, and each segment of music can inspire specific emotion tags. Most researchers extract acoustic features from music and explore the relations between these…

Multimedia · Computer Science 2017-04-20 Xin Liu , Qingcai Chen , Xiangping Wu , Yan Liu , Yang Liu

Dynamic graph learning (DGL) aims to learn informative and temporally-evolving node embeddings to support downstream tasks such as link prediction. A fundamental challenge in DGL lies in effectively modeling both the temporal dynamics and…

Social and Information Networks · Computer Science 2025-06-10 Ling Wang

Humans express their opinions and emotions through multiple modalities which mainly consist of textual, acoustic and visual modalities. Prior works on multimodal sentiment analysis mostly apply Recurrent Neural Network (RNN) to model…

Computation and Language · Computer Science 2021-08-18 Jianfeng Wu , Sijie Mai , Haifeng Hu

The analysis of events in dynamic environments poses a fundamental challenge in the development of intelligent agents and robots capable of interacting with humans. Current approaches predominantly utilize visual models. However, these…

Computer Vision and Pattern Recognition · Computer Science 2025-05-07 Sergey Linok , Vadim Semenov , Anastasia Trunova , Oleg Bulichev , Dmitry Yudin

Emotion recognition has a pivotal role in affective computing and in human-computer interaction. The current technological developments lead to increased possibilities of collecting data about the emotional state of a person. In general,…

Computer Vision and Pattern Recognition · Computer Science 2020-07-10 Andreea Birhala , Catalin Nicolae Ristea , Anamaria Radoi , Liviu Cristian Dutu

Graph neural networks (GNNs) continue to achieve state-of-the-art performance on many graph learning tasks, but rely on the assumption that a given graph is a sufficient approximation of the true neighborhood structure. When a system…

Machine Learning · Computer Science 2023-02-08 Steven J. Krieg , William C. Burgis , Patrick M. Soga , Nitesh V. Chawla