中文
相关论文

相关论文: Towards Explainable Fusion and Balanced Learning i…

200 篇论文

3D medical image segmentation is important for clinical diagnosis and treatment but faces challenges from high-dimensional data and complex spatial dependencies. Traditional single-modality networks, such as CNNs and Transformers, are often…

计算机视觉与模式识别 · 计算机科学 2025-11-26 Haoyu Yang , Yutong Guan , Meixing Shi , Yuxiang Cai , Jintao Chen , Sun Bing , Wenhui Lei , Mianxin Liu , Xiaoming Shi , Yankai Jiang , Jianwei Yin

Multi-modal fusion holds great promise for integrating information from different modalities. However, due to a lack of consideration for modal consistency, existing multi-modal fusion methods in the field of remote sensing still face…

计算机视觉与模式识别 · 计算机科学 2025-03-11 Mingxiang Cao , Weiying Xie , Xin Zhang , Jiaqing Zhang , Kai Jiang , Jie Lei , Yunsong Li

Depression is a prevalent mental health disorder that severely impairs daily functioning and quality of life. While recent deep learning approaches for depression detection have shown promise, most rely on limited feature types, overlook…

计算机视觉与模式识别 · 计算机科学 2026-02-10 Bowen Zhou , Marc-André Fiedler , Ayoub Al-Hamadi

Truly real-life data presents a strong, but exciting challenge for sentiment and emotion research. The high variety of possible `in-the-wild' properties makes large datasets such as these indispensable with respect to building robust…

多媒体 · 计算机科学 2021-10-22 Lukas Stappen , Alice Baird , Lea Schumann , Björn Schuller

Multimodal Sentiment Analysis (MSA) with missing modalities has attracted increasing attention recently. While current Transformer-based methods leverage dense text information to maintain model robustness, their quadratic complexity…

多媒体 · 计算机科学 2026-01-12 Xiang Li , Xianfu Cheng , Dezhuang Miao , Xiaoming Zhang , Zhoujun Li

Kolmogorov-Arnold Networks (KANs) have recently gained attention as an alternative to traditional Multilayer Perceptrons (MLPs) in deep learning frameworks. KANs have been integrated into various deep learning architectures such as…

计算机视觉与模式识别 · 计算机科学 2025-06-13 Ali Kashefi

Multimodal sentiment analysis (MSA) is a fundamental complex research problem due to the heterogeneity gap between different modalities and the ambiguity of human emotional expression. Although there have been many successful attempts to…

机器学习 · 计算机科学 2022-07-05 Jiahao Zheng , Sen Zhang , Xiaoping Wang , Zhigang Zeng

Inspired by the fact that different modalities in videos carry complementary information, we propose a Multimodal Semantic Attention Network(MSAN), which is a new encoder-decoder framework incorporating multimodal semantic attributes for…

计算机视觉与模式识别 · 计算机科学 2019-05-09 Liang Sun , Bing Li , Chunfeng Yuan , Zhengjun Zha , Weiming Hu

Mortgage risk assessment traditionally relies on structured financial data, which is often proprietary, confidential, and costly. In this study, we propose a novel multimodal deep learning framework that uses cost-free, publicly available,…

计算工程、金融与科学 · 计算机科学 2025-10-28 Mahsa Tavakoli , Rohitash Chandra , Cristian Bravo

With the advancement of artificial intelligence and computer vision technologies, multimodal emotion recognition has become a prominent research topic. However, existing methods face challenges such as heterogeneous data fusion and the…

计算机视觉与模式识别 · 计算机科学 2025-02-13 Wei Dai , Dequan Zheng , Feng Yu , Yanrong Zhang , Yaohui Hou

While multimodal fusion has been extensively studied in Multimodal Sentiment Analysis (MSA), the role of fusion depth and multimodal capacity allocation remains underexplored. In this work, we position fusion depth, scalability, and…

计算与语言 · 计算机科学 2025-04-16 Efthymios Georgiou , Vassilis Katsouros , Yannis Avrithis , Alexandros Potamianos

Multimodal semantic segmentation integrates complementary information from diverse sensors for remote sensing Earth observation. However, practical systems often encounter missing modalities due to sensor failures or incomplete coverage,…

计算机视觉与模式识别 · 计算机科学 2026-03-04 Lekang Wen , Liang Liao , Jing Xiao , Mi Wang

Multimodal Sentiment Analysis (MSA) aims to predict sentiment from language, acoustic, and visual data in videos. However, imbalanced unimodal performance often leads to suboptimal fused representations. Existing approaches typically adopt…

计算机视觉与模式识别 · 计算机科学 2026-04-02 Dingkang Yang , Mingcheng Li , Xuecheng Wu , Zhaoyu Chen , Kaixun Jiang , Keliang Liu , Peng Zhai , Lihua Zhang

Neural network (NN)-based transistor compact modeling has recently emerged as a transformative solution for accelerating device modeling and SPICE circuit simulations. However, conventional NN architectures, despite their widespread…

机器学习 · 计算机科学 2025-03-20 Rodion Novkin , Hussam Amrouch

In this paper, we introduce an Adaptive Graph Signal Processing with Dynamic Semantic Alignment (AGSP DSA) framework to perform robust multimodal data fusion over heterogeneous sources, including text, audio, and images. The requested…

计算机视觉与模式识别 · 计算机科学 2026-01-27 KV Karthikeya , Ashok Kumar Das , Shantanu Pal , Vivekananda Bhat K , Arun Sekar Rajasekaran

Multimodal video sentiment analysis aims to integrate multiple modal information to analyze the opinions and attitudes of speakers. Most previous work focuses on exploring the semantic interactions of intra- and inter-modality. However,…

计算机视觉与模式识别 · 计算机科学 2024-04-16 Zhuyang Xie , Yan Yang , Jie Wang , Xiaorong Liu , Xiaofan Li

Complex dynamical systems governed by holomorphic maps such as $z^2 + c$ exhibit fractal boundaries with extreme sensitivity to initial conditions. Accurately modelling these structures from data requires methods that respect the underlying…

机器学习 · 计算机科学 2026-05-22 Bhaskar Ranjan Karn , Dinesh Kumar

Multimodal aspect-based sentiment analysis (MABSA) aims to understand opinions in a granular manner, advancing human-computer interaction and other fields. Traditionally, MABSA methods use a joint prediction approach to identify aspects and…

计算与语言 · 计算机科学 2024-06-14 Shezheng Song , Shasha Li , Shan Zhao , Chengyu Wang , Xiaopeng Li , Jie Yu , Qian Wan , Jun Ma , Tianwei Yan , Wentao Ma , Xiaoguang Mao

Multimodal sarcasm detection (MSD) aims to identify sarcastic intent from semantic incongruity between text and image. Although recent methods have improved MSD through cross-modal interaction and incongruity reasoning, most still treat…

计算机视觉与模式识别 · 计算机科学 2026-05-05 Zhenyu Wang , Weichen Cheng , Weijia Li , Junjie Mou , Zongyou Zhao , Guoying Zhang

In this paper, we introduce Wav-KAN, an innovative neural network architecture that leverages the Wavelet Kolmogorov-Arnold Networks (Wav-KAN) framework to enhance interpretability and performance. Traditional multilayer perceptrons (MLPs)…

机器学习 · 计算机科学 2024-05-28 Zavareh Bozorgasl , Hao Chen