中文
相关论文

相关论文: Towards Explainable Fusion and Balanced Learning i…

200 篇论文

Multimodal sentiment analysis (MSA) is a research field that recognizes human sentiments by combining textual, visual, and audio modalities. The main challenge lies in integrating sentiment-related information from different modalities,…

多媒体 · 计算机科学 2025-12-02 Heng Xie , Kang Zhu , Zhengqi Wen , Jianhua Tao , Xuefei Liu , Ruibo Fu , Changsheng Li

Kolmogorov-Arnold Networks (KAN) has recently attracted significant attention as a promising alternative to traditional Multi-Layer Perceptrons (MLP). Despite their theoretical appeal, KAN require validation on large-scale benchmark…

机器学习 · 计算机科学 2024-09-12 Chang Dong , Liangwei Zheng , Weitong Chen

The recently proposed Kolmogorov-Arnold network (KAN) is a promising alternative to multi-layer perceptrons (MLPs) for data-driven modeling. While original KAN layers were only capable of representing the addition operator, the…

机器学习 · 计算机科学 2025-07-28 Benjamin C. Koenig , Suyong Kim , Sili Deng

Nuclear mass prediction is one of the core issues in nuclear physics research, yet it faces the challenge of small-sample datasets with high complexity. This study introduces the Kolmogorov-Arnold Network (KAN) into the refinement of…

核理论 · 物理学 2026-03-17 Yanhua Lu , Tianshuai Shang , Pengxiang Du , Jian Li , Haozhao Liang

Kolmogorov-Arnold Networks (KAN) is a groundbreaking model recently proposed by the MIT team, representing a revolutionary approach with the potential to be a game-changer in the field. This innovative concept has rapidly garnered worldwide…

机器学习 · 计算机科学 2024-06-05 Kunpeng Xu , Lifei Chen , Shengrui Wang

Effective multimodal fusion requires mechanisms that can capture complex cross-modal dependencies while remaining computationally scalable for real-world deployment. Existing audio-visual fusion approaches face a fundamental trade-off:…

多媒体 · 计算机科学 2026-02-03 Mohamed Saleh , Zahra Ahmadi

Pan-sharpening aims to generate high-resolution multispectral (HRMS) images by integrating a high-resolution panchromatic (PAN) image with its corresponding low-resolution multispectral (MS) image. To achieve effective fusion, it is crucial…

计算机视觉与模式识别 · 计算机科学 2025-12-18 Yingying Wang , Xuanhua He , Chen Wu , Jialing Huang , Suiyun Zhang , Rui Liu , Xinghao Ding , Haoxuan Che

Despite their strong performance in multimodal emotion reasoning, existing Multimodal Large Language Models (MLLMs) often overlook the scenarios involving emotion conflicts, where emotional cues from different modalities are inconsistent.…

人工智能 · 计算机科学 2025-10-14 Zhiyuan Han , Beier Zhu , Yanlong Xu , Peipei Song , Xun Yang

In the era of large-scale pre-trained models, effectively adapting general knowledge to specific affective computing tasks remains a challenge, particularly regarding computational efficiency and multimodal heterogeneity. While…

人工智能 · 计算机科学 2026-03-20 Yan Li , Yifei Xing , Xiangyuan Lan , Xin Li , Haifeng Chen , Dongmei Jiang

Advances in computer vision and deep learning have blurred the line between deepfakes and authentic media, undermining multimedia credibility through audio-visual forgery. Current multimodal detection methods remain limited by unbalanced…

计算机视觉与模式识别 · 计算机科学 2025-05-20 Zihan Xiong , Xiaohua Wu , Lei Chen , Fangqi Lou

Time series classification is a relevant step supporting decision-making processes in various domains, and deep neural models have shown promising performance in this respect. Despite significant advancements in deep learning, the…

机器学习 · 计算机科学 2025-11-04 Irina Barašin , Blaž Bertalanič , Mihael Mohorčič , Carolina Fortuna

Multimodal learning mimics the reasoning process of the human multi-sensory system, which is used to perceive the surrounding world. While making a prediction, the human brain tends to relate crucial cues from multiple sources of…

计算机视觉与模式识别 · 计算机科学 2021-06-29 Lang Su , Chuqing Hu , Guofa Li , Dongpu Cao

Multimodal sarcasm detection is a complex task that requires distinguishing subtle complementary signals across modalities while filtering out irrelevant information. Many advanced methods rely on learning shortcuts from datasets rather…

机器学习 · 计算机科学 2025-11-18 Yihua Wang , Qi Jia , Cong Xu , Feiyu Chen , Yuhan Liu , Haotian Zhang , Liang Jin , Lu Liu , Zhichun Wang

Multimodal learning faces two major challenges: modality imbalance and data noise, which significantly affect the robustness and generalization ability of models. Existing methods achieve modality balance by suppressing dominant modalities,…

多媒体 · 计算机科学 2025-11-17 Zijing Xu , Yunfeng Kou , Kunming Wu , Hong Liu

Multimodal Sentiment Analysis (MSA) seeks to understand human emotions by jointly analyzing data from multiple modalities typically text and images offering a richer and more accurate interpretation than unimodal approaches. In this paper,…

机器学习 · 计算机科学 2025-10-29 Phuong Q. Dao , Mark Roantree , Vuong M. Ngo

Characterising the heterogeneous presentation of Parkinson's disease (PD) requires integrating biological and clinical markers within a unified predictive framework. While multimodal data provide complementary information, many existing…

机器学习 · 计算机科学 2026-01-05 Dristi Datta , Tanmoy Debnath , Minh Chau , Manoranjan Paul , Gourab Adhikary , Md Geaur Rahman

The Kolmogorov-Arnold Network (KAN) is a new network architecture known for its high accuracy in several tasks such as function fitting and PDE solving. The superior expressive capability of KAN arises from the Kolmogorov-Arnold…

机器学习 · 计算机科学 2024-12-19 Ruichen Qiu , Yibo Miao , Shiwen Wang , Lijia Yu , Yifan Zhu , Xiao-Shan Gao

Multimodal sentiment analysis (MSA) leverages heterogeneous data sources to interpret the complex nature of human sentiments. Despite significant progress in multimodal architecture design, the field lacks comprehensive regularization…

计算与语言 · 计算机科学 2023-12-20 Efthymios Georgiou , Yannis Avrithis , Alexandros Potamianos

Machine learning has recently been widely adopted to address the managerial decision making problems, in which the decision maker needs to be able to interpret the contributions of individual attributes in an explicit form. However, there…

机器学习 · 计算机科学 2019-10-28 Mengzhuo Guo , Qingpeng Zhang , Xiuwu Liao , Frank Youhua Chen , Daniel Dajun Zeng

Attention is typically used to select informative sub-phrases that are used for prediction. This paper investigates the novel use of attention as a form of feature augmentation, i.e, casted attention. We propose Multi-Cast Attention…

计算与语言 · 计算机科学 2018-06-05 Yi Tay , Luu Anh Tuan , Siu Cheung Hui