中文
相关论文

相关论文: Exploring Fusion Techniques in Multimodal AI-Based…

200 篇论文

Visual language models (VLMs) have shown remarkable capabilities in multimodal tasks but face challenges in maintaining fairness across demographic groups, particularly when deployed in federated learning (FL) environments. This paper…

计算机视觉与模式识别 · 计算机科学 2025-05-06 Chaomeng Chen , Zitong Yu , Junhao Dong , Sen Su , Linlin Shen , Shutao Xia , Xiaochun Cao

Knowing which factors are significant in credit rating assignment leads to better decision-making. However, the focus of the literature thus far has been mostly on structured data, and fewer studies have addressed unstructured or…

综合金融 · 定量金融 2025-02-17 Mahsa Tavakoli , Rohitash Chandra , Fengrui Tian , Cristián Bravo

A central goal of algorithmic fairness is to reduce bias in automated decision making. An unavoidable tension exists between accuracy gains obtained by using sensitive information (e.g., gender or ethnic group) as part of a statistical…

机器学习 · 统计学 2020-02-03 Luca Oneto , Michele Donini , Amon Elders , Massimiliano Pontil

Deep learning algorithms have demonstrated remarkable efficacy in various medical image analysis (MedIA) applications. However, recent research highlights a performance disparity in these algorithms when applied to specific subgroups, such…

计算机视觉与模式识别 · 计算机科学 2024-07-10 Zikang Xu , Jun Li , Qingsong Yao , Han Li , Mingyue Zhao , S. Kevin Zhou

Multimodal learning leverages the integration of diverse data modalities to enhance performance in complex tasks. Yet, it frequently encounters incomplete or redundant modality data in real-world scenarios. This paper presents a…

机器学习 · 计算机科学 2026-05-05 Richeng Zhou , Xuelin Zhang , Liyuan Liu

Due to its ability to accurately predict emotional state using multimodal features, audiovisual emotion recognition has recently gained more interest from researchers. This paper proposes two methods to predict emotional attributes from…

音频与语音处理 · 电气工程与系统科学 2022-07-22 Bagus Tris Atmaja , Masato Akagi

Medical decision systems increasingly rely on data from multiple sources to ensure reliable and unbiased diagnosis. However, existing multimodal learning models fail to achieve this goal because they often ignore two critical challenges.…

As machine learning (ML) systems get adopted in more critical areas, it has become increasingly crucial to address the bias that could occur in these systems. Several fairness pre-processing algorithms are available to alleviate implicit…

In recent years, the affective computing (AC) and human-robot interaction (HRI) research communities have put fairness at the centre of their research agenda. However, none of the existing work has addressed the problem of machine learning…

机器人学 · 计算机科学 2024-07-03 Jiaee Cheong , Micol Spitale , Hatice Gunes

This paper investigates the MM dynamics approach proposed by Han et al. (2022) for multi-modal fusion in biomedical classification tasks. The MM dynamics algorithm integrates feature-level and modality-level informativeness to dynamically…

机器学习 · 计算机科学 2024-11-04 Laura Wenderoth

Ensembling is commonly regarded as an effective way to improve the general performance of models in machine learning, while also increasing the robustness of predictions. When it comes to algorithmic fairness, heterogeneous ensembles,…

机器学习 · 计算机科学 2025-01-27 Estanislao Claucich , Sara Hooker , Diego H. Milone , Enzo Ferrante , Rodrigo Echeveste

Ensuring fairness is critical when applying artificial intelligence to high-stakes domains such as healthcare, where predictive models trained on imbalanced and demographically skewed data risk exacerbating existing disparities. Federated…

计算机与社会 · 计算机科学 2025-05-15 Qiming Wu , Siqi Li , Doudou Zhou , Nan Liu

Learning effective joint embedding for cross-modal data has always been a focus in the field of multimodal machine learning. We argue that during multimodal fusion, the generated multimodal embedding may be redundant, and the discriminative…

机器学习 · 计算机科学 2022-12-06 Sijie Mai , Ying Zeng , Haifeng Hu

Multimodal aerial data are used to monitor natural systems, and machine learning can significantly accelerate the classification of landscape features within such imagery to benefit ecology and conservation. It remains under-explored,…

计算机视觉与模式识别 · 计算机科学 2024-10-08 Lucia Gordon , Nico Lang , Catherine Ressijac , Andrew Davies

Building general-purpose models that can effectively perceive the world through multimodal signals has been a long-standing goal. Current approaches involve integrating separately pre-trained components, such as connecting vision encoders…

计算机视觉与模式识别 · 计算机科学 2025-08-12 Mustafa Shukor , Enrico Fini , Victor Guilherme Turrisi da Costa , Matthieu Cord , Joshua Susskind , Alaaeldin El-Nouby

Multimodal fusion is considered a key step in multimodal tasks such as sentiment analysis, emotion detection, question answering, and others. Most of the recent work on multimodal fusion does not guarantee the fidelity of the multimodal…

Automated gender classification has important applications in many domains, such as demographic research, law enforcement, online advertising, as well as human-computer interaction. Recent research has questioned the fairness of this…

计算机视觉与模式识别 · 计算机科学 2020-09-25 Anoop Krishnan , Ali Almadan , Ajita Rattani

The characteristics of feature selection, nonlinear combination and multi-task auxiliary learning mechanism of the human visual perception system play an important role in real-world scenarios, but the research of image fusion theory based…

计算机视觉与模式识别 · 计算机科学 2020-06-23 Aiqing Fang , Xinbo Zhao , Jiaqi Yang , Yanning Zhang

The use of multiple modalities (e.g., face and fingerprint) or multiple algorithms (e.g., three face comparators) has shown to improve the recognition accuracy of an operational biometric system. Over time a biometric system may evolve to…

计算机视觉与模式识别 · 计算机科学 2024-08-22 Melissa R Dale , Anil Jain , Arun Ross

As decision-making increasingly relies on Machine Learning (ML) and (big) data, the issue of fairness in data-driven Artificial Intelligence (AI) systems is receiving increasing attention from both research and industry. A large variety of…

机器学习 · 计算机科学 2022-03-08 Tai Le Quy , Arjun Roy , Vasileios Iosifidis , Wenbin Zhang , Eirini Ntoutsi