中文
相关论文

相关论文: Exploring Fusion Techniques in Multimodal AI-Based…

200 篇论文

The subject of "fairness" in artificial intelligence (AI) refers to assessing AI algorithms for potential bias based on demographic characteristics such as race and gender, and the development of algorithms to address this bias. Most…

计算机视觉与模式识别 · 计算机科学 2021-07-02 Esther Puyol-Anton , Bram Ruijsink , Stefan K. Piechnik , Stefan Neubauer , Steffen E. Petersen , Reza Razavi , Andrew P. King

Electronic Health Record (EHR) data encompass diverse modalities -- text, images, and medical codes -- that are vital for clinical decision-making. To process these complex data, multimodal AI (MAI) has emerged as a powerful approach for…

机器学习 · 计算机科学 2026-03-03 Nikkie Hooman , Zhongjie Wu , Eric C. Larson , Mehak Gupta

This research presents a novel multimodal data fusion methodology for pain behavior recognition, integrating statistical correlation analysis with human-centered insights. Our approach introduces two key innovations: 1) integrating…

人工智能 · 计算机科学 2025-01-22 Xingrui Gu , Zhixuan Wang , Irisa Jin , Zekun Wu

Cluster analysis is a fundamental problem in data mining and machine learning. In recent years, multi-view clustering has attracted increasing attention due to its ability to integrate complementary information from multiple views. However,…

机器学习 · 计算机科学 2025-08-07 Mudi Jiang , Jiahui Zhou , Lianyu Hu , Xinying Liu , Zengyou He , Zhikui Chen

Multimodal learning has increasingly become a focal point in research, primarily due to its ability to integrate complementary information from diverse modalities. Nevertheless, modality imbalance, stemming from factors such as insufficient…

机器学习 · 计算机科学 2025-11-04 Rongrong Xie , Guido Sanguinetti

Modern machine learning models often combine multiple input streams of data to more accurately capture the information that informs their decisions. In multimodal machine learning, choosing the strategy for fusing data together requires…

机器学习 · 计算机科学 2025-12-01 Regan Willis , Jason Bakos

This paper proposes a novel multimodal fusion approach, aiming to produce best possible decisions by integrating information coming from multiple media. While most of the past multimodal approaches either work by projecting the features of…

人工智能 · 计算机科学 2018-08-23 Valentin Vielzeuf , Alexis Lechervy , Stéphane Pateux , Frédéric Jurie

In this paper, we consider the problem of multimodal data analysis with a use case of audiovisual emotion recognition. We propose an architecture capable of learning from raw data and describe three variants of it with distinct modality…

计算机视觉与模式识别 · 计算机科学 2022-01-27 Kateryna Chumachenko , Alexandros Iosifidis , Moncef Gabbouj

As AI systems become more embedded in everyday life, the development of fair and unbiased models becomes more critical. Considering the social impact of AI systems is not merely a technical challenge but a moral imperative. As evidenced in…

机器学习 · 计算机科学 2025-10-03 Aida Tayebi , Ali Khodabandeh Yalabadi , Mehdi Yazdani-Jahromi , Ozlem Ozmen Garibay

Visible images offer rich texture details, while infrared images emphasize salient targets. Fusing these complementary modalities enhances scene understanding, particularly for advanced vision tasks under challenging conditions. Recently,…

计算机视觉与模式识别 · 计算机科学 2025-06-10 Beining Xu , Junxian Li

Transformer-based tabular foundation models have recently demonstrated promising in-context learning (ICL) performance on structured data, emerging as competitive alternatives to gradient-boosted trees. However, the fairness implications of…

机器学习 · 计算机科学 2026-01-06 Patrik Kenfack , Samira Ebrahimi Kahou , Ulrich Aïvodji

This paper explores the development of a multimodal sentiment analysis model that integrates text, audio, and visual data to enhance sentiment classification. The goal is to improve emotion detection by capturing the complex interactions…

计算与语言 · 计算机科学 2025-01-15 Hui Lee , Singh Suniljit , Yong Siang Ong

While fairness-aware machine learning algorithms have been receiving increasing attention, the focus has been on centralized machine learning, leaving decentralized methods underexplored. Federated Learning is a decentralized form of…

机器学习 · 计算机科学 2023-07-04 Teresa Salazar , Miguel Fernandes , Helder Araujo , Pedro Henriques Abreu

AI-enhanced personality assessments are increasingly shaping hiring decisions, using affective computing to predict traits from the Big Five (OCEAN) model. However, integrating AI into these assessments raises ethical concerns, especially…

人机交互 · 计算机科学 2025-11-24 Dena F. Mujtaba , Nihar R. Mahapatra

Feature alignment serves as the primary mechanism for fusing multimodal data. We put forth a feature alignment approach that achieves full integration of multimodal information. This is accomplished via an alternating process of shifting…

计算机视觉与模式识别 · 计算机科学 2024-06-14 Jiahao Qin

To ensure unbiased and ethical automated predictions, fairness must be a core principle in machine learning applications. Fairness in machine learning aims to mitigate biases present in the training data and model imperfections that could…

机器学习 · 计算机科学 2024-12-03 Jan Pablo Burgard , João Vitor Pamplona

Artificial intelligence (AI) systems in healthcare have demonstrated remarkable potential to improve patient outcomes. However, if not designed with fairness in mind, they also carry the risks of perpetuating or exacerbating existing health…

机器学习 · 计算机科学 2025-01-24 Xiaoyang Wang , Christopher C. Yang

Multimodal Re-Identification (ReID) is a popular retrieval task that aims to re-identify objects across diverse data streams, prompting many researchers to integrate multiple modalities into a unified representation. While such fusion…

计算机视觉与模式识别 · 计算机科学 2023-10-31 Jennifer Crawford , Haoli Yin , Luke McDermott , Daniel Cummings

Developing AI tools that preserve fairness is of critical importance, specifically in high-stakes applications such as those in healthcare. However, health AI models' overall prediction performance is often prioritized over the possible…

机器学习 · 计算机科学 2023-05-22 Raphael Poulain , Mirza Farhan Bin Tarek , Rahmatollah Beheshti

Although significant progress has been made in face recognition, demographic bias still exists in face recognition systems. For instance, it usually happens that the face recognition performance for a certain demographic group is lower than…

计算机视觉与模式识别 · 计算机科学 2022-11-29 Fu-En Wang , Chien-Yi Wang , Min Sun , Shang-Hong Lai