English
Related papers

Related papers: Towards Robust Multimodal Representation: A Unifie…

200 papers

Infrared and visible image fusion aims to integrate comprehensive information from multiple sources to achieve superior performances on various practical tasks, such as detection, over that of a single modality. However, most existing…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Yiming Sun , Bing Cao , Pengfei Zhu , Qinghua Hu

Multimodal deep learning systems which employ multiple modalities like text, image, audio, video, etc., are showing better performance in comparison with individual modalities (i.e., unimodal) systems. Multimodal machine learning involves…

Machine Learning · Computer Science 2022-01-19 Anil Rahate , Rahee Walambe , Sheela Ramanna , Ketan Kotecha

In parameter-efficient fine-tuning, mixture-of-experts (MoE), which involves specializing functionalities into different experts and sparsely activating them appropriately, has been widely adopted as a promising approach to trade-off…

Machine Learning · Computer Science 2025-08-29 Jinyuan Feng , Chaopeng Wei , Tenghai Qiu , Tianyi Hu , Zhiqiang Pu

Learning high-quality multi-modal entity representations is an important goal of multi-modal knowledge graph (MMKG) representation learning, which can enhance reasoning tasks within the MMKGs, such as MMKG completion (MMKGC). The main…

Artificial Intelligence · Computer Science 2025-04-08 Yichi Zhang , Zhuo Chen , Lingbing Guo , Yajing Xu , Binbin Hu , Ziqi Liu , Wen Zhang , Huajun Chen

Modern autonomous driving perception systems utilize complementary multi-modal sensors, such as LiDAR and cameras. Although sensor fusion architectures enhance performance in challenging environments, they still suffer significant…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Konyul Park , Yecheol Kim , Daehun Kim , Jun Won Choi

Mixture-of-Experts (MoE) models have shown remarkable capability in instruction tuning, especially when the number of tasks scales. However, previous methods simply merge all training tasks (e.g. creative writing, coding, and mathematics)…

Computation and Language · Computer Science 2024-06-18 Tong Zhu , Daize Dong , Xiaoye Qu , Jiacheng Ruan , Wenliang Chen , Yu Cheng

As machine learning models in critical fields increasingly grapple with multimodal data, they face the dual challenges of handling a wide array of modalities, often incomplete due to missing elements, and the temporal irregularity and…

Machine Learning · Computer Science 2025-04-10 Xing Han , Huy Nguyen , Carl Harris , Nhat Ho , Suchi Saria

Multimodal electronic health record (EHR) data are widely used in clinical applications. Conventional methods usually assume that each sample (patient) is associated with the unified observed modalities, and all modalities are available for…

Machine Learning · Computer Science 2022-11-01 Chaohe Zhang , Xu Chu , Liantao Ma , Yinghao Zhu , Yasha Wang , Jiangtao Wang , Junfeng Zhao

Multi-modal fusion approaches aim to integrate information from different data sources. Unlike natural datasets, such as in audio-visual applications, where samples consist of "paired" modalities, data in healthcare is often collected…

Image and Video Processing · Electrical Eng. & Systems 2023-03-03 Nasir Hayat , Krzysztof J. Geras , Farah E. Shamout

Learning multimodal representations from medical images and other data sources can provide richer information for decision-making. While various multimodal models have been developed for this, they overlook learning features that are both…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Boyu Chen , Weiye Bao , Junjie Liu , Michael Shen , Bo Peng , Paul Taylor , Zhu Li , Mengyue Yang

Sleep abnormalities can have severe health consequences. Automated sleep staging, i.e. labelling the sequence of sleep stages from the patient's physiological recordings, could simplify the diagnostic process. Previous work on automated…

Signal Processing · Electrical Eng. & Systems 2023-04-14 Konstantinos Kontras , Christos Chatzichristos , Huy Phan , Johan Suykens , Maarten De Vos

Survival analysis, as a challenging task, requires integrating Whole Slide Images (WSIs) and genomic data for comprehensive decision-making. There are two main challenges in this task: significant heterogeneity and complex inter- and…

Image and Video Processing · Electrical Eng. & Systems 2024-06-17 Conghao Xiong , Hao Chen , Hao Zheng , Dong Wei , Yefeng Zheng , Joseph J. Y. Sung , Irwin King

The Mixture of Experts (MoE) paradigm provides a powerful way to decompose dense layers into smaller, modular computations often more amenable to human interpretation, debugging, and editability. However, a major challenge lies in the…

Computer Vision and Pattern Recognition · Computer Science 2024-10-18 James Oldfield , Markos Georgopoulos , Grigorios G. Chrysos , Christos Tzelepis , Yannis Panagakis , Mihalis A. Nicolaou , Jiankang Deng , Ioannis Patras

Recent advancements in general-purpose or domain-specific multimodal large language models (LLMs) have witnessed remarkable progress for medical decision-making. However, they are designated for specific classification or generative tasks,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Songtao Jiang , Tuo Zheng , Yan Zhang , Yeying Jin , Li Yuan , Zuozhu Liu

Multimodal federated learning holds immense potential for collaboratively training models from multiple sources without sharing raw data, addressing both data scarcity and privacy concerns, two key challenges in healthcare. A major…

Machine Learning · Computer Science 2025-05-27 Pranav Poudel , Aavash Chhetri , Prashnna Gyawali , Georgios Leontidis , Binod Bhattarai

While deep learning methods have shown great success in medical image analysis, they require a number of medical images to train. Due to data privacy concerns and unavailability of medical annotators, it is oftentimes very difficult to…

Image and Video Processing · Electrical Eng. & Systems 2020-10-08 Yue Yang , Pengtao Xie

Large language models (LLMs) are typically fine-tuned on diverse and extensive datasets sourced from various origins to develop a comprehensive range of skills, such as writing, reasoning, chatting, coding, and more. Each skill has unique…

Computation and Language · Computer Science 2024-10-08 Minghao Wu , Thuy-Trang Vu , Lizhen Qu , Gholamreza Haffari

Deep learning on an edge device requires energy efficient operation due to ever diminishing power budget. Intentional low quality data during the data acquisition for longer battery life, and natural noise from the low cost sensor degrade…

Machine Learning · Computer Science 2019-04-30 Taesik Na , Minah Lee , Burhan A. Mudassar , Priyabrata Saha , Jong Hwan Ko , Saibal Mukhopadhyay

Humans make accurate decisions by interpreting complex data from multiple sources. Medical diagnostics, in particular, often hinge on human interpretation of multi-modal information. In order for artificial intelligence to make progress in…

Computer Vision and Pattern Recognition · Computer Science 2018-11-20 Faisal Mahmood , Ziyun Yang , Thomas Ashley , Nicholas J. Durr

Mixture-of-Experts (MoE) models increase representational capacity with modest computational cost, but their effectiveness in specialized domains such as medicine is limited by small datasets. In contrast, clinical practice offers rich…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Jinchen Gu , Nan Zhao , Lei Qiu , Lu Zhang