English
Related papers

Related papers: Has Multimodal Learning Delivered Universal Intell…

200 papers

Recent technological advancements in multimodal machine learning--including the rise of large language models (LLMs)--have improved our ability to collect, process, and analyze diverse multimodal data such as speech, video, and eye gaze in…

With advanced imaging, sequencing, and profiling technologies, multiple omics data become increasingly available and hold promises for many healthcare applications such as cancer diagnosis and treatment. Multimodal learning for integrative…

Genomics · Quantitative Biology 2022-12-20 Sina Tabakhi , Mohammod Naimul Islam Suvon , Pegah Ahadian , Haiping Lu

Our experience of the world is multimodal - we see objects, hear sounds, feel texture, smell odors, and taste flavors. Modality refers to the way in which something happens or is experienced and a research problem is characterized as…

Machine Learning · Computer Science 2017-08-02 Tadas Baltrušaitis , Chaitanya Ahuja , Louis-Philippe Morency

Multimodal learning, a rapidly evolving field in artificial intelligence, seeks to construct more versatile and robust systems by integrating and analyzing diverse types of data, including text, images, audio, and video. Inspired by the…

Artificial Intelligence · Computer Science 2024-12-24 Priyaranjan Pattnayak , Hitesh Laxmichand Patel , Bhargava Kumar , Amit Agarwal , Ishan Banerjee , Srikant Panda , Tejaswini Kumar

The synchronic and diachronic study of the evolution of Artificial Intelligence (AI) unveils one prominent fact that its effect can be traced in almost all fields such as healthcare industry. The growth is perceived holistically in…

With the advancements in computer technology, there is a rapid development of intelligent systems to understand the complex relationships in data to make predictions and classifications. Artificail Intelligence based framework is rapidly…

Machine Learning · Computer Science 2021-07-30 G Jignesh Chowdary , Suganya G , Premalatha M , Asnath Victy Phamila Y , Karunamurthy K

Artificial intelligence has provided us with an exploration of a whole new research era. As more data and better computational power become available, the approach is being implemented in various fields. The demand for it in health…

Machine Learning · Computer Science 2020-08-11 Gloria Hyunjung Kwak , Pan Hui

Multimodal machine learning is a vibrant multi-disciplinary research field that aims to design computer agents with intelligent capabilities such as understanding, reasoning, and learning through integrating multiple communicative…

Machine Learning · Computer Science 2023-02-21 Paul Pu Liang , Amir Zadeh , Louis-Philippe Morency

The integration of artificial intelligence (AI) into healthcare is accelerating, yet medical education has not kept pace with these technological advancements. This paper synthesizes current knowledge on AI in medical education through a…

Computers and Society · Computer Science 2026-05-26 Scott P. McGrath , Katherine K. Kim , Karnjit Johl , Haibo Wang , Nick Anderson

We are perceiving and communicating with the world in a multisensory manner, where different information sources are sophisticatedly processed and interpreted by separate parts of the human brain to constitute a complex, yet harmonious and…

Computer Vision and Pattern Recognition · Computer Science 2024-06-12 Ye Zhu , Yu Wu , Nicu Sebe , Yan Yan

Machine learning holds promise for advancing clinical decision support, yet it remains unclear when multimodal learning truly helps in practice, particularly under modality missingness and fairness constraints. In this work, we conduct a…

Machine Learning · Computer Science 2026-03-02 Kejing Yin , Haizhou Xu , Wenfang Yao , Chen Liu , Zijie Chen , Yui Haang Cheung , William K. Cheung , Jing Qin

Generative artificial intelligence (AI) models, such as diffusion models and OpenAI's ChatGPT, are transforming medicine by enhancing diagnostic accuracy and automating clinical workflows. The field has advanced rapidly, evolving from…

Artificial Intelligence · Computer Science 2025-08-28 Lukas Buess , Matthias Keicher , Nassir Navab , Andreas Maier , Soroosh Tayebi Arasteh

Artificial intelligence (AI) in healthcare is a potentially revolutionary tool to achieve improved healthcare outcomes while reducing overall health costs. While many exploratory results hit the headlines in recent years there are only few…

Artificial Intelligence · Computer Science 2021-07-29 Vince I. Madai , David C. Higgins

The rise of Multimodal Large Language Models (MLLMs) has become a transformative force in the field of artificial intelligence, enabling machines to process and generate content across multiple modalities, such as text, images, audio, and…

Computation and Language · Computer Science 2025-12-09 Ming Li , Keyu Chen , Ziqian Bi , Ming Liu , Xinyuan Song , Zekun Jiang , Tianyang Wang , Benji Peng , Qian Niu , Junyu Liu , Jinlang Wang , Sen Zhang , Xuanhe Pan , Jiawei Xu , Pohsun Feng

Recent advancements in deep learning have significantly revolutionized the field of clinical diagnosis and treatment, offering novel approaches to improve diagnostic precision and treatment efficacy across diverse clinical domains, thus…

Artificial Intelligence · Computer Science 2024-12-04 Kai Sun , Siyan Xue , Fuchun Sun , Haoran Sun , Yu Luo , Ling Wang , Siyuan Wang , Na Guo , Lei Liu , Tian Zhao , Xinzhou Wang , Lei Yang , Shuo Jin , Jun Yan , Jiahong Dong

Artificial Intelligence (AI) and Medical Humanities have become two of the most crucial and rapidly growing fields in the current world. AI has made substantial advancements in recent years, enabling the development of algorithms and…

Computers and Society · Computer Science 2023-02-22 Zohaib Tariq

Multimodal deep learning systems which employ multiple modalities like text, image, audio, video, etc., are showing better performance in comparison with individual modalities (i.e., unimodal) systems. Multimodal machine learning involves…

Machine Learning · Computer Science 2022-01-19 Anil Rahate , Rahee Walambe , Sheela Ramanna , Ketan Kotecha

Deep learning methods have revolutionized speech recognition, image recognition, and natural language processing since 2010. Each of these tasks involves a single modality in their input signals. However, many applications in the artificial…

Artificial Intelligence · Computer Science 2020-07-15 Chao Zhang , Zichao Yang , Xiaodong He , Li Deng

Human perception inherently operates in a multimodal manner. Similarly, as machines interpret the empirical world, their learning processes ought to be multimodal. The recent, remarkable successes in empirical multimodal learning underscore…

Machine Learning · Computer Science 2023-12-19 Zhou Lu

Multimodal medical data fusion has emerged as a transformative approach in smart healthcare, enabling a comprehensive understanding of patient health and personalized treatment plans. In this paper, a journey from data to information to…

Information Retrieval · Computer Science 2024-10-28 Thanveer Shaik , Xiaohui Tao , Lin Li , Haoran Xie , Juan D. Velásquez