English
Related papers

Related papers: Has Multimodal Learning Delivered Universal Intell…

200 papers

Visual impairment represents a major global health challenge, with multimodal imaging providing complementary information that is essential for accurate ophthalmic diagnosis. This comprehensive survey systematically reviews the latest…

Image and Video Processing · Electrical Eng. & Systems 2025-08-07 Xiaoling Luo , Ruli Zheng , Qiaojian Zheng , Zibo Du , Shuo Yang , Meidan Ding , Qihao Xu , Chengliang Liu , Linlin Shen

Human perception of the empirical world involves recognizing the diverse appearances, or 'modalities', of underlying objects. Despite the longstanding consideration of this perspective in philosophy and cognitive science, the study of…

Machine Learning · Computer Science 2023-12-19 Zhou Lu

As machine learning and artificial intelligence are more frequently being leveraged to tackle problems in the health sector, there has been increased interest in utilizing them in clinical decision-support. This has historically been the…

Machine Learning · Computer Science 2022-04-12 Adrienne Kline , Hanyin Wang , Yikuan Li , Saya Dennis , Meghan Hutch , Zhenxing Xu , Fei Wang , Feixiong Cheng , Yuan Luo

As a subset of machine learning, meta-learning, or learning to learn, aims at improving the model's capabilities by employing prior knowledge and experience. A meta-learning paradigm can appropriately tackle the conventional challenges of…

Machine Learning · Computer Science 2024-08-14 Alireza Rafiei , Ronald Moore , Sina Jahromi , Farshid Hajati , Rishikesan Kamaleswaran

Multi-modal 3D scene understanding has gained considerable attention due to its wide applications in many areas, such as autonomous driving and human-computer interaction. Compared to conventional single-modal 3D understanding, introducing…

Computer Vision and Pattern Recognition · Computer Science 2023-10-25 Yinjie Lei , Zixuan Wang , Feng Chen , Guoqing Wang , Peng Wang , Yang Yang

Artificial intelligence (AI) is rapidly advancing in healthcare, enhancing the efficiency and effectiveness of services across various specialties, including cardiology, ophthalmology, dermatology, emergency medicine, etc. AI applications…

The potential for machine learning to disrupt the medical profession is the subject of ongoing debate within biomedical informatics. This study aimed to explore psychiatrists' opinions about the potential impact of innovations in artificial…

Computers and Society · Computer Science 2019-10-23 Charlotte Blease , Cosima Locher , Marisa Leon-Carlyle , P. Murali Doraiswamy

Computer-assisted diagnostic and prognostic systems of the future should be capable of simultaneously processing multimodal data. Multimodal deep learning (MDL), which involves the integration of multiple sources of data, such as images and…

Computer Vision and Pattern Recognition · Computer Science 2023-10-20 Zhaoyi Sun , Mingquan Lin , Qingqing Zhu , Qianqian Xie , Fei Wang , Zhiyong Lu , Yifan Peng

Generative AI has had a profound impact on biomedicine and health, both in professional work and in education. Based on large language models (LLMs), generative AI has been found to perform as well as humans in simulated situations taking…

Artificial Intelligence · Computer Science 2025-01-20 William Hersh

Large Language Models (LLMs) have rapidly evolved from text-based systems to multimodal platforms, significantly impacting various sectors including healthcare. This comprehensive review explores the progression of LLMs to Multimodal Large…

Machine learning has long since become a keystone technology, accelerating science and applications in a broad range of domains. Consequently, the notion of applying learning methods to a particular problem set has become an established and…

Deep learning has received extensive research interest in developing new medical image processing algorithms, and deep learning based models have been remarkably successful in a variety of medical imaging tasks to support disease detection…

Computer Vision and Pattern Recognition · Computer Science 2022-04-12 Xuxin Chen , Ximin Wang , Ke Zhang , Kar-Ming Fung , Theresa C. Thai , Kathleen Moore , Robert S. Mannel , Hong Liu , Bin Zheng , Yuchen Qiu

Fueled by breakthrough technology developments, the biological, biomedical, and behavioral sciences are now collecting more data than ever before. There is a critical need for time- and cost-efficient strategies to analyze and interpret…

Multimodal fusion focuses on integrating information from multiple modalities with the goal of more accurate prediction, which has achieved remarkable progress in a wide range of scenarios, including autonomous driving and medical…

Machine Learning · Computer Science 2024-11-04 Qingyang Zhang , Yake Wei , Zongbo Han , Huazhu Fu , Xi Peng , Cheng Deng , Qinghua Hu , Cai Xu , Jie Wen , Di Hu , Changqing Zhang

Multimodal learning, which integrates diverse data sources such as images, text, and structured data, has proven superior to unimodal counterparts in high-stakes decision-making. However, while performance gains remain the gold standard for…

Artificial Intelligence · Computer Science 2025-05-07 Kishore Sampath , Pratheesh , Ayaazuddin Mohammad , Resmi Ramachandranpillai

Meta-learning has gained wide popularity as a training framework that is more data-efficient than traditional machine learning methods. However, its generalization ability in complex task distributions, such as multimodal tasks, has not…

Machine Learning · Computer Science 2022-05-10 Yao Ma , Shilin Zhao , Weixiao Wang , Yaoman Li , Irwin King

Virtual reality (VR) is rapidly growing, with the potential to change the way we create and consume content. In VR, users integrate multimodal sensory information they receive, to create a unified perception of the virtual world. In this…

Human-Computer Interaction · Computer Science 2024-05-24 Daniel Martin , Sandra Malpica , Diego Gutierrez , Belen Masia , Ana Serrano

Healthcare sector is totally different from other industry. It is on high priority sector and people expect highest level of care and services regardless of cost. It did not achieve social expectation even though it consume huge percentage…

Computer Vision and Pattern Recognition · Computer Science 2017-04-25 Muhammad Imran Razzak , Saeeda Naz , Ahmad Zaib

Deep learning has achieved significant breakthroughs in medical imaging, but these advancements are often dependent on large, well-annotated datasets. However, obtaining such datasets poses a significant challenge, as it requires…

Computer Vision and Pattern Recognition · Computer Science 2025-04-17 Siteng Ma , Honghui Du , Yu An , Jing Wang , Qinqin Wang , Haochang Wu , Aonghus Lawlor , Ruihai Dong

The analysis of the adaptive behaviour of many different kinds of systems such as humans, animals and machines, requires more general ways of assessing their cognitive abilities. This need is strengthened by increasingly more tasks being…

Artificial Intelligence · Computer Science 2013-05-10 David L. Dowe , Jose Hernandez-Orallo