English
Related papers

Related papers: M3H: Multimodal Multitask Machine Learning for Hea…

200 papers

While many machine learning methods have been used for medical prediction and risk factor analysis on healthcare data, most prior research has involved single-task learning (STL) methods. However, healthcare research often involves multiple…

Machine Learning · Computer Science 2021-03-08 Lu Wang , Haoyan Jiang , Mark Chignell

Recent advances in clinical AI have enabled remarkable progress across many clinical domains. However, existing benchmarks and models are primarily limited to a small set of modalities and tasks, which hinders the development of large-scale…

Machine Learning · Computer Science 2025-03-21 Wei Dai , Peilin Chen , Malinda Lu , Daniel Li , Haowen Wei , Hejie Cui , Paul Pu Liang

Modern medical records include a vast amount of multimodal free text clinical data and imaging data from radiology, cardiology, and digital pathology. Fully mining such big data requires multitasking; otherwise, occult but important aspects…

Image and Video Processing · Electrical Eng. & Systems 2024-04-25 Chuang Niu , Qing Lyu , Christopher D. Carothers , Parisa Kaviani , Josh Tan , Pingkun Yan , Mannudeep K. Kalra , Christopher T. Whitlow , Ge Wang

The integration of diverse clinical modalities such as medical imaging and the tabular data extracted from patients' Electronic Health Records (EHRs) is a crucial aspect of modern healthcare. Integrative analysis of multiple sources can…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Daniel Duenias , Brennan Nichyporuk , Tal Arbel , Tammy Riklin Raviv

Multi-task learning (MTL) is a powerful approach in deep learning that leverages the information from multiple tasks during training to improve model performance. In medical imaging, MTL has shown great potential to solve various tasks.…

Computer Vision and Pattern Recognition · Computer Science 2023-09-08 Sangwook Kim , Thomas G. Purdie , Chris McIntosh

LLM-based agents have demonstrated strong potential for autonomous machine learning, yet their applicability to health data remains limited. Existing systems often struggle to generalize across heterogeneous health data modalities, rely…

Artificial Intelligence · Computer Science 2026-02-03 Tong Xia , Weibin Li , Gang Liu , Yong Li

Multi-Task Learning (MTL) is a learning paradigm in machine learning and its aim is to leverage useful information contained in multiple related tasks to help improve the generalization performance of all the tasks. In this paper, we give a…

Machine Learning · Computer Science 2021-03-30 Yu Zhang , Qiang Yang

Developing reliable workload predictive models can affect many aspects of clinical decision making procedure. The primary challenge in healthcare systems is handling the demand uncertainty over the time. This issue becomes more critical for…

Computers and Society · Computer Science 2019-01-04 Mohammad Hessam Olya , Dongxiao Zhu , Kai Yang

Multi-task neural networks learn tasks simultaneously to improve individual task performance. There are three mechanisms of multi-task learning (MTL) which are explored here for the context of structural health monitoring (SHM): (i) the…

Machine Learning · Computer Science 2023-05-17 Sarah Bee , Lawrence Bull , Nikolas Dervilis , Keith Worden

Biomedical data is inherently multimodal, consisting of electronic health records, medical imaging, digital pathology, genome sequencing, wearable sensors, and more. The application of artificial intelligence tools to these multifaceted…

Machine Learning · Computer Science 2024-08-26 Shentong Mo , Paul Pu Liang

Task execution quality significantly impacts multi-robot missions, yet existing task allocation frameworks rarely consider quality of service as a decision variable, despite its importance in applications like robotic disinfection and…

Robotics · Computer Science 2025-10-09 Ishaan Mehta , Junseo Kim , Sharareh Taghipour , Sajad Saeedi

Automated retinal image medical description generation is crucial for streamlining medical diagnosis and treatment planning. Existing challenges include the reliance on learned retinal image representations, difficulties in handling…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Nagur Shareef Shaik , Teja Krishna Cherukuri , Dong Hye Ye

Multitask deep learning has been applied to patient outcome prediction from text, taking clinical notes as input and training deep neural networks with a joint loss function of multiple tasks. However, the joint training scheme of multitask…

Computation and Language · Computer Science 2023-01-26 Shaoxiong Ji , Pekka Marttinen

Electronic Health Records (EHRs), comprising diverse clinical data such as diagnoses, medications, and laboratory results, hold great promise for translational research. EHR-derived data have advanced disease prevention, improved clinical…

Machine Learning · Statistics 2025-09-09 Yinjie Wang , Doudou Zhou , Yue Liu , Junwei Lu , Tianxi Cai

Accurate Intensive Care Unit (ICU) outcome prediction is critical for improving patient treatment quality and ICU resource allocation. Existing research mainly focuses on structured data, e.g. demographics and vital signs, and lacks…

Information Theory · Computer Science 2025-02-26 Yucheng Ruan , Daniel J. Tan , See Kiong Ng , Ling Huang , Mengling Feng

Predicting multiple heterogeneous biological and medical targets is a challenge for traditional deep learning models. In contrast to single-task learning, in which a separate model is trained for each target, multi-task learning (MTL)…

Machine Learning · Computer Science 2022-05-31 Raquel Aoki , Frederick Tung , Gabriel L. Oliveira

Machine learning holds promise for advancing clinical decision support, yet it remains unclear when multimodal learning truly helps in practice, particularly under modality missingness and fairness constraints. In this work, we conduct a…

Machine Learning · Computer Science 2026-03-02 Kejing Yin , Haizhou Xu , Wenfang Yao , Chen Liu , Zijie Chen , Yui Haang Cheung , William K. Cheung , Jing Qin

Hashing has recently sparked a great revolution in cross-modal retrieval because of its low storage cost and high query speed. Recent cross-modal hashing methods often learn unified or equal-length hash codes to represent the multi-modal…

Computer Vision and Pattern Recognition · Computer Science 2019-09-13 Xin Liu , Zhikai Hu , Haibin Ling , Yiu-ming Cheung

MTL is a learning paradigm that effectively leverages both task-specific and shared information to address multiple related tasks simultaneously. In contrast to STL, MTL offers a suite of benefits that enhance both the training process and…

We present M3P, a Multitask Multilingual Multimodal Pre-trained model that combines multilingual pre-training and multimodal pre-training into a unified framework via multitask pre-training. Our goal is to learn universal representations…

Computation and Language · Computer Science 2021-04-02 Minheng Ni , Haoyang Huang , Lin Su , Edward Cui , Taroon Bharti , Lijuan Wang , Jianfeng Gao , Dongdong Zhang , Nan Duan