English
Related papers

Related papers: Multimodal Multitask Representation Learning for P…

200 papers

Cancer prognosis is a critical task that involves predicting patient outcomes and survival rates. To enhance prediction accuracy, previous studies have integrated diverse data modalities, such as clinical notes, medical images, and genomic…

Machine Learning · Computer Science 2025-02-04 Jie Peng , Shuang Zhou , Longwei Yang , Yiran Song , Mohan Zhang , Kaixiong Zhou , Feng Xie , Mingquan Lin , Rui Zhang , Tianlong Chen

Machine learning is bringing a paradigm shift to healthcare by changing the process of disease diagnosis and prognosis in clinics and hospitals. This development equips doctors and medical staff with tools to evaluate their hypotheses and…

Machine learning methods in healthcare have traditionally focused on using data from a single modality, limiting their ability to effectively replicate the clinical practice of integrating multiple sources of information for improved…

Machine Learning · Computer Science 2024-02-13 Felix Krones , Umar Marikkar , Guy Parsons , Adam Szmul , Adam Mahdi

Tabular data is the most abundant data type in the world, powering systems in finance, healthcare, e-commerce, and beyond. As tabular datasets grow and span multiple related targets, there is an increasing need to exploit shared task…

Machine Learning · Computer Science 2025-11-14 Dimitrios Sinodinos , Jack Yi Wei , Narges Armanfard

Cognitive diagnosis is an essential research topic in intelligent education, aimed at assessing the level of mastery of different skills by students. So far, many research works have used deep learning models to explore the complex…

Machine Learning · Computer Science 2025-12-30 Jin Wu , Chanjin Zheng

Biomedical data is inherently multimodal, consisting of electronic health records, medical imaging, digital pathology, genome sequencing, wearable sensors, and more. The application of artificial intelligence tools to these multifaceted…

Machine Learning · Computer Science 2024-08-26 Shentong Mo , Paul Pu Liang

Clinical decision-making relies on the integration of information across various data modalities, such as clinical time-series, medical images and textual reports. Compared to other domains, real-world medical data is heterogeneous in…

Image and Video Processing · Electrical Eng. & Systems 2025-08-14 Baraa Al Jorf , Farah Shamout

Metalearning and multitask learning are two frameworks for solving a group of related learning tasks more efficiently than we could hope to solve each of the individual tasks on their own. In multitask learning, we are given a fixed set of…

Machine Learning · Computer Science 2024-04-02 Maryam Aliakbarpour , Konstantina Bairaktari , Gavin Brown , Adam Smith , Nathan Srebro , Jonathan Ullman

Shortage of annotated data is one of the greatest bottlenecks in biomedical image analysis. Meta learning studies how learning systems can increase in efficiency through experience and could thus evolve as an important concept to overcome…

Computer Vision and Pattern Recognition · Computer Science 2021-07-09 Patrick Godau , Lena Maier-Hein

Predicting stroke risk is a complex challenge that can be enhanced by integrating diverse clinically available data modalities. This study introduces a self-supervised multimodal framework that combines 3D brain imaging, clinical data, and…

Computer Vision and Pattern Recognition · Computer Science 2025-07-09 Camille Delgrange , Olga Demler , Samia Mora , Bjoern Menze , Ezequiel de la Rosa , Neda Davoudi

Multi-Task Learning (MTL) is a framework, where multiple related tasks are learned jointly and benefit from a shared representation space, or parameter transfer. To provide sufficient learning support, modern MTL uses annotated data with…

Computer Vision and Pattern Recognition · Computer Science 2024-01-04 Dimitrios Kollias , Viktoriia Sharmanska , Stefanos Zafeiriou

Managing fluid balance in dialysis patients is crucial, as improper management can lead to severe complications. In this paper, we propose a multimodal approach that integrates visual features from lung ultrasound images with clinical data…

Image and Video Processing · Electrical Eng. & Systems 2024-10-04 Tianqi Yang , Nantheera Anantrasirichai , Oktay Karakuş , Marco Allinovi , Alin Achim

Background and objective: Employing deep learning models in critical domains such as medical imaging poses challenges associated with the limited availability of training data. We present a strategy for improving the performance and…

Computer Vision and Pattern Recognition · Computer Science 2024-03-27 Eva Pachetti , Sotirios A. Tsaftaris , Sara Colantonio

Microscopic examination of slides prepared from tissue samples is the primary tool for detecting and classifying cancerous lesions, a process that is time-consuming and requires the expertise of experienced pathologists. Recent advances in…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Saba Fatema , Brighton Nuwagira , Sayoni Chakraborty , Reyhan Gedik , Baris Coskunuzer

Meta-learning algorithms are able to learn a new task using previously learned knowledge, but they often require a large number of meta-training tasks which may not be readily available. To address this issue, we propose a method for…

Machine Learning · Computer Science 2023-05-18 Wenfang Sun , Yingjun Du , Xiantong Zhen , Fan Wang , Ling Wang , Cees G. M. Snoek

Pathological diagnosis remains the definitive standard for identifying tumors. The rise of multimodal large models has simplified the process of integrating image analysis with textual descriptions. Despite this advancement, the substantial…

Computer Vision and Pattern Recognition · Computer Science 2024-08-14 Xiaomin Wu , Rui Xu , Pengchen Wei , Wenkang Qin , Peixiang Huang , Ziheng Li , Lin Luo

Multitask learning assumes that models capable of learning from multiple tasks can achieve better quality and efficiency via knowledge transfer, a key feature of human learning. Though, state of the art ML models rely on high customization…

Machine Learning · Computer Science 2022-11-17 Andrea Gesmundo , Jeff Dean

Session-based recommendation plays a central role in a wide spectrum of online applications, ranging from e-commerce to online advertising services. However, the majority of existing session-based recommendation techniques (e.g.,…

Information Retrieval · Computer Science 2021-10-11 Chao Huang , Jiahui Chen , Lianghao Xia , Yong Xu , Peng Dai , Yanqing Chen , Liefeng Bo , Jiashu Zhao , Jimmy Xiangji Huang

Foundational models, pretrained on a large scale, have demonstrated substantial success across non-medical domains. However, training these models typically requires large, comprehensive datasets, which contrasts with the smaller and more…

Computer Vision and Pattern Recognition · Computer Science 2023-11-17 Raphael Schäfer , Till Nicke , Henning Höfener , Annkristin Lange , Dorit Merhof , Friedrich Feuerhake , Volkmar Schulz , Johannes Lotz , Fabian Kiessling

The recent surge in performance for image analysis of digitised pathology slides can largely be attributed to the advances in deep learning. Deep models can be used to initially localise various structures in the tissue and hence facilitate…

Image and Video Processing · Electrical Eng. & Systems 2022-11-15 Simon Graham , Quoc Dang Vu , Mostafa Jahanifar , Shan E Ahmed Raza , Fayyaz Minhas , David Snead , Nasir Rajpoot