English
Related papers

Related papers: Medical Multimodal Classifiers Under Scarce Data C…

200 papers

Multimodal registration is a challenging problem in medical imaging due the high variability of tissue appearance under different imaging modalities. The crucial component here is the choice of the right similarity measure. We make a step…

Computer Vision and Pattern Recognition · Computer Science 2016-09-20 Martin Simonovsky , Benjamín Gutiérrez-Becker , Diana Mateus , Nassir Navab , Nikos Komodakis

Training deep learning models on medical datasets that perform well for all classes is a challenging task. It is often the case that a suboptimal performance is obtained on some classes due to the natural class imbalance issue that comes…

Computer Vision and Pattern Recognition · Computer Science 2022-10-05 Suraj Kothawade , Atharv Savarkar , Venkat Iyer , Lakshman Tamil , Ganesh Ramakrishnan , Rishabh Iyer

Medical professionals frequently work in a data constrained setting to provide insights across a unique demographic. A few medical observations, for instance, informs the diagnosis and treatment of a patient. This suggests a unique setting…

Computation and Language · Computer Science 2022-12-06 Pankaj Sharma , Imran Qureshi , Minh Tran

Accurate breast lesion risk estimation can significantly reduce unnecessary biopsies and help doctors decide optimal treatment plans. Most existing computer-aided systems rely solely on mammogram features to classify breast lesions. While…

Image and Video Processing · Electrical Eng. & Systems 2021-08-24 Hung Q. Vo , Pengyu Yuan , Tiancheng He , Stephen T. C. Wong , Hien V. Nguyen

Understanding brain disorders is crucial for accurate clinical diagnosis and treatment. Recent advances in Multimodal Large Language Models (MLLMs) offer a promising approach to interpreting medical images with the support of text…

Image and Video Processing · Electrical Eng. & Systems 2025-06-03 Jing Zhang , Xiaowei Yu , Yanjun Lyu , Lu Zhang , Tong Chen , Chao Cao , Yan Zhuang , Minheng Chen , Tianming Liu , Dajiang Zhu

Detecting collaborative and problem-solving behaviours from digital traces to interpret students' collaborative problem solving (CPS) competency is a long-term goal in the Artificial Intelligence in Education (AIEd) field. Although…

Computation and Language · Computer Science 2025-04-22 K. Wong , B. Wu , S. Bulathwela , M. Cukurova

Machine learning (ML) applications in medical artificial intelligence (AI) systems have shifted from traditional and statistical methods to increasing application of deep learning models. This survey navigates the current landscape of…

Machine Learning · Computer Science 2024-01-23 Elisa Warner , Joonsang Lee , William Hsu , Tanveer Syeda-Mahmood , Charles Kahn , Olivier Gevaert , Arvind Rao

Most uses of Meta-Learning in visual recognition are very often applied to image classification, with a relative lack of works in other tasks {such} as segmentation and detection. We propose a generic Meta-Learning framework for few-shot…

Computer Vision and Pattern Recognition · Computer Science 2023-05-12 Hugo Oliveira , Pedro H. T. Gama , Isabelle Bloch , Roberto Marcondes Cesar

Histopathology remains the gold standard for cancer diagnosis and prognosis. With the advent of transcriptome profiling, multi-modal learning combining transcriptomics with histology offers more comprehensive information. However, existing…

Image and Video Processing · Electrical Eng. & Systems 2026-03-03 Yupei Zhang , Xiaofei Wang , Anran Liu , Lequan Yu , Chao Li

Studies on schizophrenia assessments using deep learning typically treat it as a classification task to detect the presence or absence of the disorder, oversimplifying the condition and reducing its clinical applicability. This traditional…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-29 Gowtham Premananth , Philip Resnik , Sonia Bansal , Deanna L. Kelly , Carol Espy-Wilson

Managing fluid balance in dialysis patients is crucial, as improper management can lead to severe complications. In this paper, we propose a multimodal approach that integrates visual features from lung ultrasound images with clinical data…

Image and Video Processing · Electrical Eng. & Systems 2024-10-04 Tianqi Yang , Nantheera Anantrasirichai , Oktay Karakuş , Marco Allinovi , Alin Achim

The widely used ChestX-ray14 dataset addresses an important medical image classification problem and has the following caveats: 1) many lung pathologies are visually similar, 2) a variant of diseases including lung cancer, tuberculosis, and…

Computer Vision and Pattern Recognition · Computer Science 2018-07-26 Zongyuan Ge , Dwarikanath Mahapatra , Suman Sedai , Rahil Garnavi , Rajib Chakravorty

Multi-modal medical image segmentation plays an essential role in clinical diagnosis. It remains challenging as the input modalities are often not well-aligned spatially. Existing learning-based methods mainly consider sharing trainable…

Computer Vision and Pattern Recognition · Computer Science 2021-01-06 Jingkun Chen , Wenqi Li , Hongwei Li , Jianguo Zhang

We present a weakly supervised deep learning model for classifying thoracic diseases and identifying abnormalities in chest radiography. In this work, instead of learning from medical imaging data with region-level annotations, our model…

Computer Vision and Pattern Recognition · Computer Science 2018-11-07 Bo Zhou , Yuemeng Li , Jiangcong Wang

Transformers are very powerful tools for a variety of tasks across domains, from text generation to image captioning. However, transformers require substantial amounts of training data, which is often a challenge in biomedical settings,…

Computer Vision and Pattern Recognition · Computer Science 2023-07-04 Andrew Kean Gao

Deep Learning has implemented a wide range of applications and has become increasingly popular in recent years. The goal of multimodal deep learning (MMDL) is to create models that can process and link information using various modalities.…

Machine Learning · Computer Science 2022-02-21 Jabeen Summaira , Xi Li , Amin Muhammad Shoib , Jabbar Abdul

Machine learning methods in healthcare have traditionally focused on using data from a single modality, limiting their ability to effectively replicate the clinical practice of integrating multiple sources of information for improved…

Machine Learning · Computer Science 2024-02-13 Felix Krones , Umar Marikkar , Guy Parsons , Adam Szmul , Adam Mahdi

Magnetic Resonance Imaging (MRI) is a principal diagnostic approach used in the field of radiology to create images of the anatomical and physiological structure of patients. MRI is the prevalent medical imaging practice to find…

Computer Vision and Pattern Recognition · Computer Science 2021-06-16 Yusuf Brima , Mossadek Hossain Kamal Tushar , Upama Kabir , Tariqul Islam

The medical imaging literature has witnessed remarkable progress in high-performing segmentation models based on convolutional neural networks. Despite the new performance highs, the recent advanced segmentation models still require large,…

Image and Video Processing · Electrical Eng. & Systems 2020-02-13 Nima Tajbakhsh , Laura Jeyaseelan , Qian Li , Jeffrey Chiang , Zhihao Wu , Xiaowei Ding

The limited availability of annotated data presents a major challenge for applying deep learning methods to medical image analysis. Few-shot learning methods aim to recognize new classes from only a small number of labeled examples. These…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Berenice Montalvo-Lezama , Gibran Fuentes-Pineda