English
Related papers

Related papers: MINT: A wrapper to make multi-modal and multi-imag…

200 papers

According to PBS, nearly one-third of Americans lack access to primary care services, and another forty percent delay going to avoid medical costs. As a result, many diseases are left undiagnosed and untreated, even if the disease shows…

Image and Video Processing · Electrical Eng. & Systems 2024-11-22 Allen Yang , Edward Yang

Data augmentations are widely used in training medical image deep learning models to increase the diversity and size of sparse datasets. However, commonly used augmentation techniques can result in loss of clinically relevant information…

Image and Video Processing · Electrical Eng. & Systems 2024-04-18 Adrit Rao , Andrea Fisher , Ken Chang , John Christopher Panagides , Katherine McNamara , Joon-Young Lee , Oliver Aalami

The incorporation of physical information in machine learning frameworks is transforming medical image analysis (MIA). By integrating fundamental knowledge and governing physical laws, these models achieve enhanced robustness and…

Image and Video Processing · Electrical Eng. & Systems 2024-08-05 Chayan Banerjee , Kien Nguyen , Olivier Salvado , Truyen Tran , Clinton Fookes

To make sense of their surroundings, intelligent systems must transform complex sensory inputs to structured codes that are reduced to task-relevant information such as object category. Biological agents achieve this in a largely autonomous…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Robin Weiler , Matthias Brucklacher , Cyriel M. A. Pennartz , Sander M. Bohté

Noninvasive optical imaging modalities can probe patient's tissue in 3D and over time generate gigabytes of clinically relevant data per sample. There is a need for AI models to analyze this data and assist clinical workflow. The lack of…

Inpainting, the process of filling missing or corrupted image parts, has broad applications in medical imaging. However, generating anatomically accurate synthetic polyp images for clinical AI is a largely underexplored problem. In…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Duy-Bao Bui , Hoang-Khang Nguyen , Thao Thi Phuong Dao , Kim Anh Phung , Tam V. Nguyen , Justin Zhan , Minh-Triet Tran , Trung-Nghia Le

Skin diseases, such as skin cancer, are a significant public health issue, and early diagnosis is crucial for effective treatment. Artificial intelligence (AI) algorithms have the potential to assist in triaging benign vs malignant skin…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Nusrat Munia , Abdullah-Al-Zubaer Imran

A patient undergoes multiple examinations in each hospital stay, where each provides different facets of the health status. These assessments include temporal data with varying sampling rates, discrete single-point measurements, therapeutic…

Computer Vision and Pattern Recognition · Computer Science 2025-01-31 Malte Tölle , Mohamad Scharaf , Samantha Fischer , Christoph Reich , Silav Zeid , Christoph Dieterich , Benjamin Meder , Norbert Frey , Philipp Wild , Sandy Engelhardt

The past decade has witnessed a substantial increase in the number of startups and companies offering AI-based solutions for clinical decision support in medical institutions. However, the critical nature of medical decision-making raises…

Image and Video Processing · Electrical Eng. & Systems 2025-02-27 Solha Kang , Wesley De Neve , Francois Rameau , Utku Ozbulak

In hospitals, data are siloed to specific information systems that make the same information available under different modalities such as the different medical imaging exams the patient undergoes (CT scans, MRI, PET, Ultrasound, etc.) and…

Computer Vision and Pattern Recognition · Computer Science 2021-02-03 Tristan Sylvain , Francis Dutil , Tess Berthier , Lisa Di Jorio , Margaux Luck , Devon Hjelm , Yoshua Bengio

Real-life medical data is often multimodal and incomplete, fueling the growing need for advanced deep learning models capable of integrating them efficiently. The use of diverse modalities, including histopathology slides, MRI, and genetic…

Artificial Intelligence · Computer Science 2024-10-02 Lucas Robinet , Ahmad Berjaoui , Ziad Kheil , Elizabeth Cohen-Jonathan Moyal

AI algorithms have become valuable in aiding professionals in healthcare. The increasing confidence obtained by these models is helpful in critical decision demands. In clinical dermatology, classification models can detect malignant…

In view of the recent paradigm shift in deep AI based image processing methods, medical image processing has advanced considerably. In this study, we propose a novel deep neural network (DNN), entitled InceptNet, in the scope of medical…

Image and Video Processing · Electrical Eng. & Systems 2023-09-06 Amirhossein Sajedi , Mohammad Javad Fadaeieslam

Recent advancements in large-scale Vision Transformers have made significant strides in improving pre-trained models for medical image segmentation. However, these methods face a notable challenge in acquiring a substantial amount of…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Yiqing Wang , Zihan Li , Jieru Mei , Zihao Wei , Li Liu , Chen Wang , Shengtian Sang , Alan Yuille , Cihang Xie , Yuyin Zhou

In this work, we aim to solve data-driven optimization problems, where the goal is to find an input that maximizes an unknown score function given access to a dataset of inputs with corresponding scores. When the inputs are high-dimensional…

Machine Learning · Computer Science 2020-01-01 Aviral Kumar , Sergey Levine

With the rapid advancement of deep learning, particularly in the field of medical image analysis, an increasing number of Vision-Language Models (VLMs) are being widely applied to solve complex health and biomedical challenges. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Haiyang Yu , Siyang Yi , Ke Niu , Minghan Zhuo , Bin Li

From the simple measurement of tissue attributes in pathology workflow to designing an explainable diagnostic/prognostic AI tool, access to accurate semantic segmentation of tissue regions in histology images is a prerequisite. However,…

Image and Video Processing · Electrical Eng. & Systems 2021-08-31 Mostafa Jahanifar , Neda Zamani Tajeddin , Navid Alemi Koohbanani , Nasir Rajpoot

Active learning is a unique abstraction of machine learning techniques where the model/algorithm could guide users for annotation of a set of data points that would be beneficial to the model, unlike passive machine learning. The primary…

Computer Vision and Pattern Recognition · Computer Science 2021-01-08 Vishwesh Nath , Dong Yang , Bennett A. Landman , Daguang Xu , Holger R. Roth

In this work, we survey recent studies on masked image modeling (MIM), an approach that emerged as a powerful self-supervised learning technique in computer vision. The MIM task involves masking some information, e.g. pixels, patches, or…

Computer Vision and Pattern Recognition · Computer Science 2025-07-11 Vlad Hondru , Florinel Alin Croitoru , Shervin Minaee , Radu Tudor Ionescu , Nicu Sebe

The ability for a human to understand an Artificial Intelligence (AI) model's decision-making process is critical in enabling stakeholders to visualize model behavior, perform model debugging, promote trust in AI models, and assist in…

Machine Learning · Computer Science 2022-03-07 Yiwei Lyu , Paul Pu Liang , Zihao Deng , Ruslan Salakhutdinov , Louis-Philippe Morency