English
Related papers

Related papers: Using Multi-modal Data for Improving Generalizabil…

200 papers

Deep learning is a branch of artificial intelligence where networks of simple interconnected units are used to extract patterns from data in order to solve complex problems. Deep learning algorithms have shown groundbreaking performance in…

Computer Vision and Pattern Recognition · Computer Science 2018-02-27 Maciej A. Mazurowski , Mateusz Buda , Ashirbani Saha , Mustafa R. Bashir

Multi-modal ophthalmic image classification plays a key role in diagnosing eye diseases, as it integrates information from different sources to complement their respective performances. However, recent improvements have mainly focused on…

Image and Video Processing · Electrical Eng. & Systems 2024-05-29 Ke Zou , Tian Lin , Zongbo Han , Meng Wang , Xuedong Yuan , Haoyu Chen , Changqing Zhang , Xiaojing Shen , Huazhu Fu

Recently, a variety of approaches has been enriching the field of Remote Sensing (RS) image processing and analysis. Unfortunately, existing methods remain limited faced to the rich spatio-spectral content of today's large datasets. It…

Computer Vision and Pattern Recognition · Computer Science 2018-08-15 Amina Ben Hamida , A Benoit , Patrick Lambert , Chokri Ben Amar

Eye trackers can provide visual guidance to sonographers during ultrasound (US) scanning. Such guidance is potentially valuable for less experienced operators to improve their scanning skills on how to manipulate the probe to achieve the…

Computer Vision and Pattern Recognition · Computer Science 2022-07-27 Qianhui Men , Clare Teng , Lior Drukker , Aris T. Papageorghiou , J. Alison Noble

Although deep learning models for chest X-ray interpretation are commonly trained on labels generated by automatic radiology report labelers, the impact of improvements in report labeling on the performance of chest X-ray classification…

Image and Video Processing · Electrical Eng. & Systems 2021-11-30 Saahil Jain , Akshay Smit , Andrew Y. Ng , Pranav Rajpurkar

Deep learning (DL) has remarkably impacted several different scientific disciplines over the last few years. E.g., in image processing and analysis, DL algorithms were able to outperform other cutting-edge methods. Additionally, DL has…

Image and Video Processing · Electrical Eng. & Systems 2022-05-19 Jan Egger , Christina Gsaxner , Antonio Pepe , Kelsey L. Pomykala , Frederic Jonske , Manuel Kurz , Jianning Li , Jens Kleesiek

Deep learning semantic segmentation algorithms can localise abnormalities or opacities from chest radiographs. However, the task of collecting and annotating training data is expensive and requires expertise which remains a bottleneck for…

Image and Video Processing · Electrical Eng. & Systems 2021-02-26 Jitesh Seth , Rohit Lokwani , Viraj Kulkarni , Aniruddha Pant , Amit Kharat

Vision-language pre-training has recently gained popularity as it allows learning rich feature representations using large-scale data sources. This paradigm has quickly made its way into the medical image analysis community. In particular,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Julio Silva-Rodríguez , Jose Dolz , Ismail Ben Ayed

We systematically evaluate a Deep Learning (DL) method in a 3D medical image segmentation task. Our segmentation method is integrated into the radiosurgery treatment process and directly impacts the clinical workflow. With our method, we…

Image and Video Processing · Electrical Eng. & Systems 2021-08-24 Boris Shirokikh , Alexandra Dalechina , Alexey Shevtsov , Egor Krivov , Valery Kostjuchenko , Amayak Durgaryan , Mikhail Galkin , Andrey Golanov , Mikhail Belyaev

Much effort is being made by the researchers in order to detect and diagnose diabetic retinopathy (DR) accurately automatically. The disease is very dangerous as it can cause blindness suddenly if it is not continuously screened. Therefore,…

Image and Video Processing · Electrical Eng. & Systems 2020-12-24 Eman AbdelMaksoud , Sherif Barakat , Mohammed Elmogy

There is growing interest in applying AI to radiology report generation, particularly for chest X-rays (CXRs). This paper investigates whether incorporating pixel-level information through segmentation masks can improve fine-grained image…

In the context of classification problems, Deep Learning (DL) approaches represent state of art. Many DL approaches are based on variations of standard multi-layer feed-forward neural networks. These are also referred to as deep networks.…

Machine Learning · Computer Science 2023-11-21 Andrea Apicella , Francesco Isgrò , Roberto Prevete

Medical imaging provides essential visual insights for diagnosis, and multimodal large language models (MLLMs) are increasingly utilized for its analysis due to their strong generalization capabilities; however, the underlying factors…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Zhenyang Cai , Junying Chen , Rongsheng Wang , Weihong Wang , Yonglin Deng , Dingjie Song , Yize Chen , Zixu Zhang , Benyou Wang

Numerous studies are aimed at diagnosing heart diseases based on 12-lead electrocardiographic (ECG) records using deep learning methods. These studies usually use specific datasets that differ in size and parameters, such as patient…

Signal Processing · Electrical Eng. & Systems 2023-05-31 Aram Avetisyan , Shahane Tigranyan , Ariana Asatryan , Olga Mashkova , Sergey Skorik , Vladislav Ananev , Yury Markin

In this work, we present RadGazeGen, a novel framework for integrating experts' eye gaze patterns and radiomic feature maps as controls to text-to-image diffusion models for high fidelity medical image generation. Despite the recent success…

Computer Vision and Pattern Recognition · Computer Science 2024-10-02 Moinak Bhattacharya , Gagandeep Singh , Shubham Jain , Prateek Prasanna

The diagnosis, prognosis, and treatment of patients with musculoskeletal (MSK) disorders require radiology imaging (using computed tomography, magnetic resonance imaging(MRI), and ultrasound) and their precise analysis by expert…

Image and Video Processing · Electrical Eng. & Systems 2020-03-03 Ismail Irmakci , Syed Muhammad Anwar , Drew A. Torigian , Ulas Bagci

Deep Learning has implemented a wide range of applications and has become increasingly popular in recent years. The goal of multimodal deep learning (MMDL) is to create models that can process and link information using various modalities.…

Machine Learning · Computer Science 2022-02-21 Jabeen Summaira , Xi Li , Amin Muhammad Shoib , Jabbar Abdul

Recently, Geometric Deep Learning (GDL) has been introduced as a novel and versatile framework for computer-aided disease classification. GDL uses patient meta-information such as age and gender to model patient cohort relations in a graph…

Machine Learning · Computer Science 2020-05-05 Hendrik Burwinkel , Anees Kazi , Gerome Vivar , Shadi Albarqouni , Guillaume Zahnd , Nassir Navab , Seyed-Ahmad Ahmadi

Although deep learning-based computer-aided diagnosis systems have recently achieved expert-level performance, developing a robust deep learning model requires large, high-quality data with manual annotation, which is expensive to obtain.…

Image and Video Processing · Electrical Eng. & Systems 2022-10-12 Sangjoon Park , Gwanghyun Kim , Yujin Oh , Joon Beom Seo , Sang Min Lee , Jin Hwan Kim , Sungjun Moon , Jae-Kwang Lim , Chang Min Park , Jong Chul Ye

Understanding the internal physiological changes accompanying the aging process is an important aspect of medical image interpretation, with the expected changes acting as a baseline when reporting abnormal findings. Deep learning has…

Image and Video Processing · Electrical Eng. & Systems 2022-07-05 Matthew MacPherson , Keerthini Muthuswamy , Ashik Amlani , Charles Hutchinson , Vicky Goh , Giovanni Montana