English
Related papers

Related papers: Using Multi-modal Data for Improving Generalizabil…

200 papers

Mirroring its ubiquity in popular media and all human activities, the use of deep learning (DL) is rapidly growing in scientific imaging modalities. However, unlike everyday RGB pictures, pixels encode precise physicochemical properties in…

Computer Vision and Pattern Recognition · Computer Science 2026-05-07 Ji-Hun Oh , Dou Hoon Kwark , Kianoush Falahkheirkhah , Kevin Yeh , John Cheville , Volodymyr Kindratenko , Rohit Bhargava

The vision-language modeling capability of multi-modal large language models has attracted wide attention from the community. However, in medical domain, radiology report generation using vision-language models still faces significant…

Computer Vision and Pattern Recognition · Computer Science 2024-08-23 Yuhao Wang , Chao Hao , Yawen Cui , Xinqi Su , Weicheng Xie , Tao Tan , Zitong Yu

Managing fluid balance in dialysis patients is crucial, as improper management can lead to severe complications. In this paper, we propose a multimodal approach that integrates visual features from lung ultrasound images with clinical data…

Image and Video Processing · Electrical Eng. & Systems 2024-10-04 Tianqi Yang , Nantheera Anantrasirichai , Oktay Karakuş , Marco Allinovi , Alin Achim

Automatic radiology reporting has great clinical potential to relieve radiologists from heavy workloads and improve diagnosis interpretation. Recently, researchers have enhanced data-driven neural networks with medical knowledge graphs to…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Mingjie Li , Bingqian Lin , Zicong Chen , Haokun Lin , Xiaodan Liang , Xiaojun Chang

Tools, models and statistical methods for signal processing and medical image analysis and training deep learning models to create research prototypes for eventual clinical applications are of special interest to the biomedical imaging…

Image and Video Processing · Electrical Eng. & Systems 2023-12-22 Pratik Shah , Jenna Lester , Jana G Deflino , Vinay Pai

While deep learning has shown promise in the domain of disease classification from medical images, models based on state-of-the-art convolutional neural network architectures often exhibit performance loss due to dataset shift. Models…

Machine Learning · Computer Science 2020-01-14 Joseph D. Janizek , Gabriel Erion , Alex J. DeGrave , Su-In Lee

Deep Learning (DL) have greatly contributed to bioelectric signals processing, in particular to extract physiological markers. However, the efficacy and applicability of the results proposed in the literature is often constrained to the…

Machine Learning · Statistics 2021-10-27 Andrea Bizzego , Giulio Gabrieli , Michelle Jin-Yee Neoh , Gianluca Esposito

The integration of multi-modal Magnetic Resonance Imaging (MRI) and clinical data holds great promise for enhancing the diagnosis of neurological disorders (NDs) in real-world clinical settings. Deep Learning (DL) has recently emerged as a…

Image and Video Processing · Electrical Eng. & Systems 2025-06-19 Wajih Hassan Raza , Aamir Bader Shah , Yu Wen , Yidan Shen , Juan Diego Martinez Lemus , Mya Caryn Schiess , Timothy Michael Ellmore , Renjie Hu , Xin Fu

Cancer has relational information residing at varying scales, modalities, and resolutions of the acquired data, such as radiology, pathology, genomics, proteomics, and clinical records. Integrating diverse data types can improve the…

Machine Learning · Computer Science 2024-07-29 Asim Waqas , Aakash Tripathi , Ravi P. Ramachandran , Paul Stewart , Ghulam Rasool

Deep reinforcement learning has been extensively studied in decision-making processes and has demonstrated superior performance over conventional approaches in various fields, including radar resource management (RRM). However, a notable…

Machine Learning · Computer Science 2025-06-27 Ziyang Lu , M. Cenk Gursoy , Chilukuri K. Mohan , Pramod K. Varshney

Several reasons explain the significant role that chest X-rays play on supporting clinical analysis and early disease detection in pediatric patients, such as low cost, high resolution, low radiation levels, and high availability. In the…

Other Computer Science · Computer Science 2020-10-08 Afonso U. Fonseca , Gabriel S. Vieira , Fabrízzio A. A. M. N. Soares , Renato F. Bulcão-Neto

Electroencephalography (EEG) is a complex signal and can require several years of training to be correctly interpreted. Recently, deep learning (DL) has shown great promise in helping make sense of EEG signals due to its capacity to learn…

Machine Learning · Computer Science 2019-01-23 Yannick Roy , Hubert Banville , Isabela Albuquerque , Alexandre Gramfort , Tiago H. Falk , Jocelyn Faubert

Deep learning (DL) powered biomedical ultrasound imaging is an emerging research field where researchers adapt the image analysis capabilities of DL algorithms to biomedical ultrasound imaging settings. A major roadblock to wider adoption…

Image and Video Processing · Electrical Eng. & Systems 2023-01-16 Ufuk Soylu , Michael L. Oelze

Computer-assisted diagnostic and prognostic systems of the future should be capable of simultaneously processing multimodal data. Multimodal deep learning (MDL), which involves the integration of multiple sources of data, such as images and…

Computer Vision and Pattern Recognition · Computer Science 2023-10-20 Zhaoyi Sun , Mingquan Lin , Qingqing Zhu , Qianqian Xie , Fei Wang , Zhiyong Lu , Yifan Peng

Multimodal deep learning utilizing imaging and diagnostic reports has made impressive progress in the field of medical imaging diagnostics, demonstrating a particularly strong capability for auxiliary diagnosis in cases where sufficient…

Computer Vision and Pattern Recognition · Computer Science 2024-08-21 Hao Yang , Hong-Yu Zhou , Cheng Li , Weijian Huang , Jiarun Liu , Yong Liang , Guangming Shi , Hairong Zheng , Qiegen Liu , Shanshan Wang

Developing an interpretable system for generating reports in chest X-ray (CXR) analysis is becoming increasingly crucial in Computer-aided Diagnosis (CAD) systems, enabling radiologists to comprehend the decisions made by these systems.…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Trong Thang Pham , Ngoc-Vuong Ho , Nhat-Tan Bui , Thinh Phan , Patel Brijesh , Donald Adjeroh , Gianfranco Doretto , Anh Nguyen , Carol C. Wu , Hien Nguyen , Ngan Le

Deep learning has advanced medical image classification, but interpretability challenges hinder its clinical adoption. This study enhances interpretability in Chest X-ray (CXR) classification by using concept bottleneck models (CBMs) and a…

Information Retrieval · Computer Science 2025-04-30 Hasan Md Tusfiqur Alam , Devansh Srivastav , Md Abdul Kadir , Daniel Sonntag

Obtaining large-scale radiology reports can be difficult for medical images due to various reasons, limiting the effectiveness of contrastive pre-training in the medical image domain and underscoring the need for alternative methods. In…

Computer Vision and Pattern Recognition · Computer Science 2023-12-13 Zihao Zhao , Sheng Wang , Qian Wang , Dinggang Shen

Existing deep learning models for chest radiology often neglect patient metadata, limiting diagnostic accuracy and fairness. To bridge this gap, we introduce MetaCheX, a novel multimodal framework that integrates chest X-ray images with…

Image and Video Processing · Electrical Eng. & Systems 2025-09-17 Nathan He , Cody Chen

Deep learning techniques hold immense promise for advancing medical image analysis, particularly in tasks like image segmentation, where precise annotation of regions or volumes of interest within medical images is crucial but manually…

‹ Prev 1 4 5 6 7 8 10 Next ›