English
Related papers

Related papers: HER2 Expression Prediction with Flexible Multi-Mod…

200 papers

Survival prediction is a crucial task associated with cancer diagnosis and treatment planning. This paper presents a novel approach to survival prediction by harnessing comprehensive information from CT and PET scans, along with associated…

Image and Video Processing · Electrical Eng. & Systems 2024-10-01 Aiman Farooq , Deepak Mishra , Santanu Chaudhury

Histopathological cancer diagnostics has become more complex, and the increasing number of biopsies is a challenge for most pathology laboratories. Thus, development of automatic methods for evaluation of histopathological cancer sections…

Image and Video Processing · Electrical Eng. & Systems 2021-12-08 André Pedersen , Erik Smistad , Tor V. Rise , Vibeke G. Dale , Henrik S. Pettersen , Tor-Arne S. Nordmo , David Bouget , Ingerid Reinertsen , Marit Valla

Multimodal Emotion Recognition in Conversations (ERC) is a typical multimodal learning task in exploiting various data modalities concurrently. Prior studies on effective multimodal ERC encounter challenges in addressing modality imbalances…

Multimedia · Computer Science 2024-08-26 Cam-Van Thi Nguyen , The-Son Le , Anh-Tuan Mai , Duc-Trong Le

MRI cross-modal synthesis involves generating images from one acquisition protocol using another, offering considerable clinical value by reducing scan time while maintaining diagnostic information. This paper presents a comprehensive…

Image and Video Processing · Electrical Eng. & Systems 2026-02-10 Ali Alqutayfi , Sadam Al-Azani

Controllable text-to-image (T2I) diffusion models generate images conditioned on both text prompts and semantic inputs of other modalities like edge maps. Nevertheless, current controllable T2I methods commonly face challenges related to…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Xuehai He , Jian Zheng , Jacob Zhiyuan Fang , Robinson Piramuthu , Mohit Bansal , Vicente Ordonez , Gunnar A Sigurdsson , Nanyun Peng , Xin Eric Wang

Medical image analysis requires substantial labeled data for model training, yet expert annotation is expensive and time-consuming. Active learning (AL) addresses this challenge by strategically selecting the most informative samples for…

Image and Video Processing · Electrical Eng. & Systems 2026-03-06 Ifrat Ikhtear Uddin , Longwei Wang , Xiao Qin , Yang Zhou , KC Santosh

Multiple modalities often co-occur when describing natural phenomena. Learning a joint representation of these modalities should yield deeper and more useful representations. Previous generative approaches to multi-modal input either do not…

Machine Learning · Computer Science 2018-11-13 Mike Wu , Noah Goodman

Reliable classification of benign and malignant lesions in breast ultrasound images can provide an effective and relatively low cost method for early diagnosis of breast cancer. The accuracy of the diagnosis is however highly dependent on…

Image and Video Processing · Electrical Eng. & Systems 2021-02-24 Elham Yousef Kalaf , Ata Jodeiri , Seyed Kamaledin Setarehdan , Ng Wei Lin , Kartini Binti Rahman , Nur Aishah Taib , Sarinder Kaur Dhillon

Early detection of breast cancer through screening mammography yields a 20-35% increase in survival rate; however, there are not enough radiologists to serve the growing population of women seeking screening mammography. Although commercial…

Computer Vision and Pattern Recognition · Computer Science 2020-01-24 Stefano Pedemonte , Brent Mombourquette , Alexis Goh , Trevor Tsue , Aaron Long , Sadanand Singh , Thomas Paul Matthews , Meet Shah , Jason Su

Breast cancer has long been a prominent cause of mortality among women. Diagnosis, therapy, and prognosis are now possible, thanks to the availability of RNA sequencing tools capable of recording gene expression data. Molecular subtyping…

Machine Learning · Computer Science 2021-11-11 Sheetal Rajpal , Virendra Kumar , Manoj Agarwal , Naveen Kumar

This work introduces a novel framework for brain tumor segmentation leveraging pre-trained GANs and Unet architectures. By combining a global anomaly detection module with a refined mask generation network, the proposed model accurately…

Image and Video Processing · Electrical Eng. & Systems 2025-06-27 Qifei Cui , Xinyu Lu

The integration of quantum machine learning with classical deep learning offers promising avenues for medical image analysis by mapping data into high-dimensional Hilbert spaces. However, effectively unifying these distinct paradigms…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Yasmin Rodrigues Sobrinho , João Renato Ribeiro Manesco , João Paulo Papa

Leveraging multimodal information from Magnetic Resonance Imaging (MRI) plays a vital role in lesion segmentation, especially for brain tumors. However, in clinical practice, multimodal MRI data are often incomplete, making it challenging…

Computer Vision and Pattern Recognition · Computer Science 2026-01-01 Yulong Zou , Bo Liu , Cun-Jing Zheng , Yuan-ming Geng , Siyue Li , Qiankun Zuo , Shuihua Wang , Yudong Zhang , Jin Hong

Survival analysis plays a vital role in making clinical decisions. However, the models currently in use are often difficult to interpret, which reduces their usefulness in clinical settings. Prototype learning presents a potential solution,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-08 Shuo Jiang , Zhuwen Chen , Liaoman Xu , Yanming Zhu , Changmiao Wang , Jiong Zhang , Feiwei Qin , Yifei Chen , Zhu Zhu

We propose a novel multimodal deep learning framework for patient-level survival prediction, which integrates whole-slide histology features, RNA-seq expression profiles, and clinical variables. Our architecture combines an ABMIL…

Quantitative Methods · Quantitative Biology 2026-05-15 Hassan Keshvarikhojasteh , Josien P. W. Pluim , Mitko Veta

Medical imaging is critical for diagnostics, but clinical adoption of advanced AI-driven imaging faces challenges due to patient variability, image artifacts, and limited model generalization. While deep learning has transformed image…

Image and Video Processing · Electrical Eng. & Systems 2025-06-02 Abdul-mojeed Olabisi Ilyas , Adeleke Maradesa , Jamal Banzi , Jianpan Huang , Henry K. F. Mak , Kannie W. Y. Chan

A precise assessment of the risk of breast lesions can greatly lower it and assist physicians in choosing the best course of action. To categorise breast lesions, the majority of current computer-aided systems only use characteristics from…

Image and Video Processing · Electrical Eng. & Systems 2025-08-25 Muhaisin Tiyumba Nantogmah , Abdul-Barik Alhassan , Salamudeen Alhassan

Multimodal embedding models, built upon causal Vision Language Models (VLMs), have shown promise in various tasks. However, current approaches face three key limitations: the use of causal attention in VLM backbones is suboptimal for…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Haonan Chen , Hong Liu , Yuping Luo , Liang Wang , Nan Yang , Furu Wei , Zhicheng Dou

Multimodal medical image segmentation faces significant challenges in the context of gastric cancer lesion analysis. This clinical context is defined by the scarcity of independent multimodal datasets and the imperative to amalgamate…

Image and Video Processing · Electrical Eng. & Systems 2025-05-28 Jiaming Liang , Lihuan Dai , Xiaoqi Sheng , Xiangguang Chen , Chun Yao , Guihua Tao , Qibin Leng , Hongmin Cai , Xi Zhong

Medical image-to-image (I2I) translation enables virtual scanning, i.e. the synthesis of a target imaging modality from a source one without additional acquisitions. Despite growing interest, most proposed methods operate on 2D slices, are…