English
Related papers

Related papers: ManiNeg: Manifestation-guided Multimodal Pretraini…

200 papers

Although fusion of information from multiple views of mammograms plays an important role to increase accuracy of breast cancer detection, developing multi-view mammograms-based computer-aided diagnosis (CAD) schemes still faces challenges…

Computer Vision and Pattern Recognition · Computer Science 2024-04-25 Xuxin Chen , Yuheng Li , Mingzhe Hu , Ella Salari , Xiaoqian Chen , Richard L. J. Qiu , Bin Zheng , Xiaofeng Yang

Medicine is inherently a multimodal discipline. Medical images can reflect the pathological changes of cancer and tumors, while the expression of specific genes can influence their morphological characteristics. However, most deep learning…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Jiaying Zhou , Mingzhou Jiang , Junde Wu , Jiayuan Zhu , Ziyue Wang , Yueming Jin

Breast cancer is a major cause of cancer death among women, emphasising the importance of early detection for improved treatment outcomes and quality of life. Mammography, the primary diagnostic imaging test, poses challenges due to the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-03 Yijun Yang , Shujun Wang , Lihao Liu , Sarah Hickman , Fiona J Gilbert , Carola-Bibiane Schönlieb , Angelica I. Aviles-Rivero

Contrastive learning has gained popularity due to its robustness with good feature representation performance. However, cosine distance, the commonly used similarity metric in contrastive learning, is not well suited to represent the…

Computer Vision and Pattern Recognition · Computer Science 2023-06-27 Jing Wei Tan , Won-Ki Jeong

Medical imaging is an essential tool in many areas of medical applications, used for both diagnosis and treatment. However, reading medical images and making diagnosis or treatment recommendations require specially trained medical…

Computer Vision and Pattern Recognition · Computer Science 2019-03-13 Wentao Zhu

Multi-label image classification presents a challenging task in many domains, including computer vision and medical imaging. Recent advancements have introduced graph-based and transformer-based methods to improve performance and capture…

Computer Vision and Pattern Recognition · Computer Science 2024-04-15 Ahmad Sajedi , Samir Khaki , Yuri A. Lawryshyn , Konstantinos N. Plataniotis

Computer-aided breast cancer diagnosis in mammography is a challenging problem, stemming from mammographical data scarcity and data entanglement. In particular, data scarcity is attributed to the privacy and expensive annotation. And data…

Computer Vision and Pattern Recognition · Computer Science 2021-01-01 Heyi Li , Dongdong Chen , William H. Nailon , Mike E. Davies , David Laurenson

Self-supervised contrastive learning between pairs of multiple views of the same image has been shown to successfully leverage unlabeled data to produce meaningful visual representations for both natural and medical images. However, there…

Image and Video Processing · Electrical Eng. & Systems 2021-10-19 Yen Nhi Truong Vu , Richard Wang , Niranjan Balachandar , Can Liu , Andrew Y. Ng , Pranav Rajpurkar

A pre-trained visual-language model, contrastive language-image pre-training (CLIP), successfully accomplishes various downstream tasks with text prompts, such as finding images or localizing regions within the image. Despite CLIP's strong…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 YeongHyeon Park , Myung Jin Kim , Hyeong Seok Kim

Multi-instance multi-label (MIML) learning is a challenging problem in many aspects. Such learning approaches might be useful for many medical diagnosis applications including breast cancer detection and classification. In this study subset…

Computer Vision and Pattern Recognition · Computer Science 2015-10-13 Baris Gecer , Ozge Yalcinkaya , Onur Tasar , Selim Aksoy

Data scarcity and class imbalance are two fundamental challenges in many machine learning applications to healthcare. Breast cancer classification in mammography exemplifies these challenges, with a malignancy rate of around 0.5% in a…

Image and Video Processing · Electrical Eng. & Systems 2020-06-02 Eric Wu , Kevin Wu , William Lotter

Model-agnostic meta-learning (MAML) is one of the most popular and widely adopted meta-learning algorithms, achieving remarkable success in various learning problems. Yet, with the unique design of nested inner-loop and outer-loop updates,…

Machine Learning · Computer Science 2022-03-15 Chia-Hsiang Kao , Wei-Chen Chiu , Pin-Yu Chen

Mammograms are commonly employed in the large scale screening of breast cancer which is primarily characterized by the presence of malignant masses. However, automated image-level detection of malignancy is a challenging task given the…

Computer Vision and Pattern Recognition · Computer Science 2020-04-27 Sarath Chandra K , Arunava Chakravarty , Nirmalya Ghosh , Tandra Sarkar , Ramanathan Sethuraman , Debdoot Sheet

In the last few years, deep learning classifiers have shown promising results in image-based medical diagnosis. However, interpreting the outputs of these models remains a challenge. In cancer diagnosis, interpretability can be achieved by…

Computer Vision and Pattern Recognition · Computer Science 2021-06-16 Kangning Liu , Yiqiu Shen , Nan Wu , Jakub Chłędowski , Carlos Fernandez-Granda , Krzysztof J. Geras

Breast cancer is one of the leading causes of cancer deaths in women. As the primary output of breast screening, breast ultrasound (US) video contains exclusive dynamic information for cancer diagnosis. However, training models for video…

Computer Vision and Pattern Recognition · Computer Science 2022-09-13 Zehui Lin , Ruobing Huang , Dong Ni , Jiayi Wu , Baoming Luo

Accurate segmentation of laryngo-pharyngeal tumors is crucial for precise diagnosis and effective treatment planning. However, traditional single-modality imaging methods often fall short of capturing the complex anatomical and pathological…

Image and Video Processing · Electrical Eng. & Systems 2025-08-26 Junhao Wu , Yun Li , Junhao Li , Jingliang Bian , Xiaomao Fan , Wenbin Lei , Ruxin Wang

Learning medical visual representations directly from paired images and reports through multimodal self-supervised learning has emerged as a novel and efficient approach to digital diagnosis in recent years. However, existing models suffer…

Computer Vision and Pattern Recognition · Computer Science 2025-06-16 Libin Lan , Hongxing Li , Zunhui Xia , Juan Zhou , Xiaofei Zhu , Yongmei Li , Yudong Zhang , Xin Luo

Traditional supervised learning with deep neural networks requires a tremendous amount of labelled data to converge to a good solution. For 3D medical images, it is often impractical to build a large homogeneous annotated dataset for a…

Hand-crafted features extracted from dynamic contrast-enhanced magnetic resonance images (DCE-MRIs) have shown strong predictive abilities in characterization of breast lesions. However, heterogeneity across medical image datasets hinders…

Medical Physics · Physics 2017-01-17 Natalia Antropova , Benjamin Huynh , Maryellen Giger

Multimodal learning aims to imitate human beings to acquire complementary information from multiple modalities for various downstream tasks. However, traditional aggregation-based multimodal fusion methods ignore the inter-modality…

Computer Vision and Pattern Recognition · Computer Science 2023-05-17 Heqing Zou , Meng Shen , Chen Chen , Yuchen Hu , Deepu Rajan , Eng Siong Chng