English
Related papers

Related papers: Joint Sequence Learning and Cross-Modality Convolu…

200 papers

We consider referring image segmentation. It is a problem at the intersection of computer vision and natural language understanding. Given an input image and a referring expression in the form of a natural language sentence, the goal is to…

Computer Vision and Pattern Recognition · Computer Science 2020-02-03 Linwei Ye , Zhi Liu , Yang Wang

In the field of medical imaging, AI-assisted techniques such as object detection, segmentation, and classification are widely employed to alleviate the workload of physicians and doctors. However, single-task models are predominantly used,…

Image and Video Processing · Electrical Eng. & Systems 2025-11-18 Fan Li , Arun Iyengar , Lanyu Xu

This paper introduces an innovative multi-modal fusion deep learning approach to overcome the drawbacks of traditional single-modal recognition techniques. These drawbacks include incomplete information and limited diagnostic accuracy.…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Xiaoyi Liu , Hongjie Qiu , Muqing Li , Zhou Yu , Yutian Yang , Yafeng Yan

Recent advancements in medical image segmentation techniques have achieved compelling results. However, most of the widely used approaches do not take into account any prior knowledge about the shape of the biomedical structures being…

Image and Video Processing · Electrical Eng. & Systems 2019-09-18 Zhou He , Siqi Bao , Albert Chung

Over the last decade, convolutional neural networks have emerged and advanced the state-of-the-art in various image analysis and computer vision applications. The performance of 2D image classification networks is constantly improving and…

Image and Video Processing · Electrical Eng. & Systems 2023-08-01 Hicham Messaoudi , Ahror Belaid , Douraied Ben Salem , Pierre-Henri Conze

Multimodal MRI provides critical complementary information for accurate brain tumor segmentation. However, conventional methods struggle when certain modalities are missing due to issues such as image quality, protocol inconsistencies,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-03 Runze Cheng , Xihang Qiu , Ming Li , Ye Zhang , Chun Li , Fei Yu

Traditional brain lesion segmentation models for multi-modal MRI are typically tailored to specific pathologies, relying on datasets with predefined modalities. Adapting to new MRI modalities or pathologies often requires training separate…

Image and Video Processing · Electrical Eng. & Systems 2025-07-25 Yousef Sadegheih , Pratibha Kumari , Dorit Merhof

The brain tumor segmentation task aims to classify tissue into the whole tumor (WT), tumor core (TC), and enhancing tumor (ET) classes using multimodel MRI images. Quantitative analysis of brain tumors is critical for clinical decision…

Image and Video Processing · Electrical Eng. & Systems 2020-12-15 Saqib Qamar , Parvez Ahmad , Linlin Shen

Deep learning (DL) models for disease classification or segmentation from medical images are increasingly trained using transfer learning (TL) from unrelated natural world images. However, shortcomings and utility of TL for specialized…

Machine Learning · Statistics 2021-11-11 Sambuddha Ghosal , Pratik Shah

People can recognize scenes across many different modalities beyond natural images. In this paper, we investigate how to learn cross-modal scene representations that transfer across modalities. To study this problem, we introduce a new…

Computer Vision and Pattern Recognition · Computer Science 2016-07-26 Lluis Castrejon , Yusuf Aytar , Carl Vondrick , Hamed Pirsiavash , Antonio Torralba

In clinical practice, medical segmentation datasets are often limited and heterogeneous, with variations in modalities, protocols, and anatomical targets across institutions. Existing deep learning models struggle to jointly learn from such…

Computer Vision and Pattern Recognition · Computer Science 2026-01-22 Weiwei Ma , Xiaobing Yu , Peijie Qiu , Jin Yang , Pan Xiao , Xiaoqi Zhao , Xiaofeng Liu , Tomo Miyazaki , Shinichiro Omachi , Yongsong Huang

Fully convolutional neural networks (CNNs) have proven to be effective at representing and classifying textural information, thus transforming image intensity into output class masks that achieve semantic image segmentation. In medical…

Computer Vision and Pattern Recognition · Computer Science 2019-09-12 Ali Hatamizadeh , Demetri Terzopoulos , Andriy Myronenko

Convolutional Neural Networks (CNNs) have achieved promising results in medical image segmentation. However, CNNs require lots of training data and are incapable of handling pose and deformation of objects. Furthermore, their pooling layers…

Computer Vision and Pattern Recognition · Computer Science 2022-06-28 Minh Tran , Viet-Khoa Vo-Ho , Ngan T. H. Le

Live cell microscopy sequences exhibit complex spatial structures and complicated temporal behaviour, making their analysis a challenging task. Considering cell segmentation problem, which plays a significant role in the analysis, the…

Computer Vision and Pattern Recognition · Computer Science 2019-01-08 Assaf Arbelle , Tammy Riklin Raviv

We propose a unified cross-domain transfer learning framework that leverages knowledge from multiple heterogeneous medical imaging datasets to improve performance across segmentation, classification, and object detection tasks. Our approach…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Ceausescu Ciprian-Mihai , Anghelina Ion-Marian , Alexe Dumitru-Bogdan

We propose a 3D convolutional neural network to simultaneously segment and detect cell nuclei in confocal microscopy images. Mirroring the co-dependency of these tasks, our proposed model consists of two serial components: the first part…

Image and Video Processing · Electrical Eng. & Systems 2018-09-07 Sundaresh Ram , Vicky T. Nguyen , Kirsten H. Limesand , Mert R. Sabuncu

Models for segmentation of brain lesions in multi-modal MRI are commonly trained for a specific pathology using a single database with a predefined set of MRI modalities, determined by a protocol for the specific disease. This work explores…

Multimodal Magnetic Resonance Imaging (MRI) provides essential complementary information for analyzing brain tumor subregions. While methods using four common MRI modalities for automatic segmentation have shown success, they often face…

Image and Video Processing · Electrical Eng. & Systems 2024-11-14 Runze Cheng , Zhongao Sun , Ye Zhang , Chun Li

Deep learning has become a valuable tool for the automation of certain medical image segmentation tasks, significantly relieving the workload of medical specialists. Some of these tasks require segmentation to be performed on a subset of…

Image and Video Processing · Electrical Eng. & Systems 2024-02-06 José Morano , Guilherme Aresta , Dmitrii Lachinov , Julia Mai , Ursula Schmidt-Erfurth , Hrvoje Bogunović

Fully convolutional neural networks have made promising progress in joint liver and liver tumor segmentation. Instead of following the debates over 2D versus 3D networks (for example, pursuing the balance between large-scale 2D pretraining…

Image and Video Processing · Electrical Eng. & Systems 2022-03-09 Shuxin Wang , Shilei Cao , Zhizhong Chai , Dong Wei , Kai Ma , Liansheng Wang , Yefeng Zheng