English
Related papers

Related papers: PIMMS: Permutation Invariant Multi-Modal Segmentat…

200 papers

Large language models (LLMs) have enabled the creation of multi-modal LLMs that exhibit strong comprehension of visual data such as images and videos. However, these models usually rely on extensive visual tokens from visual encoders,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-30 Yiwu Zhong , Zhuoming Liu , Yin Li , Liwei Wang

Recently, masked image modeling (MIM) has gained considerable attention due to its capacity to learn from vast amounts of unlabeled data and has been demonstrated to be effective on a wide variety of vision tasks involving natural images.…

Computer Vision and Pattern Recognition · Computer Science 2022-08-25 Zekai Chen , Devansh Agarwal , Kshitij Aggarwal , Wiem Safta , Samit Hirawat , Venkat Sethuraman , Mariann Micsinai Balan , Kevin Brown

Image segmentation is often performed on medical images for identifying diseases in clinical evaluation. Hence it has become one of the major research areas. Conventional image segmentation techniques are unable to provide satisfactory…

Computer Vision and Pattern Recognition · Computer Science 2017-02-13 Pratik Kalshetti , Manas Bundele , Parag Rahangdale , Dinesh Jangra , Chiranjoy Chattopadhyay , Gaurav Harit , Abhay Elhence

In tissue characterization and cancer diagnostics, multimodal imaging has emerged as a powerful technique. Thanks to computational advances, large datasets can be exploited to discover patterns in pathologies and improve diagnosis. However,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Eva Breznik , Elisabeth Wetzer , Joakim Lindblad , Nataša Sladoje

Most medical image lesion segmentation methods rely on hand-crafted accurate annotations of the original image for supervised learning. Recently, a series of weakly supervised or unsupervised methods have been proposed to reduce the…

Computer Vision and Pattern Recognition · Computer Science 2024-06-24 Jiawei Chen , Dingkang Yang , Yuxuan Lei , Lihua Zhang

Synthesizing missing modalities in multi-modal magnetic resonance imaging (MRI) is vital for ensuring diagnostic completeness, particularly when full acquisitions are infeasible due to time constraints, motion artifacts, and patient…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Yue Zhang , Zhizheng Zhuo , Siyao Xu , Shan Lv , Zhaoxi Liu , Jun Qiu , Qiuli Wang , Yaou Liu , S. Kevin Zhou

Semi-supervised learning (SSL) has made notable advancements in medical image segmentation (MIS), particularly in scenarios with limited labeled data and significantly enhancing data utilization efficiency. Previous methods primarily focus…

Computer Vision and Pattern Recognition · Computer Science 2024-11-25 Mengzhu Wang , Jiao Li , Houcheng Su , Nan Yin , Liang Yang , Shen Li

Imaging with multiple modalities or multiple channels is becoming increasingly important for our modern society. A key tool for understanding and early diagnosis of cancer and dementia is PET-MR, a combined positron emission tomography and…

Image and Video Processing · Electrical Eng. & Systems 2020-07-24 Matthias J. Ehrhardt

Medical image segmentation is a cornerstone of computer-assisted diagnosis and treatment planning. While recent multimodal vision-language models have shown promise in enhancing semantic understanding through textual descriptions, their…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Saivan Talaei , Fatemeh Daneshfar , Abdulhady Abas Abdullah , Mustaqeem Khan

Automated identification of DICOM image series is essential for large-scale medical image analysis, quality control, protocol harmonization, and reliable downstream processing. However, DICOM series classification remains challenging due to…

Image and Video Processing · Electrical Eng. & Systems 2026-05-22 Tuan Truong , Melanie Dohmen , Sara Lorio , Matthias Lenga

With the increasing amounts of high-dimensional heterogeneous data to be processed, multi-modality feature selection has become an important research direction in medical image analysis. Traditional methods usually depict the data structure…

Computer Vision and Pattern Recognition · Computer Science 2022-04-11 Yuang Shi , Chen Zu , Mei Hong , Luping Zhou , Lei Wang , Xi Wu , Jiliu Zhou , Daoqiang Zhang , Yan Wang

With the development of Deep Neural Networks (DNNs), many efforts have been made to handle medical image segmentation. Traditional methods such as nnUNet train specific segmentation models on the individual datasets. Plenty of recent…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Xiaobao Wei , Jiajun Cao , Yizhu Jin , Ming Lu , Guangyu Wang , Shanghang Zhang

Digital whole slides images contain an enormous amount of information providing a strong motivation for the development of automated image analysis tools. Particularly deep neural networks show high potential with respect to various tasks…

Computer Vision and Pattern Recognition · Computer Science 2023-12-07 Michael Gadermayr , Maximilian Tschuchnig

As the rapid development of computer vision and the emergence of powerful network backbones and architectures, the application of deep learning in medical imaging has become increasingly significant. Unlike natural images, medical images…

Image and Video Processing · Electrical Eng. & Systems 2026-04-10 Guoqing Zhang , Jingyun Yang , Yang Li

Multi-view segmentation in Remote Sensing (RS) seeks to segment images from diverse perspectives within a scene. Recent methods leverage 3D information extracted from an Implicit Neural Field (INF), bolstering result consistency across…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Zipeng Qi , Chenyang Liu , Zili Liu , Hao Chen , Yongchang Wu , Zhengxia Zou , Zhenwei Sh

Imaging techniques is widely used for medical diagnostics. This leads in some cases to a real bottleneck when there is a lack of medical practitioners and the images have to be manually processed. In such a situation there is a need to…

Image and Video Processing · Electrical Eng. & Systems 2019-08-16 Samuel Gunz , Svenja Erne , Eric J. Rawdon , Garyfalia Ampanozi , Till Sieberth , Raffael Affolter , Lars C. Ebert , Akos Dobay

The separation of the data capture and analysis in modern vision systems has led to a massive amount of data transfer between the end devices and cloud computers, resulting in long latency, slow response, and high power consumption.…

Image and Video Processing · Electrical Eng. & Systems 2024-08-13 Ruibing Song , Kejie Huang , Zongsheng Wang , Haibin Shen

Unsupervised image segmentation aims at assigning the pixels with similar feature into a same cluster without annotation, which is an important task in computer vision. Due to lack of prior knowledge, most of existing model usually need to…

Computer Vision and Pattern Recognition · Computer Science 2020-12-17 Zhichao Wu , Lei Guo , Hao Zhang , Dan Xu

Brain tumor segmentation is often based on multiple magnetic resonance imaging (MRI). However, in clinical practice, certain modalities of MRI may be missing, which presents an even more difficult scenario. To cope with this challenge,…

Image and Video Processing · Electrical Eng. & Systems 2025-01-16 Tianyi Liu , Zhaorui Tan , Haochuan Jiang , Xi Yang , Kaizhu Huang

Unmanned aircraft have decreased the cost required to collect remote sensing imagery, which has enabled researchers to collect high-spatial resolution data from multiple sensor modalities more frequently and easily. The increase in data…

Computer Vision and Pattern Recognition · Computer Science 2017-03-07 Ronald Kemker , Carl Salvaggio , Christopher Kanan