English
Related papers

Related papers: MCAD: Multi-modal Conditioned Adversarial Diffusio…

200 papers

Diffusion models have recently emerged as powerful priors for solving inverse problems. While computed tomography (CT) is theoretically a linear inverse problem, it poses many practical challenges. These include correlated noise, artifact…

Image and Video Processing · Electrical Eng. & Systems 2026-02-24 Jiayang Shi , Daniel M. Pelt , K. Joost Batenburg

Despite their success, unsupervised domain adaptation methods for semantic segmentation primarily focus on adaptation between image domains and do not utilize other abundant visual modalities like depth, infrared and event. This limitation…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Ruihao Xia , Yu Liang , Peng-Tao Jiang , Hao Zhang , Bo Li , Yang Tang , Pan Zhou

Accurate identification of agricultural pests is essential for crop protection but remains challenging due to the large intra-class variance and fine-grained differences among pest species. While deep learning has advanced pest detection,…

Artificial Intelligence · Computer Science 2025-05-06 Jiaqi Zhang , Zhuodong Liu , Kejian Yu

Multimodal diffusion models for image editing generate outputs conditioned on both textual instructions and visual inputs, aiming to modify target regions while preserving the rest of the image. Although diffusion models have been shown to…

Cryptography and Security · Computer Science 2025-06-02 Ji Guo , Peihong Chen , Wenbo Jiang , Xiaolei Wen , Jiaming He , Jiachen Li , Guoming Lu , Aiguo Chen , Hongwei Li

High-quality, high-resolution medical imaging is essential for clinical care. Raman-based biomedical optical imaging uses non-ionizing infrared radiation to evaluate human tissues in real time and is used for early cancer detection, brain…

Image and Video Processing · Electrical Eng. & Systems 2024-12-19 Yiwei Lyu , Sung Jik Cha , Cheng Jiang , Asadur Chowdury , Xinhai Hou , Edward Harake , Akhil Kondepudi , Christian Freudiger , Honglak Lee , Todd C. Hollon

Medical image segmentation is a critical step in computer-aided diagnosis, and convolutional neural networks are popular segmentation networks nowadays. However, the inherent local operation characteristics make it difficult to focus on the…

Computer Vision and Pattern Recognition · Computer Science 2023-05-18 Fenghe Tang , Jianrui Ding , Lingtao Wang , Min Xian , Chunping Ning

Multi-modal skin lesion diagnosis (MSLD) has achieved remarkable success by modern computer-aided diagnosis (CAD) technology based on deep convolutions. However, the information aggregation across modalities in MSLD remains challenging due…

Computer Vision and Pattern Recognition · Computer Science 2023-03-03 Yilan Zhang , Fengying Xie , Jianqi Chen

Four-dimensional computed tomography (4DCT) is essential for medical imaging applications like radiotherapy, which demand precise respiratory motion representation. Traditional methods for reconstructing 4DCT data suffer from artifacts and…

Medical Physics · Physics 2025-07-21 Antoine De Paepe , Alexandre Bousse , Clémentine Phung-Ngoc , Dimitris Visvikis

Positron emission tomography (PET) is widely used in various clinical applications, including cancer diagnosis, heart disease and neuro disorders. The use of radioactive tracer in PET imaging raises concerns due to the risk of radiation…

Computer Vision and Pattern Recognition · Computer Science 2017-12-13 Junshen Xu , Enhao Gong , John Pauly , Greg Zaharchuk

Medical image segmentation faces challenges due to variations in anatomical structures. While convolutional neural networks (CNNs) effectively capture local features, they struggle with modeling long-range dependencies. Transformers…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Lalit Maurya , Honghai Liu , Reyer Zwiggelaar

Partial Differential Equations (PDEs) are fundamental for modeling physical systems, yet solving them in a generic and efficient manner using machine learning-based approaches remains challenging due to limited multi-input and multi-scale…

Machine Learning · Computer Science 2025-08-12 Yichen Luo , Jia Wang , Dapeng Lan , Yu Liu , Zhibo Pang

While diffusion models have set a new benchmark for quality in Low-Dose Computed Tomography (LDCT) denoising, their clinical adoption is critically hindered by extreme computational costs, with inference times often exceeding thousands of…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Tangtangfang Fang , Jingxi Hu , Xiangjian He , Jiaqi Yang

We address the problem of referring image segmentation that aims to generate a mask for the object specified by a natural language expression. Many recent works utilize Transformer to extract features for the target object by aggregating…

Computer Vision and Pattern Recognition · Computer Science 2023-05-25 Chang Liu , Henghui Ding , Yulun Zhang , Xudong Jiang

Low-dose computed tomography (LDCT) scans, which can effectively alleviate the radiation problem, will degrade the imaging quality. In this paper, we propose a novel LDCT reconstruction network that unrolls the iterative scheme and performs…

Image and Video Processing · Electrical Eng. & Systems 2020-08-04 Wenjun Xia , Zexin Lu , Yongqiang Huang , Zuoqiang Shi , Yan Liu , Hu Chen , Yang Chen , Jiliu Zhou , Yi Zhang

Transformer-based methods have demonstrated impressive results in medical image restoration, attributed to the multi-head self-attention (MSA) mechanism in the spatial dimension. However, the majority of existing Transformers conduct…

Image and Video Processing · Electrical Eng. & Systems 2024-07-15 Zhiwen Yang , Haowei Chen , Ziniu Qian , Yang Zhou , Hui Zhang , Dan Zhao , Bingzheng Wei , Yan Xu

Despite its tremendous value for the diagnosis, treatment monitoring and surveillance of children with cancer, whole body staging with positron emission tomography (PET) is time consuming and associated with considerable radiation exposure.…

Millimeter-wave radar enables robust environment perception in autonomous systems under adverse conditions yet suffers from sparse, noisy point clouds with low angular resolution. Existing diffusion-based radar enhancement methods either…

Image and Video Processing · Electrical Eng. & Systems 2026-01-13 Hao Li , Xinqi Liu , Yaoqing Jin

Low-dose CT (LDCT) protocols reduce radiation exposure but increase image noise, compromising diagnostic confidence. Diffusion-based generative models have shown promise for LDCT denoising by learning image priors and performing iterative…

Computer Vision and Pattern Recognition · Computer Science 2025-08-14 Tomás de la Sotta , José M. Saavedra , Héctor Henríquez , Violeta Chang , Aline Xavier

Diffusion models (DMs) have recently been introduced as a regularizing prior for PET image reconstruction, integrating DMs trained on high-quality PET images with unsupervised schemes that condition on measured data. While these approaches…

Medical Physics · Physics 2026-03-18 George Webber , Alexander Hammers , Andrew P King , Andrew J Reader

Computed tomography (CT) is one of the modalities for effective lung cancer screening, diagnosis, treatment, and prognosis. The features extracted from CT images are now used to quantify spatial and temporal variations in tumors. However,…

Image and Video Processing · Electrical Eng. & Systems 2023-03-28 Md Selim , Jie Zhang , Michael A. Brooks , Ge Wang , Jin Chen