English
Related papers

Related papers: Plasticine: A Traceable Diffusion Model for Medica…

200 papers

Despite the ability of existing large-scale text-to-image (T2I) models to generate high-quality images from detailed textual descriptions, they often lack the ability to precisely edit the generated or real images. In this paper, we propose…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Chong Mou , Xintao Wang , Jiechong Song , Ying Shan , Jian Zhang

Diffusion models have demonstrated exceptional performances in various fields of generative modeling, but suffer from slow sampling speed due to their iterative nature. While this issue is being addressed in continuous domains, discrete…

Machine Learning · Computer Science 2025-05-12 Satoshi Hayakawa , Yuhta Takida , Masaaki Imaizumi , Hiromi Wakaki , Yuki Mitsufuji

Image to image translation is the problem of transferring an image from a source domain to a different (but related) target domain. We present a new unsupervised image to image translation technique that leverages the underlying semantic…

Computer Vision and Pattern Recognition · Computer Science 2021-03-02 Pravakar Roy , Nicolai Häni , Jun-Jee Chao , Volkan Isler

Image-to-image translation is a class of vision and graphics problems where the goal is to learn the mapping between an input image and an output image using a training set of aligned image pairs. However, for many tasks, paired training…

Computer Vision and Pattern Recognition · Computer Science 2020-08-25 Jun-Yan Zhu , Taesung Park , Phillip Isola , Alexei A. Efros

Recent progress in image recognition has stimulated the deployment of vision systems at an unprecedented scale. As a result, visual data are now often consumed not only by humans but also by machines. Existing image processing methods only…

Computer Vision and Pattern Recognition · Computer Science 2022-09-13 Zhuang Liu , Hung-Ju Wang , Tinghui Zhou , Zhiqiang Shen , Bingyi Kang , Evan Shelhamer , Trevor Darrell

We present a framework for high-fidelity product image recontextualization using text-to-image diffusion models and a novel data augmentation pipeline. This pipeline leverages image-to-video diffusion, in/outpainting & negatives to create…

Computer Vision and Pattern Recognition · Computer Science 2025-03-13 Ishaan Malhi , Praneet Dutta , Ellie Talius , Sally Ma , Brendan Driscoll , Krista Holden , Garima Pruthi , Arunachalam Narayanaswamy

Depth information provides valuable insights into the 3D structure especially the outline of objects, which can be utilized to improve the semantic segmentation tasks. However, a naive fusion of depth information can disrupt feature and…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Wei Sun , Yuan Li , Qixiang Ye , Jianbin Jiao , Yanzhao Zhou

Image-to-image translation is significant to many computer vision and machine learning tasks such as image synthesis and video synthesis. It has primary applications in the graphics editing and animation industries. With the development of…

Computer Vision and Pattern Recognition · Computer Science 2019-12-17 Heng Wang , Donghao Zhang , Yang Song , Heng Huang , Mei Chen , Weidong Cai

Large-scale generative models, such as text-to-image diffusion models, have garnered widespread attention across diverse domains due to their creative and high-fidelity image generation. Nonetheless, existing large-scale diffusion models…

Computer Vision and Pattern Recognition · Computer Science 2024-08-28 Younghyun Kim , Geunmin Hwang , Junyu Zhang , Eunbyung Park

Image-to-image translation has gained popularity in the medical field to transform images from one domain to another. Medical image synthesis via domain transformation is advantageous in its ability to augment an image dataset where images…

Image and Video Processing · Electrical Eng. & Systems 2024-01-08 Cassandra Czobit , Reza Samavi

Monocular depth estimation in colonoscopy video aims to overcome the unusual lighting properties of the colonoscopic environment. One of the major challenges in this area is the domain gap between annotated but unrealistic synthetic data…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Shuxian Wang , Akshay Paruchuri , Zhaoxi Zhang , Sarah McGill , Roni Sengupta

Image retouching aims to enhance the visual quality of photos. Considering the different aesthetic preferences of users, the target of retouching is subjective. However, current retouching methods mostly adopt deterministic models, which…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Zheng-Peng Duan , Jiawei zhang , Zheng Lin , Xin Jin , Dongqing Zou , Chunle Guo , Chongyi Li

In medical imaging, chromosome straightening plays a significant role in the pathological study of chromosomes and in the development of cytogenetic maps. Whereas different approaches exist for the straightening task, typically geometric…

Computer Vision and Pattern Recognition · Computer Science 2021-10-20 Sifan Song , Daiyun Huang , Yalun Hu , Chunxiao Yang , Jia Meng , Fei Ma , Frans Coenen , Jiaming Zhang , Jionglong Su

We do not pursue a novel method in this paper, but aim to study if a modern text-to-image diffusion model can tailor any task-adaptive image classifier across domains and categories. Existing domain adaptive image classification works…

Computer Vision and Pattern Recognition · Computer Science 2023-10-26 Weijie Chen , Haoyu Wang , Shicai Yang , Lei Zhang , Wei Wei , Yanning Zhang , Luojun Lin , Di Xie , Yueting Zhuang

We propose a novel unpaired image-to-image translation method that uses denoising diffusion probabilistic models without requiring adversarial training. Our method, UNpaired Image Translation with Denoising Diffusion Probabilistic Models…

Computer Vision and Pattern Recognition · Computer Science 2021-04-13 Hiroshi Sasaki , Chris G. Willcocks , Toby P. Breckon

Recently, deep-learning-based approaches have been widely studied for deformable image registration task. However, most efforts directly map the composite image representation to spatial transformation through the convolutional neural…

Image and Video Processing · Electrical Eng. & Systems 2022-07-08 Jiashun Chen , Donghuan Lu , Yu Zhang , Dong Wei , Munan Ning , Xinyu Shi , Zhe Xu , Yefeng Zheng

Our goal is to develop fine-grained real-image editing methods suitable for real-world applications. In this paper, we first summarize four requirements for these methods and propose a novel diffusion-based image editing framework with…

Computer Vision and Pattern Recognition · Computer Science 2023-06-01 Naoki Matsunaga , Masato Ishii , Akio Hayakawa , Kenji Suzuki , Takuya Narihira

The in-image machine translation task involves translating text embedded within images, with the translated results presented in image format. While this task has numerous applications in various scenarios such as film poster translation…

Computation and Language · Computer Science 2024-12-25 Chengpeng Fu , Xiaocheng Feng , Yichong Huang , Wenshuai Huo , Baohang Li , Zhirui Zhang , Yunfei Lu , Dandan Tu , Duyu Tang , Hui Wang , Bing Qin , Ting Liu

In this paper, we argue that iterative computation with diffusion models offers a powerful paradigm for not only generation but also visual perception tasks. We unify tasks such as depth estimation, optical flow, and amodal segmentation…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Rahul Ravishankar , Zeeshan Patel , Jathushan Rajasegaran , Jitendra Malik

Synthetic image data generation represents a promising avenue for training deep learning models, particularly in the realm of transfer learning, where obtaining real images within a specific domain can be prohibitively expensive due to…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Yuhang Li , Xin Dong , Chen Chen , Jingtao Li , Yuxin Wen , Michael Spranger , Lingjuan Lyu