English
Related papers

Related papers: RefineNet: Enhancing Text-to-Image Conversion with…

200 papers

Image denoising is a fundamental and challenging task in the field of computer vision. Most supervised denoising methods learn to reconstruct clean images from noisy inputs, which have intrinsic spectral bias and tend to produce…

Computer Vision and Pattern Recognition · Computer Science 2023-09-20 Yujin Wang , Lingen Li , Tianfan Xue , Jinwei Gu

Diffusion models excel at producing high-quality images; however, scaling to higher resolutions, such as 4K, often results in over-smoothed content, structural distortions, and repetitive patterns. To this end, we introduce ResMaster, a…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Shuwei Shi , Wenbo Li , Yuechen Zhang , Jingwen He , Biao Gong , Yinqiang Zheng

We propose a Multifaceted Resilient Network(MRNet), a novel architecture developed for medical image-to-image translation that outperforms state-of-the-art methods in MRI-to-CT and MRI-to-MRI conversion. MRNet leverages the Segment Anything…

Image and Video Processing · Electrical Eng. & Systems 2024-12-05 Hyojeong Lee , Youngwan Jo , Inpyo Hong , Sanghyun Park

Image Super-Resolution (SR) aims to recover a high-resolution image from its low-resolution counterpart, which has been affected by a specific degradation process. This is achieved by enhancing detail and visual quality. Recent advancements…

Computer Vision and Pattern Recognition · Computer Science 2025-01-15 Debasish Dutta , Deepjyoti Chetia , Neeharika Sonowal , Sanjib Kr Kalita

We consider the problem of semantic image segmentation using deep convolutional neural networks. We propose a novel network architecture called the label refinement network that predicts segmentation labels in a coarse-to-fine fashion at…

Computer Vision and Pattern Recognition · Computer Science 2017-03-03 Md Amirul Islam , Shujon Naha , Mrigank Rochan , Neil Bruce , Yang Wang

Scene text editing (STE), which converts a text in a scene image into the desired text while preserving an original style, is a challenging task due to a complex intervention between text and style. In this paper, we propose a novel STE…

Computer Vision and Pattern Recognition · Computer Science 2022-05-03 Junyeop Lee , Yoonsik Kim , Seonghyeon Kim , Moonbin Yim , Seung Shin , Gayoung Lee , Sungrae Park

Since the advent of deep convolutional neural networks (DNNs), computer vision has seen an extremely rapid progress that has led to huge advances in medical imaging. This article does not aim to cover all aspects of the field but focuses on…

Medical Physics · Physics 2019-06-11 Shizuo Kaji , Satoshi Kida

Scene text image super-resolution has significantly improved the accuracy of scene text recognition. However, many existing methods emphasize performance over efficiency and ignore the practical need for lightweight solutions in deployment…

Computer Vision and Pattern Recognition · Computer Science 2024-03-21 LeoWu TomyEnrique , Xiangcheng Du , Kangliang Liu , Han Yuan , Zhao Zhou , Cheng Jin

Recent advancements in diffusion models have significantly impacted the trajectory of generative machine learning research, with many adopting the strategy of fine-tuning pre-trained models using domain-specific text-to-image datasets.…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Mischa Dombrowski , Hadrien Reynaud , Johanna P. Müller , Matthew Baugh , Bernhard Kainz

Large-scale text-to-image generative models have been a revolutionary breakthrough in the evolution of generative AI, allowing us to synthesize diverse images that convey highly complex visual concepts. However, a pivotal challenge in…

Computer Vision and Pattern Recognition · Computer Science 2022-11-24 Narek Tumanyan , Michal Geyer , Shai Bagon , Tali Dekel

Recent advancements in diffusion models have notably improved the perceptual quality of generated images in text-to-image synthesis tasks. However, diffusion models often struggle to produce images that accurately reflect the intended…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Yang Zhang , Teoh Tze Tzun , Lim Wei Hern , Tiviatis Sim , Kenji Kawaguchi

Can we leverage high-resolution information without the unsustainable quadratic complexity to input scale? We propose Traversal Network (TNet), a novel multi-scale hard-attention architecture, which traverses image scale-space in a top-down…

Computer Vision and Pattern Recognition · Computer Science 2021-11-01 Athanasios Papadopoulos , Paweł Korus , Nasir Memon

Text-to-image diffusion models are typically trained to optimize the log-likelihood objective, which presents challenges in meeting specific requirements for downstream tasks, such as image aesthetics and image-text alignment. Recent…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Chaofeng Chen , Annan Wang , Haoning Wu , Liang Liao , Wenxiu Sun , Qiong Yan , Weisi Lin

Diffusion models create data from noise by inverting the forward paths of data towards noise and have emerged as a powerful generative modeling technique for high-dimensional, perceptual data such as images and videos. Rectified flow is a…

Text-to-image synthesis has recently attracted widespread attention due to rapidly improving quality and numerous practical applications. However, the language understanding capabilities of text-to-image models are still poorly understood,…

Computer Vision and Pattern Recognition · Computer Science 2023-10-16 Anton Baryshnikov , Max Ryabinin

Due to the significant information loss in low-resolution (LR) images, it has become extremely challenging to further advance the state-of-the-art of single image super-resolution (SISR). Reference-based super-resolution (RefSR), on the…

Computer Vision and Pattern Recognition · Computer Science 2019-03-11 Zhifei Zhang , Zhaowen Wang , Zhe Lin , Hairong Qi

Human pose transfer (HPT) is an emerging research topic with huge potential in fashion design, media production, online advertising and virtual reality. For these applications, the visual realism of fine-grained appearance details is…

Computer Vision and Pattern Recognition · Computer Science 2021-05-10 Lingbo Yang , Pan Wang , Chang Liu , Zhanning Gao , Peiran Ren , Xinfeng Zhang , Shanshe Wang , Siwei Ma , Xiansheng Hua , Wen Gao

This paper presents a novel method to deal with the challenging task of generating photographic images conditioned on semantic image descriptions. Our method introduces accompanying hierarchical-nested adversarial objectives inside the…

Computer Vision and Pattern Recognition · Computer Science 2018-04-10 Zizhao Zhang , Yuanpu Xie , Lin Yang

This work aims to improve the applicability of diffusion models in realistic image restoration. Specifically, we enhance the diffusion model in several aspects such as network architecture, noise level, denoising steps, training image size,…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Ziwei Luo , Fredrik K. Gustafsson , Zheng Zhao , Jens Sjölund , Thomas B. Schön

Image captioning is the process of automatically generating a description of an image in natural language. Image captioning is one of the significant challenges in image understanding since it requires not only recognizing salient objects…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Ghadah Alabduljabbar , Hafida Benhidour , Said Kerrache