English
Related papers

Related papers: Text-Guided Variational Image Generation for Indus…

200 papers

As a challenging task, text-to-image generation aims to generate photo-realistic and semantically consistent images according to the given text descriptions. Existing methods mainly extract the text information from only one sentence to…

Computer Vision and Pattern Recognition · Computer Science 2022-09-29 Xintian Wu , Hanbin Zhao , Liangli Zheng , Shouhong Ding , Xi Li

This paper presents instruct-imagen, a model that tackles heterogeneous image generation tasks and generalizes across unseen tasks. We introduce *multi-modal instruction* for image generation, a task representation articulating a range of…

Computer Vision and Pattern Recognition · Computer Science 2024-01-05 Hexiang Hu , Kelvin C. K. Chan , Yu-Chuan Su , Wenhu Chen , Yandong Li , Kihyuk Sohn , Yang Zhao , Xue Ben , Boqing Gong , William Cohen , Ming-Wei Chang , Xuhui Jia

Anomaly detection is a classical problem in computer vision, namely the determination of the normal from the abnormal when datasets are highly biased towards one class (normal) due to the insufficient sample size of the other class…

Computer Vision and Pattern Recognition · Computer Science 2018-11-14 Samet Akcay , Amir Atapour-Abarghouei , Toby P. Breckon

Image extrapolation aims at expanding the narrow field of view of a given image patch. Existing models mainly deal with natural scene images of homogeneous regions and have no control of the content generation process. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2019-12-30 Yijun Li , Lu Jiang , Ming-Hsuan Yang

Detecting out-of-distribution (OOD) inputs is pivotal for deploying safe vision systems in open-world environments. We revisit diffusion models, not as generators, but as universal perceptual templates for OOD detection. This research…

Computer Vision and Pattern Recognition · Computer Science 2025-07-31 Lemar Abdi , Amaan Valiuddin , Francisco Caetano , Christiaan Viviers , Fons van der Sommen

Anomaly detection is a fundamental problem in computer vision area with many real-world applications. Given a wide range of images belonging to the normal class, emerging from some distribution, the objective of this task is to construct…

Computer Vision and Pattern Recognition · Computer Science 2020-07-15 Chengwei Chen , Pan Chen , Haichuan Song , Yiqing Tao , Yuan Xie , Shouhong Ding , Lizhuang Ma

Text-guided image generation aimed to generate desired images conditioned on given texts, while text-guided image manipulation refers to semantically edit parts of a given image based on specified texts. For these two similar tasks, the key…

Computer Vision and Pattern Recognition · Computer Science 2023-09-22 Xiaozhou You , Jian Zhang

Adversarial examples have been demonstrated to threaten many computer vision tasks including object detection. However, the existing attacking methods for object detection have two limitations: poor transferability, which denotes that the…

Computer Vision and Pattern Recognition · Computer Science 2019-05-14 Xingxing Wei , Siyuan Liang , Ning Chen , Xiaochun Cao

We propose a novel approach to image generation by decomposing an image into a structured sequence, where each element in the sequence shares the same spatial resolution but differs in the number of unique tokens used, capturing different…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Yikai Wang , Zhouxia Wang , Zhonghua Wu , Qingyi Tao , Kang Liao , Chen Change Loy

Industrial anomaly generation is a crucial method for alleviating the data scarcity problem in anomaly detection tasks. Most existing anomaly synthesis methods rely on single-step generation mechanisms, lacking complex reasoning and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Jiaming Su , Tengchao Yang , Ruikang Zhang , Zhengan Yan , Haoyu Sun , Linfeng Zhang

Anomaly detection in medical imaging is to distinguish the relevant biomarkers of diseases from those of normal tissues. Deep supervised learning methods have shown potentials in various detection tasks, but its performances would be…

Image and Video Processing · Electrical Eng. & Systems 2021-12-01 Byungjai Kim , Kinam Kwon , Changheun Oh , Hyunwook Park

We introduce a memory-driven semi-parametric approach to text-to-image generation, which is based on both parametric and non-parametric techniques. The non-parametric component is a memory bank of image features constructed from a training…

Computer Vision and Pattern Recognition · Computer Science 2022-08-16 Bowen Li , Philip H. S. Torr , Thomas Lukasiewicz

Recent advances in generative diffusion models have enabled text-controlled synthesis of realistic and diverse images with impressive quality. Despite these remarkable advances, the application of text-to-image generative models in computer…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Yulu Gan , Sungwoo Park , Alexander Schubert , Anthony Philippakis , Ahmed M. Alaa

This survey reviews the progress of diffusion models in generating images from text, ~\textit{i.e.} text-to-image diffusion models. As a self-contained work, this survey starts with a brief introduction of how diffusion models work for…

Computer Vision and Pattern Recognition · Computer Science 2024-11-11 Chenshuang Zhang , Chaoning Zhang , Mengchun Zhang , In So Kweon , Junmo Kim

Current text-to-image models struggle to provide precise camera control using natural language alone. In this work, we present a framework for precise camera control with global scene understanding in text-to-image generation by learning…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Xinxuan Lu , Charless Fowlkes , Alexander C. Berg

This paper introduces an innovative methodology for producing high-quality 3D lung CT images guided by textual information. While diffusion-based generative models are increasingly used in medical imaging, current state-of-the-art…

Image and Video Processing · Electrical Eng. & Systems 2024-10-16 Yanwu Xu , Li Sun , Wei Peng , Shuyue Jia , Katelyn Morrison , Adam Perer , Afrooz Zandifar , Shyam Visweswaran , Motahhare Eslami , Kayhan Batmanghelich

Unsupervised anomaly detection models which are trained solely by healthy data, have gained importance in the recent years, as the annotation of medical data is a tedious task. Autoencoders and generative adversarial networks are the…

Computer Vision and Pattern Recognition · Computer Science 2022-12-12 Marc Dietrichstein , David Major , Martin Trapp , Maria Wimmer , Dimitrios Lenis , Philip Winter , Astrid Berg , Theresa Neubauer , Katja Bühler

This paper explores the possibility of learning custom tokens for representing new concepts in Vision-Language Models (VLMs). Our aim is to learn tokens that can be effective for both discriminative and generative tasks while composing well…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Pramuditha Perera , Matthew Trager , Luca Zancato , Alessandro Achille , Stefano Soatto

The power of natural language generation models has provoked a flurry of interest in automatic methods to detect if a piece of text is human or machine-authored. The problem so far has been framed in a standard supervised way and consists…

Computation and Language · Computer Science 2021-11-05 Matthias Gallé , Jos Rozen , Germán Kruszewski , Hady Elsahar

Anomaly detection aims to identify abnormal data that deviates from the normal ones, while typically requiring a sufficient amount of normal data to train the model for performing this task. Despite the success of recent anomaly detection…

Computer Vision and Pattern Recognition · Computer Science 2022-03-24 Shang-Fu Chen , Yu-Min Liu , Chia-Ching Lin , Trista Pei-Chun Chen , Yu-Chiang Frank Wang