English
Related papers

Related papers: Abstract Art Interpretation Using ControlNet

200 papers

With the advent of generative adversarial networks, synthesizing images from textual descriptions has recently become an active research area. It is a flexible and intuitive way for conditional image generation with significant progress in…

Computer Vision and Pattern Recognition · Computer Science 2021-10-07 Stanislav Frolov , Tobias Hinz , Federico Raue , Jörn Hees , Andreas Dengel

In recent years, Generative Adversarial Networks have achieved impressive results in photorealistic image synthesis. This progress nurtures hopes that one day the classical rendering pipeline can be replaced by efficient models that are…

Computer Vision and Pattern Recognition · Computer Science 2020-03-25 Yiyi Liao , Katja Schwarz , Lars Mescheder , Andreas Geiger

Humans show high-level of abstraction capabilities in games that require quickly communicating object information. They decompose the message content into multiple parts and communicate them in an interpretable protocol. Toward equipping…

Computer Vision and Pattern Recognition · Computer Science 2022-07-28 Stephan Alaniz , Massimiliano Mancini , Anjan Dutta , Diego Marcos , Zeynep Akata

This work introduces ArtAdapter, a transformative text-to-image (T2I) style transfer framework that transcends traditional limitations of color, brushstrokes, and object shape, capturing high-level style elements such as composition and…

Computer Vision and Pattern Recognition · Computer Science 2024-03-27 Dar-Yen Chen , Hamish Tennent , Ching-Wen Hsu

This paper presents abstract art created by neural networks and broadly recognizable across various computer vision systems. The existence of abstract forms that trigger specific labels independent of neural architecture or training set…

Computer Vision and Pattern Recognition · Computer Science 2019-12-10 Tom White

In this research, we introduce RefineNet, a novel architecture designed to address resolution limitations in text-to-image conversion systems. We explore the challenges of generating high-resolution images from textual descriptions,…

Computer Vision and Pattern Recognition · Computer Science 2024-01-01 Fan Shi

To enhance the controllability of text-to-image diffusion models, existing efforts like ControlNet incorporated image-based conditional controls. In this paper, we reveal that existing methods still face significant challenges in generating…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Ming Li , Taojiannan Yang , Huafeng Kuang , Jie Wu , Zhaoning Wang , Xuefeng Xiao , Chen Chen

Artificial Intelligence is present in the generation and distribution of culture. How do artists exploit neural networks? What impact do these algorithms have on artistic practice? Through a practice-based research methodology, this paper…

Human-Computer Interaction · Computer Science 2023-07-18 Varvara Guljajeva , Mar Canet Sola , Isaac Joseph Clarke

Real-world images usually contain vivid contents and rich textural details, which will complicate the manipulation on them. In this paper, we design a new framework based on content-aware synthesis to enhance content-aware image…

Graphics · Computer Science 2014-08-22 Weiming Dong , Fuzhang Wu , Yan Kong , Xing Mei , Tong-Yee Lee , Xiaopeng Zhang

In this paper, we develop a compositional approach to abstraction and safety synthesis for a general class of discrete time nonlinear systems. Our approach makes it possible to define a symbolic abstraction by composing a set of symbolic…

Systems and Control · Computer Science 2021-04-09 Pierre-Jean Meyer , Antoine Girard , Emmanuel Witrant

Sketches have been used to conceptualise and depict visual objects from pre-historic times. Sketch research has flourished in the past decade, particularly with the proliferation of touchscreen devices. Much of the utilisation of sketch has…

Computer Vision and Pattern Recognition · Computer Science 2022-10-28 Ayan Kumar Bhunia

The goal of image harmonization is adjusting the foreground appearance in a composite image to make the whole image harmonious. To construct paired training images, existing datasets adopt different ways to adjust the illumination…

Computer Vision and Pattern Recognition · Computer Science 2023-08-02 Li Niu , Junyan Cao , Wenyan Cong , Liqing Zhang

Text-guided synthesis of images has made a giant leap towards becoming a mainstream phenomenon. With text-to-image generation systems, anybody can create digital images and artworks. This provokes the question of whether text-to-image…

Human-Computer Interaction · Computer Science 2022-11-01 Jonas Oppenlaender

Recent advances in image generation have achieved remarkable visual quality, while a fundamental challenge remains: Can image generation be controlled at the element level, enabling intuitive modifications such as adjusting shapes, altering…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Lanqing Guo , Xi Liu , Yufei Wang , Zhihao Li , Siyu Huang

Learning abstractions directly from data is a core challenge in robotics. Humans naturally operate at an abstract level, reasoning over high-level subgoals while delegating execution to low-level motor skills -- an ability that enables…

Robotics · Computer Science 2026-03-23 Abhiroop Ajith , Constantinos Chamzas

Recent years have witnessed the success of deep networks in compressed sensing (CS), which allows for a significant reduction in sampling cost and has gained growing attention since its inception. In this paper, we propose a new practical…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 Bin Chen , Jian Zhang

Personalization techniques for large text-to-image (T2I) models allow users to incorporate new concepts from reference images. However, existing methods primarily rely on textual descriptions, leading to limited control over customized…

Computer Vision and Pattern Recognition · Computer Science 2024-02-28 Chufeng Xiao , Hongbo Fu

We introduce ShapeWords, an approach for synthesizing images based on 3D shape guidance and text prompts. ShapeWords incorporates target 3D shape information within specialized tokens embedded together with the input text, effectively…

Computer Vision and Pattern Recognition · Computer Science 2025-12-12 Dmitry Petrov , Pradyumn Goyal , Divyansh Shivashok , Yuanming Tao , Melinos Averkiou , Evangelos Kalogerakis

Text-conditional diffusion models are able to generate high-fidelity images with diverse contents. However, linguistic representations frequently exhibit ambiguous descriptions of the envisioned objective imagery, requiring the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-01 Minghui Hu , Jianbin Zheng , Daqing Liu , Chuanxia Zheng , Chaoyue Wang , Dacheng Tao , Tat-Jen Cham

Our ability to sample realistic natural images, particularly faces, has advanced by leaps and bounds in recent years, yet our ability to exert fine-tuned control over the generative process has lagged behind. If this new technology is to…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Marek Kowalski , Stephan J. Garbin , Virginia Estellers , Tadas Baltrušaitis , Matthew Johnson , Jamie Shotton