English
Related papers

Related papers: Texture Generation with Neural Cellular Automata

200 papers

Novel photo-realistic texture synthesis is an important task for generating novel scenes, including asset generation for 3D simulations. However, to date, these methods predominantly generate textured objects in 2D space. If we rely on 2D…

Computer Vision and Pattern Recognition · Computer Science 2023-02-09 Dharma KC , Clayton T. Morrison , Bradley Walls

We develop a model for representing visual texture in a low-dimensional feature space, along with a novel self-supervised learning objective that is used to train it on an unlabeled database of texture images. Inspired by the architecture…

Computer Vision and Pattern Recognition · Computer Science 2020-07-01 Nikhil Parthasarathy , Eero P. Simoncelli

Artistic stylization of 3D volumetric smoke data is still a challenge in computer graphics due to the difficulty of ensuring spatiotemporal consistency given a reference style image, and that within reasonable time and computational…

Image and Video Processing · Electrical Eng. & Systems 2025-02-17 Dongqing Wang , Ehsan Pajouheshgar , Yitao Xu , Tong Zhang , Sabine Süsstrunk

This paper presents a method to reconstruct high-quality textured 3D models from both multi-view and single-view images. The reconstruction is posed as an adaptation problem and is done progressively where in the first stage, we focus on…

Computer Vision and Pattern Recognition · Computer Science 2022-03-18 Aysegul Dundar , Jun Gao , Andrew Tao , Bryan Catanzaro

Conditional text-to-image generation is an active area of research, with many possible applications. Existing research has primarily focused on generating a single image from available conditioning information in one step. One practical…

Computer Vision and Pattern Recognition · Computer Science 2019-09-24 Alaaeldin El-Nouby , Shikhar Sharma , Hannes Schulz , Devon Hjelm , Layla El Asri , Samira Ebrahimi Kahou , Yoshua Bengio , Graham W. Taylor

While recent generative models for 2D images achieve impressive visual results, they clearly lack the ability to perform 3D reasoning. This heavily restricts the degree of control over generated objects as well as the possible applications…

Computer Vision and Pattern Recognition · Computer Science 2020-10-26 Dario Pavllo , Graham Spinks , Thomas Hofmann , Marie-Francine Moens , Aurelien Lucchi

Here we demonstrate that the feature space of random shallow convolutional neural networks (CNNs) can serve as a surprisingly good model of natural textures. Patches from the same texture are consistently classified as being more similar…

Computer Vision and Pattern Recognition · Computer Science 2016-06-02 Ivan Ustyuzhaninov , Wieland Brendel , Leon A. Gatys , Matthias Bethge

Convolutional Neural Networks (CNNs) for visual tasks are believed to learn both the low-level textures and high-level object attributes, throughout the network depth. This paper further investigates the `texture bias' in CNNs. To this end,…

Computer Vision and Pattern Recognition · Computer Science 2021-10-22 Amin Banitalebi-Dehkordi , Yong Zhang

Texture-based classification solutions have proven their significance in many domains, from industrial inspections to health-related applications. New methods have been developed based on texture feature learning and CNN-based architectures…

Computer Vision and Pattern Recognition · Computer Science 2022-10-21 Vijay Pandey , Trapti Kalra , Mayank Gubba , Mohammed Faisal

This paper addresses the problem of interpolating visual textures. We formulate this problem by requiring (1) by-example controllability and (2) realistic and smooth interpolation among an arbitrary number of texture samples. To solve it we…

Computer Vision and Pattern Recognition · Computer Science 2019-04-17 Ning Yu , Connelly Barnes , Eli Shechtman , Sohrab Amirghodsi , Michal Lukac

Recent work in the literature has shown experimentally that one can use the lower layers of a trained convolutional neural network (CNN) to model natural textures. More interestingly, it has also been experimentally shown that only one…

Computer Vision and Pattern Recognition · Computer Science 2016-12-20 Mihir Mongia , Kundan Kumar , Akram Erraqabi , Yoshua Bengio

We study the predictability of emergent phenomena in complex systems. Using nearest neighbor, one-dimensional Cellular Automata (CA) as an example, we show how to construct local coarse-grained descriptions of CA in all classes of Wolfram's…

Cellular Automata and Lattice Gases · Physics 2015-06-26 Navot Israeli , Nigel Goldenfeld

The real world exhibits an abundance of non-stationary textures. Examples include textures with large-scale structures, as well as spatially variant and inhomogeneous textures. While existing example-based texture synthesis methods can cope…

Graphics · Computer Science 2024-01-08 Yang Zhou , Zhen Zhu , Xiang Bai , Dani Lischinski , Daniel Cohen-Or , Hui Huang

Recent experiments in computer vision demonstrate texture bias as the primary reason for supreme results in models employing Convolutional Neural Networks (CNNs), conflicting with early works claiming that these networks identify objects…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Satyam Mohla , Anshul Nasery , Biplab Banerjee

Convolutional Neural Networks (CNNs) are commonly thought to recognise objects by learning increasingly complex representations of object shapes. Some recent studies suggest a more important role of image textures. We here put these…

Computer Vision and Pattern Recognition · Computer Science 2022-11-11 Robert Geirhos , Patricia Rubisch , Claudio Michaelis , Matthias Bethge , Felix A. Wichmann , Wieland Brendel

Neural Cellular Automata (NCAs) offer a way to study the growth of two-dimensional artificial organisms from a single seed cell. From the outset, NCA-grown organisms have had issues with stability, their natural boundary often breaking down…

Neural and Evolutionary Computing · Computer Science 2025-12-11 James Stovold

The recent work of Gatys et al., who characterized the style of an image by the statistics of convolutional neural network filters, ignited a renewed interest in the texture generation and image stylization problems. While their image…

Computer Vision and Pattern Recognition · Computer Science 2017-11-07 Dmitry Ulyanov , Andrea Vedaldi , Victor Lempitsky

We present a generative method for texture filtering, which exhibits surprisingly good performance and generalizability. Our core idea is to empower texture filtering by taking full advantage of the strong learned image prior of pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Rongjia Zheng , Shangwei Huang , Lei Zhu , Wei-Shi Zheng , Qing Zhang

Prior works on physical adversarial camouflage against vehicle detectors mainly focus on the effectiveness and robustness of the attack. The current most successful methods optimize 3D vehicle texture at a pixel level. However, this results…

Computer Vision and Pattern Recognition · Computer Science 2024-09-27 Linye Lyu , Jiawei Zhou , Daojing He , Yu Li

Contrasting the previous evidence that neurons in the later layers of a Convolutional Neural Network (CNN) respond to complex object shapes, recent studies have shown that CNNs actually exhibit a `texture bias': given an image with both…

Computer Vision and Pattern Recognition · Computer Science 2021-01-28 Md Amirul Islam , Matthew Kowal , Patrick Esser , Sen Jia , Bjorn Ommer , Konstantinos G. Derpanis , Neil Bruce