English
Related papers

Related papers: Optimizing CAD Models with Latent Space Manipulati…

200 papers

We explore and analyze the latent style space of StyleGAN2, a state-of-the-art architecture for image generation, using models pretrained on several different datasets. We first show that StyleSpace, the space of channel-wise style…

Computer Vision and Pattern Recognition · Computer Science 2020-12-04 Zongze Wu , Dani Lischinski , Eli Shechtman

Unsupervised 3D representation learning reduces the burden of labeling multimodal 3D data for fusion perception tasks. Among different pre-training paradigms, differentiable-rendering-based methods have shown most promise. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Runjian Chen , Hang Zhang , Avinash Ravichandran , Hyoungseob Park , Wenqi Shao , Alex Wong , Ping Luo

Latent image representations arising from vision-language models have proved immensely useful for a variety of downstream tasks. However, their utility is limited by their entanglement with respect to different visual attributes. For…

Computer Vision and Pattern Recognition · Computer Science 2023-11-14 James Oldfield , Christos Tzelepis , Yannis Panagakis , Mihalis A. Nicolaou , Ioannis Patras

We present a novel application of neural networks to design improved mixing elements for single-screw extruders. Specifically, we propose to use neural networks in numerical shape optimization to parameterize geometries. Geometry…

Computational Engineering, Finance, and Science · Computer Science 2023-02-13 Jaewook Lee , Sebastian Hube , Stefanie Elgeti

We present a new latent model of natural images that can be learned on large-scale datasets. The learning process provides a latent embedding for every image in the training dataset, as well as a deep convolutional network that maps the…

Computer Vision and Pattern Recognition · Computer Science 2018-11-06 ShahRukh Athar , Evgeny Burnaev , Victor Lempitsky

Recently, StyleGAN has enabled various image manipulation and editing tasks thanks to the high-quality generation and the disentangled latent space. However, additional architectures or task-specific training paradigms are usually required…

Computer Vision and Pattern Recognition · Computer Science 2021-11-03 Min Jin Chong , Hsin-Ying Lee , David Forsyth

Generative adversarial nets (GANs) have been successfully applied in many fields like image generation, inpainting, super-resolution and drug discovery, etc., by now, the inner process of GANs is far from been understood. To get deeper…

Computer Vision and Pattern Recognition · Computer Science 2020-07-24 Ziqiang Li , Rentuo Tao , Hongjing Niu , Bin Li

We present a novel approach to path planning for robotic manipulators, in which paths are produced via iterative optimisation in the latent space of a generative model of robot poses. Constraints are incorporated through the use of…

Generative adversarial networks (GANs) have proven to be surprisingly efficient for image editing by inverting and manipulating the latent code corresponding to a natural image. This property emerges from the disentangled nature of the…

Computer Vision and Pattern Recognition · Computer Science 2021-07-12 Mustafa Shukor , Xu Yao , Bharath Bhushan Damodaran , Pierre Hellier

The semantic controllability of StyleGAN is enhanced by unremitting research. Although the existing weak supervision methods work well in manipulating the style codes along one attribute, the accuracy of manipulating multiple attributes is…

Computer Vision and Pattern Recognition · Computer Science 2022-09-29 Bingchuan Li , Shaofei Cai , Wei Liu , Peng Zhang , Qian He , Miao Hua , Zili Yi

In this work, we are dedicated to text-guided image generation and propose a novel framework, i.e., CLIP2GAN, by leveraging CLIP model and StyleGAN. The key idea of our CLIP2GAN is to bridge the output feature embedding space of CLIP and…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Yixuan Wang , Wengang Zhou , Jianmin Bao , Weilun Wang , Li Li , Houqiang Li

Although manipulating facial attributes by Generative Adversarial Networks (GANs) has been remarkably successful recently, there are still some challenges in explicit control of features such as pose, expression, lighting, etc. Recent…

Computer Vision and Pattern Recognition · Computer Science 2022-09-27 Yuanming Li , Jeong-gi Kwak , David Han , Hanseok Ko

Automatic image editing has great demands because of its numerous applications, and the use of natural language instructions is essential to achieving flexible and intuitive editing as the user imagines. A pioneering work in text-driven…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Tsuyoshi Baba , Kosuke Nishida , Kyosuke Nishida

Latent space exploration is a technique that discovers interpretable latent directions and manipulates latent codes to edit various attributes in images generated by generative adversarial networks (GANs). However, in previous work, spatial…

Computer Vision and Pattern Recognition · Computer Science 2022-08-29 Yuki Endo

Semantic shape completion is a challenging problem in 3D computer vision where the task is to generate a complete 3D shape using a partial 3D shape as input. We propose a learning-based approach to complete incomplete 3D shapes through…

Computer Vision and Pattern Recognition · Computer Science 2018-10-02 Swaminathan Gurumurthy , Shubham Agrawal

The robotic manipulation of compliant objects is currently one of the most active problems in robotics due to its potential to automate many important applications. Despite the progress achieved by the robotics community in recent years,…

Robotics · Computer Science 2022-05-23 Jiaming Qi , Dongyu Li , Yufeng Gao , Peng Zhou , David Navarro-Alarcon

The recent GAN inversion methods have been able to successfully invert the real image input to the corresponding editable latent code in StyleGAN. By combining with the language-vision model (CLIP), some text-driven image manipulation…

Computer Vision and Pattern Recognition · Computer Science 2023-09-22 Yunpeng Bai , Zihan Zhong , Chao Dong , Weichen Zhang , Guowei Xu , Chun Yuan

A promise of Generative Adversarial Networks (GANs) is to provide cheap photorealistic data for training and validating AI models in autonomous driving. Despite their huge success, their performance on complex images featuring multiple…

Computer Vision and Pattern Recognition · Computer Science 2023-05-17 George Eskandar , Youssef Farag , Tarun Yenamandra , Daniel Cremers , Karim Guirguis , Bin Yang

In the majority of GAN architectures, the latent space is defined as a set of vectors of given dimensionality. Such representations are not easily interpretable and do not capture spatial information of image content directly. In this work,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Maciej Sypetkowski

Recently, a surge of face editing techniques have been proposed to employ the pretrained StyleGAN for semantic manipulation. To successfully edit a real image, one must first convert the input image into StyleGAN's latent variables.…

Computer Vision and Pattern Recognition · Computer Science 2022-04-28 Yin Yu , Ghasedi Kamran , Wu HsiangTao , Yang Jiaolong , Tong Xi , Fu Yun