English
Related papers

Related papers: Latent Space Editing in Transformer-Based Flow Mat…

200 papers

Recent advances in inverse problem solving have increasingly adopted flow priors over diffusion models due to their ability to construct straight probability paths from noise to data, thereby enhancing efficiency in both training and…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Hossein Askari , Yadan Luo , Hongfu Sun , Fred Roosta

Deep generative models make visual content creation more accessible to novice users by automating the synthesis of diverse, realistic content based on a collected dataset. However, the current machine learning approaches miss a key element…

Computer Vision and Pattern Recognition · Computer Science 2022-07-29 Sheng-Yu Wang , David Bau , Jun-Yan Zhu

Recent advances in the field of generative models and in particular generative adversarial networks (GANs) have lead to substantial progress for controlled image editing, especially compared with the pre-deep learning era. Despite their…

Computer Vision and Pattern Recognition · Computer Science 2023-12-14 Gwilherm Lesné , Yann Gousseau , Saïd Ladjal , Alasdair Newson

Finding a suitable layout represents a crucial task for diverse applications in graphic design. Motivated by simpler and smoother sampling trajectories, we explore the use of Flow Matching as an alternative to current diffusion-based layout…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Julian Jorge Andrade Guerreiro , Naoto Inoue , Kento Masui , Mayu Otani , Hideki Nakayama

Recent advances in high-fidelity semantic image editing heavily rely on the presumably disentangled latent spaces of the state-of-the-art generative models, such as StyleGAN. Specifically, recent works show that it is possible to achieve…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Valentin Khrulkov , Leyla Mirvakhabova , Ivan Oseledets , Artem Babenko

Deep generative models, like GANs, have considerably improved the state of the art in image synthesis, and are able to generate near photo-realistic images in structured domains such as human faces. Based on this success, recent work on…

Computer Vision and Pattern Recognition · Computer Science 2022-03-10 Guillaume Couairon , Asya Grechka , Jakob Verbeek , Holger Schwenk , Matthieu Cord

Recent advances in multimodal foundation models unifying image understanding and generation have opened exciting avenues for tackling a wide range of vision-language tasks within a single framework. Despite progress, existing unified models…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Ying Shen , Zhiyang Xu , Jiuhai Chen , Shizhe Diao , Jiaxin Zhang , Yuguang Yao , Joy Rimchala , Ismini Lourentzou , Lifu Huang

Despite the recent success of multi-view diffusion models for text/image-based 3D asset generation, instruction-based editing of 3D assets lacks surprisingly far behind the quality of generation models. The main reason is that recent…

Graphics · Computer Science 2025-12-15 Maria Parelli , Michael Oechsle , Michael Niemeyer , Federico Tombari , Andreas Geiger

Latent diffusion models (LDMs) dominate high-quality image generation, yet integrating representation learning with generative modeling remains a challenge. We introduce a novel generative image modeling framework that seamlessly bridges…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Theodoros Kouzelis , Efstathios Karypidis , Ioannis Kakogeorgiou , Spyros Gidaris , Nikos Komodakis

Generative adversarial networks (GANs) synthesize realistic images from random latent vectors. Although manipulating the latent vectors controls the synthesized outputs, editing real images with GANs suffers from i) time-consuming…

Computer Vision and Pattern Recognition · Computer Science 2021-06-24 Hyunsu Kim , Yunjey Choi , Junho Kim , Sungjoo Yoo , Youngjung Uh

The high-quality images yielded by generative adversarial networks (GANs) have motivated investigations into their application for image editing. However, GANs are often limited in the control they provide for performing specific edits. One…

Computer Vision and Pattern Recognition · Computer Science 2022-11-23 Krishnakant Singh , Simone Schaub-Meyer , Stefan Roth

End-to-end optimization has achieved state-of-the-art performance on many specific problems, but there is no straight-forward way to combine pretrained models for new problems. Here, we explore improving modularity by learning a post-hoc…

Machine Learning · Computer Science 2019-02-25 Yingtao Tian , Jesse Engel

Unconstrained Image generation with high realism is now possible using recent Generative Adversarial Networks (GANs). However, it is quite challenging to generate images with a given set of attributes. Recent methods use style-based GAN…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Rishubh Parihar , Ankit Dhiman , Tejan Karmali , R. Venkatesh Babu

Image editing has been a long-standing challenge in the research community with its far-reaching impact on numerous applications. Recently, text-driven methods started to deliver promising results in domains like human faces, but their…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Chaerin Kong , Seungyong Lee , Soohyeok Im , Wonsuk Yang

Adaptive and flexible image editing is a desirable function of modern generative models. In this work, we present a generative model with auto-encoder architecture for per-region style manipulation. We apply a code consistency loss to…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 Ansheng You , Chenglin Zhou , Qixuan Zhang , Lan Xu

Deep learning models have emerged as a powerful tool for various medical applications. However, their success depends on large, high-quality datasets that are challenging to obtain due to privacy concerns and costly annotation. Generative…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Milad Yazdani , Yasamin Medghalchi , Pooria Ashrafian , Ilker Hacihaliloglu , Dena Shahriari

Generative diffusion models have advanced image editing with high-quality results and intuitive interfaces such as prompts and semantic drawing. However, these interfaces lack precise control, and the associated methods typically specialize…

Generative models have demonstrated strong performance in conditional settings and can be viewed as a form of data compression, where the condition serves as a compact representation. However, their limited controllability and…

Machine Learning · Computer Science 2025-07-04 Xiao Li , Liangji Zhu , Anand Rangarajan , Sanjay Ranka

We introduce a latent 3D representation that models 3D surfaces as probability density functions in 3D, i.e., p(x,y,z), with flow-matching. Our representation is specifically designed for consumption by machine learning models, offering…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Jen-Hao Rick Chang , Yuyang Wang , Miguel Angel Bautista Martin , Jiatao Gu , Xiaoming Zhao , Josh Susskind , Oncel Tuzel

Controllable semantic image editing enables a user to change entire image attributes with a few clicks, e.g., gradually making a summer scene look like it was taken in winter. Classic approaches for this task use a Generative Adversarial…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Peiye Zhuang , Oluwasanmi Koyejo , Alexander G. Schwing