English
Related papers

Related papers: Temporally Consistent Semantic Video Editing

200 papers

Generative Adversarial Networks (GANs) are able to generate high-quality images, but it remains difficult to explicitly specify the semantics of synthesized images. In this work, we aim to better understand the semantic representation of…

Computer Vision and Pattern Recognition · Computer Science 2021-04-02 Jianjin Xu , Changxi Zheng

Generative Adversarial Networks (GANs) with style-based generators (e.g. StyleGAN) successfully enable semantic control over image synthesis, and recent studies have also revealed that interpretable image translations could be obtained by…

Computer Vision and Pattern Recognition · Computer Science 2020-11-20 Yunfan Liu , Qi Li , Zhenan Sun , Tieniu Tan

We are creating multimedia contents everyday and everywhere. While automatic content generation has played a fundamental challenge to multimedia community for decades, recent advances of deep learning have made this problem feasible. For…

Computer Vision and Pattern Recognition · Computer Science 2018-04-24 Yingwei Pan , Zhaofan Qiu , Ting Yao , Houqiang Li , Tao Mei

Generative Adversarial Networks (GANs) have shown remarkable successes in generating realistic images and interpolating changes between images. Existing models, however, do not take into account physical contexts behind images in generating…

Computer Vision and Pattern Recognition · Computer Science 2021-10-11 Hayato Futase , Tomoki Tsujimura , Tetsuya Kajimoto , Hajime Kawarazaki , Toshiyuki Suzuki , Makoto Miwa , Yutaka Sasaki

Compositing is one of the most important editing operations for images and videos. The process of improving the realism of composite results is often called harmonization. Previous approaches for harmonization mainly focus on images. In…

Computer Vision and Pattern Recognition · Computer Science 2018-09-06 Haozhi Huang , Senzhe Xu , Junxiong Cai , Wei Liu , Shimin Hu

Generative adversarial networks (GANs) have enabled photorealistic image synthesis and editing. However, due to the high computational cost of large-scale generators (e.g., StyleGAN2), it usually takes seconds to see the results of a single…

Computer Vision and Pattern Recognition · Computer Science 2021-03-05 Ji Lin , Richard Zhang , Frieder Ganz , Song Han , Jun-Yan Zhu

Generative Adversarial Networks (GANs) have proven to be a powerful tool in generating artistic images, capable of mimicking the styles of renowned painters, such as Claude Monet. This paper introduces a tiered GAN model to progressively…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 FNU Neha , Deepshikha Bhati , Deepak Kumar Shukla , Md Amiruzzaman

The success of the GAN-NeRF structure has enabled face editing on NeRF to maintain 3D view consistency. However, achieving simultaneously multi-view consistency and temporal coherence while editing video sequences remains a formidable…

Computer Vision and Pattern Recognition · Computer Science 2024-01-08 Hao Zhang , Yu-Wing Tai , Chi-Keung Tang

Generative Adversarial Networks (GANs) have received a great deal of attention due in part to recent success in generating original, high-quality samples from visual domains. However, most current methods only allow for users to guide this…

Graphics · Computer Science 2019-04-05 Eric Heim

Image completion has achieved significant progress due to advances in generative adversarial networks (GANs). Albeit natural-looking, the synthesized contents still lack details, especially for scenes with complex structures or images with…

Computer Vision and Pattern Recognition · Computer Science 2017-11-28 Pengpeng Liu , Xiaojuan Qi , Pinjia He , Yikang Li , Michael R. Lyu , Irwin King

Deep generative models have demonstrated the ability to create realistic audiovisual content, sometimes driven by domains of different nature. However, smooth temporal dynamics in video generation is a challenging problem. This work focuses…

Sound · Computer Science 2024-06-25 Rafael Redondo

Generative adversarial networks (GANs) offer an effective solution to the image-to-image translation problem, thereby allowing for new possibilities in medical imaging. They can translate images from one imaging modality to another at a low…

Computer Vision and Pattern Recognition · Computer Science 2022-10-13 Agnieszka Tomczak , Aarushi Gupta , Slobodan Ilic , Nassir Navab , Shadi Albarqouni

In this paper, we propose a novel controllable text-to-image generative adversarial network (ControlGAN), which can effectively synthesise high-quality images and also control parts of the image generation according to natural language…

Computer Vision and Pattern Recognition · Computer Science 2019-12-20 Bowen Li , Xiaojuan Qi , Thomas Lukasiewicz , Philip H. S. Torr

Generative Adversarial Networks (GANs) have recently achieved significant improvement on paired/unpaired image-to-image translation, such as photo$\rightarrow$ sketch and artist painting style transfer. However, existing models can only be…

Computer Vision and Pattern Recognition · Computer Science 2017-08-02 Xiaodan Liang , Hao Zhang , Eric P. Xing

Recent advancements in text-to-image (T2I) generation using diffusion models have enabled cost-effective video-editing applications by leveraging pre-trained models, eliminating the need for resource-intensive training. However, the…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Yangfan He , Sida Li , Jianhui Wang , Kun Li , Xinyuan Song , Xinhang Yuan , Keqin Li , Kuan Lu , Menghao Huo , Jingqun Tang , Yi Xin , Jiaqi Chen , Miao Zhang , Xueqian Wang

Generative networks are fundamentally different in their aim and methods compared to CNNs for classification, segmentation, or object detection. They have initially not been meant to be an image analysis tool, but to produce naturally…

Computer Vision and Pattern Recognition · Computer Science 2022-07-11 Markus Wenzel

Generative adversarial networks (GANs) transform latent vectors into visually plausible images. It is generally thought that the original GAN formulation gives no out-of-the-box method to reverse the mapping, projecting images back into…

Machine Learning · Computer Science 2017-02-20 Zachary C. Lipton , Subarna Tripathi

GAN inversion is indispensable for applying the powerful editability of GAN to real images. However, existing methods invert video frames individually often leading to undesired inconsistent results over time. In this paper, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Yangyang Xu , Shengfeng He , Kwan-Yee K. Wong , Ping Luo

While Generative Adversarial Networks (GANs) have recently found applications in image editing, most previous GAN-based image editing methods require largescale datasets with semantic segmentation annotations for training, only provide high…

Computer Vision and Pattern Recognition · Computer Science 2023-05-17 Yuhan Cao , Haoran Jiang , Zhenghong Yu , Qi Li , Xuyang Li

Generative Adversarial Networks have been crucial in the developments made in unsupervised learning in recent times. Exemplars of image synthesis from text or other images, these networks have shown remarkable improvements over conventional…

Machine Learning · Computer Science 2019-09-02 Rohan Akut , Sumukh Marathe , Rucha Apte , Ishan Joshi , Siddhivinayak Kulkarni