中文
相关论文

相关论文: Conditional Video Generation Using Action-Appearan…

200 篇论文

This paper presents a simple method for speech videos generation based on audio: given a piece of audio, we can generate a video of the target face speaking this audio. We propose Generative Adversarial Networks (GAN) with cut speech audio…

声音 · 计算机科学 2022-07-20 Hanhaodi Zhang

Generative adversarial networks (GANs) have demonstrated impressive image generation quality and semantic editing capability of real images, e.g., changing object classes, modifying attributes, or transferring styles. However, applying…

计算机视觉与模式识别 · 计算机科学 2022-06-22 Yiran Xu , Badour AlBahar , Jia-Bin Huang

We explore a novel video creation experience, namely Video Creation by Demonstration. Given a demonstration video and a context image from a different scene, we generate a physically plausible video that continues naturally from the context…

计算机视觉与模式识别 · 计算机科学 2024-12-13 Yihong Sun , Hao Zhou , Liangzhe Yuan , Jennifer J. Sun , Yandong Li , Xuhui Jia , Hartwig Adam , Bharath Hariharan , Long Zhao , Ting Liu

Creating a vivid video from the event or scenario in our imagination is a truly fascinating experience. Recent advancements in text-to-video synthesis have unveiled the potential to achieve this with prompts only. While text is convenient…

计算机视觉与模式识别 · 计算机科学 2023-06-02 Jinbo Xing , Menghan Xia , Yuxin Liu , Yuechen Zhang , Yong Zhang , Yingqing He , Hanyuan Liu , Haoxin Chen , Xiaodong Cun , Xintao Wang , Ying Shan , Tien-Tsin Wong

Facial expression generation has always been an intriguing task for scientists and researchers all over the globe. In this context, we present our novel approach for generating videos of the six basic facial expressions. Starting from a…

计算机视觉与模式识别 · 计算机科学 2023-07-04 Hamza Bouzid , Lahoucine Ballihi

Person search has recently been a challenging task in the computer vision domain, which aims to search specific pedestrians from real cameras.Nevertheless, most surveillance videos comprise only a handful of images of each pedestrian, which…

计算机视觉与模式识别 · 计算机科学 2023-08-09 Huibing Wang , Tianxiang Cui , Mingze Yao , Huijuan Pang , Yushan Du

In this work, we introduce a two-step framework for generative modeling of temporal data. Specifically, the generative adversarial networks (GANs) setting is employed to generate synthetic scenes of moving objects. To do so, we propose a…

计算机视觉与模式识别 · 计算机科学 2019-02-01 Isabela Albuquerque , João Monteiro , Tiago H. Falk

We propose a video compression framework using conditional Generative Adversarial Networks (GANs). We rely on two encoders: one that deploys a standard video codec and another which generates low-level maps via a pipeline of down-sampling,…

图像与视频处理 · 电气工程与系统科学 2018-11-28 Sungsoo Kim , Jin Soo Park , Christos G. Bampis , Jaeseong Lee , Mia K. Markey , Alexandros G. Dimakis , Alan C. Bovik

Our work offers a new method for domain translation from semantic label maps and Computer Graphic (CG) simulation edge map images to photo-realistic images. We train a Generative Adversarial Network (GAN) in a conditional way to generate a…

计算机视觉与模式识别 · 计算机科学 2019-09-26 Yakov Miron , Yona Coscas

Sequence transduction models have been widely explored in many natural language processing tasks. However, the target sequence usually consists of discrete tokens which represent word indices in a given vocabulary. We barely see the case…

计算机视觉与模式识别 · 计算机科学 2019-03-01 Xuan Liang , Yida Xu

Generative models can be used to synthesize 3D objects of high quality and diversity. However, there is typically no control over the properties of the generated object.This paper proposes a novel generative adversarial network (GAN) setup…

计算机视觉与模式识别 · 计算机科学 2022-09-12 Larissa T. Triess , Andre Bühler , David Peter , Fabian B. Flohr , J. Marius Zöllner

The entertainment industry relies on 3D visual content to create immersive experiences, but traditional methods for creating textured 3D models can be time-consuming and subjective. Generative networks such as StyleGAN have advanced image…

计算机视觉与模式识别 · 计算机科学 2024-02-09 Yi-Ting Pan , Chai-Rong Lee , Shu-Ho Fan , Jheng-Wei Su , Jia-Bin Huang , Yung-Yu Chuang , Hung-Kuo Chu

Speech is a rich biometric signal that contains information about the identity, gender and emotional state of the speaker. In this work, we explore its potential to generate face images of a speaker by conditioning a Generative Adversarial…

Learning to generate natural scenes has always been a challenging task in computer vision. It is even more painstaking when the generation is conditioned on images with drastically different views. This is mainly because understanding,…

计算机视觉与模式识别 · 计算机科学 2018-03-30 Krishna Regmi , Ali Borji

Perceptual studies demonstrate that conditional diffusion models excel at reconstructing video content aligned with human visual perception. Building on this insight, we propose a video compression framework that leverages conditional…

计算机视觉与模式识别 · 计算机科学 2025-09-26 Fangqiu Yi , Jingyu Xu , Jiawei Shao , Chi Zhang , Xuelong Li

Generating videos of complex human motions such as flips, cartwheels, and martial arts remains challenging for current video diffusion models. Text-only conditioning is temporally ambiguous for fine-grained motion control, while explicit…

计算机视觉与模式识别 · 计算机科学 2026-03-10 Ashkan Taghipour , Morteza Ghahremani , Zinuo Li , Hamid Laga , Farid Boussaid , Mohammed Bennamoun

Talking Face Generation (TFG) strives to create realistic and emotionally expressive digital faces. While previous TFG works have mastered the creation of naturalistic facial movements, they typically express a fixed target emotion in…

计算机视觉与模式识别 · 计算机科学 2026-03-09 Hao Yang , Yanyan Zhao , Tian Zheng , Hongbo Zhang , Bichen Wang , Di Wu , Xing Fu , Xuda Zhi , Yongbo Huang , Hao He

Generative inbetweening aims to generate intermediate frame sequences by utilizing two key frames as input. Although remarkable progress has been made in video generation models, generative inbetweening still faces challenges in maintaining…

计算机视觉与模式识别 · 计算机科学 2024-12-17 Tianyi Zhu , Dongwei Ren , Qilong Wang , Xiaohe Wu , Wangmeng Zuo

This paper presents an end-to-end learning-based video compression system, termed CANF-VC, based on conditional augmented normalizing flows (CANF). Most learned video compression systems adopt the same hybrid-based coding architecture as…

计算机视觉与模式识别 · 计算机科学 2022-08-16 Yung-Han Ho , Chih-Peng Chang , Peng-Yu Chen , Alessandro Gnutti , Wen-Hsiao Peng

The unprecedented increase in the usage of computer vision technology in society goes hand in hand with an increased concern in data privacy. In many real-world scenarios like people tracking or action recognition, it is important to be…

计算机视觉与模式识别 · 计算机科学 2020-12-01 Maxim Maximov , Ismail Elezi , Laura Leal-Taixé