中文
相关论文

相关论文: What Are You Doing? A Closer Look at Controllable …

200 篇论文

Human image animation involves generating videos from a character photo, allowing user control and unlocking the potential for video and movie production. While recent approaches yield impressive results using high-quality training data,…

计算机视觉与模式识别 · 计算机科学 2024-11-22 Zhenzhi Wang , Yixuan Li , Yanhong Zeng , Youqing Fang , Yuwei Guo , Wenran Liu , Jing Tan , Kai Chen , Tianfan Xue , Bo Dai , Dahua Lin

Video generation models have recently achieved impressive visual fidelity and temporal coherence. Yet, they continue to struggle with complex, non-rigid motions, especially when synthesizing humans performing dynamic actions such as sports,…

计算机视觉与模式识别 · 计算机科学 2026-01-22 Kumar Ashutosh , XuDong Wang , Xi Yin , Kristen Grauman , Adam Polyak , Ishan Misra , Rohit Girdhar

Recent advancements in visual generation technologies have markedly increased the scale and availability of video datasets, which are crucial for training effective video generation models. However, a significant lack of high-quality,…

计算机视觉与模式识别 · 计算机科学 2025-01-07 Hui Li , Mingwang Xu , Yun Zhan , Shan Mu , Jiaye Li , Kaihui Cheng , Yuxuan Chen , Tan Chen , Mao Ye , Jingdong Wang , Siyu Zhu

Video generation models are increasingly used as world simulators for storytelling, simulation, and embodied AI. As these models advance, a key question arises: do generated videos obey the physical laws of the real world? Existing…

计算机视觉与模式识别 · 计算机科学 2026-03-23 Qin Zhang , Peiyu Jing , Hong-Xing Yu , Fangqiang Ding , Fan Nie , Weimin Wang , Yilun Du , James Zou , Jiajun Wu , Bing Shuai

360{\deg} videos in recent years have experienced booming development. Compared to traditional videos, 360{\deg} videos are featured with uncertain user behaviors, bringing opportunities as well as challenges. Datasets are necessary for…

多媒体 · 计算机科学 2022-08-09 Yili Jin , Junhua Liu , Fangxin Wang , Shuguang Cui

The rapid advancement of Artificial Intelligence Generated Content (AIGC) technology has propelled audio-driven talking head generation, gaining considerable research attention for practical applications. However, performance evaluation…

计算机视觉与模式识别 · 计算机科学 2024-03-12 Weixia Zhang , Chengguang Zhu , Jingnan Gao , Yichao Yan , Guangtao Zhai , Xiaokang Yang

Generating realistic and controllable human motions, particularly those involving rich multi-character interactions, remains a significant challenge due to data scarcity and the complexities of modeling inter-personal dynamics. To address…

计算机视觉与模式识别 · 计算机科学 2025-06-18 Ruihao Xi , Xuekuan Wang , Yongcheng Li , Shuhua Li , Zichen Wang , Yiwei Wang , Feng Wei , Cairong Zhao

We introduce the WorldScore benchmark, the first unified benchmark for world generation. We decompose world generation into a sequence of next-scene generation tasks with explicit camera trajectory-based layout specifications, enabling…

图形学 · 计算机科学 2025-12-02 Haoyi Duan , Hong-Xing Yu , Sirui Chen , Li Fei-Fei , Jiajun Wu

As world models gain momentum in Embodied AI, an increasing number of works explore using video foundation models as predictive world models for downstream embodied tasks like 3D prediction or interactive generation. However, before…

Human-centric generative models are becoming increasingly popular, giving rise to various innovative tools and applications, such as talking face videos conditioned on text or audio prompts. The core of these capabilities lies in powerful…

计算机视觉与模式识别 · 计算机科学 2025-07-15 Donglin Di , He Feng , Wenzhang Sun , Yongjia Ma , Hao Li , Wei Chen , Lei Fan , Tonghua Su , Xun Yang

Action recognition is so far mainly focusing on the problem of classification of hand selected preclipped actions and reaching impressive results in this field. But with the performance even ceiling on current datasets, it also appears that…

计算机视觉与模式识别 · 计算机科学 2019-06-05 Hilde Kuehne , Ahsan Iqbal , Alexander Richard , Juergen Gall

Recent advances in generative modeling can create remarkably realistic synthetic videos, making it increasingly difficult for humans to distinguish them from real ones and necessitating reliable detection methods. However, two key…

计算机视觉与模式识别 · 计算机科学 2026-01-19 Long Ma , Zihao Xue , Yan Wang , Zhiyuan Yan , Jin Xu , Xiaorui Jiang , Haiyang Yu , Yong Liao , Zhen Bi

Video generation assessment is essential for ensuring that generative models produce visually realistic, high-quality videos while aligning with human expectations. Current video generation benchmarks fall into two main categories:…

计算机视觉与模式识别 · 计算机科学 2025-04-30 Hui Han , Siyuan Li , Jiaqi Chen , Yiwen Yuan , Yuling Wu , Chak Tou Leong , Hanwen Du , Junchen Fu , Youhua Li , Jie Zhang , Chi Zhang , Li-jia Li , Yongxin Ni

Despite the fact that many 3D human activity benchmarks being proposed, most existing action datasets focus on the action recognition tasks for the segmented videos. There is a lack of standard large-scale benchmarks, especially for current…

计算机视觉与模式识别 · 计算机科学 2017-03-29 Chunhui Liu , Yueyu Hu , Yanghao Li , Sijie Song , Jiaying Liu

Long-form video generation is rapidly moving from short, single-scene synthesis toward minute-long, multi-shot creation with narrative structure, cinematic control, audio, and cross-modal synchronization. However, evaluating such videos…

计算与语言 · 计算机科学 2026-05-29 Jiamin Chen , Qianben Chen , Jiawen Zhang , Yidi Wu , Yuchen Li , Xiaokun Zhang , Wangchunshu Zhou , Chen Ma

AI-generated video generation continues its journey through the uncanny valley to produce content that is increasingly perceptually indistinguishable from reality. To better protect individuals, organizations, and societies from its…

计算机视觉与模式识别 · 计算机科学 2025-06-24 Matyas Bohacek , Hany Farid

Generative artificial intelligence has recently progressed from static image and video synthesis to 3D content generation, culminating in the emergence of 4D generation-the task of synthesizing temporally coherent dynamic 3D assets guided…

计算机视觉与模式识别 · 计算机科学 2025-07-25 Qiaowei Miao , Kehan Li , Jinsheng Quan , Zhiyuan Min , Shaojie Ma , Yichao Xu , Yi Yang , Ping Liu , Yawei Luo

Controllable human video generation aims to produce realistic videos of humans with explicitly guided motions and appearances,serving as a foundation for digital humans, animation, and embodied AI.However, the scarcity of largescale,…

计算机视觉与模式识别 · 计算机科学 2026-04-24 Yuanchen Fei , Yude Zou , Zejian Kang , Ming Li , Jiaying Zhou , Xiangru Huang

Every day, humans perform many closely related activities that involve subtle discriminative motions, such as putting on a shirt vs. putting on a jacket, or shaking hands vs. giving a high five. Activity recognition by ethical visual AI…

计算机视觉与模式识别 · 计算机科学 2022-10-21 Jeffrey Byrne , Greg Castanon , Zhongheng Li , Gil Ettinger

Computer-using agents (CUAs) must plan task workflows across diverse and evolving applications, yet progress is limited by the lack of large-scale, high-quality training data. Existing datasets are narrow, static, and costly to annotate,…

人工智能 · 计算机科学 2026-03-17 Chan Hee Song , Yiwen Song , Palash Goyal , Yu Su , Oriana Riva , Hamid Palangi , Tomas Pfister