中文
相关论文

相关论文: RoboSwap: A GAN-driven Video Diffusion Framework F…

200 篇论文

We present a cross robot visuomotor learning framework that integrates diffusion policy based control with 3D semantic scene representations from D3Fields to enable category level generalization in manipulation. Its modular design supports…

We present RoboGen, a generative robotic agent that automatically learns diverse robotic skills at scale via generative simulation. RoboGen leverages the latest advancements in foundation and generative models. Instead of directly using or…

A basic, and still largely unanswered, question in the context of Generative Adversarial Networks (GANs) is whether they are truly able to capture all the fundamental characteristics of the distributions they are trained on. In particular,…

机器学习 · 计算机科学 2018-06-07 Shibani Santurkar , Ludwig Schmidt , Aleksander Mądry

We propose a new method for realistic human motion transfer using a generative adversarial network (GAN), which generates a motion video of a target character imitating actions of a source character, while maintaining high authenticity of…

图形学 · 计算机科学 2023-05-09 Yang-Tian Sun , Qian-Cheng Fu , Yue-Ren Jiang , Zitao Liu , Yu-Kun Lai , Hongbo Fu , Lin Gao

Recent video generation models have achieved remarkable progress and are now deployed in film, social media production, and advertising. Beyond their creative potential, such models also hold promise as world simulators for robotics and…

计算机视觉与模式识别 · 计算机科学 2026-03-24 David Romero , Ariana Bermudez , Viacheslav Iablochnikov , Hao Li , Fabio Pizzati , Ivan Laptev

We present a novel learning-based framework for face reenactment. The proposed method, known as ReenactGAN, is capable of transferring facial movements and expressions from monocular video input of an arbitrary person to a target person.…

计算机视觉与模式识别 · 计算机科学 2018-07-31 Wayne Wu , Yunxuan Zhang , Cheng Li , Chen Qian , Chen Change Loy

Animating virtual avatars to make co-speech gestures facilitates various applications in human-machine interaction. The existing methods mainly rely on generative adversarial networks (GANs), which typically suffer from notorious mode…

计算机视觉与模式识别 · 计算机科学 2023-03-21 Lingting Zhu , Xian Liu , Xuanyu Liu , Rui Qian , Ziwei Liu , Lequan Yu

Image diffusion models are trained on independently sampled static images. While this is the bedrock task protocol in generative modeling, capturing the temporal world through the lens of static snapshots is information-deficient by design.…

计算机视觉与模式识别 · 计算机科学 2025-09-05 Juhun Lee , Simon S. Woo

Cross-embodiment learning seeks to build generalist robots that operate across diverse morphologies, but differences in action spaces and kinematics hinder data sharing and policy transfer. This raises a central question: Is there any…

机器人学 · 计算机科学 2025-11-11 Zihao He , Bo Ai , Tongzhou Mu , Yulin Liu , Weikang Wan , Jiawei Fu , Yilun Du , Henrik I. Christensen , Hao Su

As generative techniques become increasingly accessible, authentic visuals are frequently subjected to iterative alterations by various individuals employing a variety of tools. Currently, to avoid misinformation and ensure accountability,…

计算机视觉与模式识别 · 计算机科学 2025-06-04 Zhiya Tan , Xin Zhang , Joey Tianyi Zhou

With the explosive popularity of AI-generated content (AIGC), video generation has recently received a lot of attention. Generating videos guided by text instructions poses significant challenges, such as modeling the complex relationship…

计算机视觉与模式识别 · 计算机科学 2024-04-25 Wenjing Wang , Huan Yang , Zixi Tuo , Huiguo He , Junchen Zhu , Jianlong Fu , Jiaying Liu

Large-scale video generation models have the inherent ability to realistically model natural scenes. In this paper, we demonstrate that through a careful design of a generative video propagation framework, various video tasks can be…

计算机视觉与模式识别 · 计算机科学 2024-12-30 Shaoteng Liu , Tianyu Wang , Jui-Hsien Wang , Qing Liu , Zhifei Zhang , Joon-Young Lee , Yijun Li , Bei Yu , Zhe Lin , Soo Ye Kim , Jiaya Jia

We present PoseDiff, a conditional diffusion model that unifies robot state estimation and control within a single framework. At its core, PoseDiff maps raw visual observations into structured robot states-such as 3D keypoints or joint…

机器人学 · 计算机科学 2025-11-03 Haozhuo Zhang , Michele Caprio , Jing Shao , Qiang Zhang , Jian Tang , Shanghang Zhang , Wei Pan

The development of generalist robot manipulation policies has seen significant progress, driven by large-scale demonstration data across diverse environments. However, the high cost and inefficiency of collecting real-world demonstrations…

计算机视觉与模式识别 · 计算机科学 2025-07-01 Tao Tang , Likui Zhang , Youpeng Wen , Kaidong Zhang , Jia-Wang Bian , xia zhou , Tianyi Yan , Kun Zhan , Peng Jia , Hefeng Wu , Liang Lin , Xiaodan Liang

The recent wave of AI-generated content (AIGC) has witnessed substantial success in computer vision, with the diffusion model playing a crucial role in this achievement. Due to their impressive generative capabilities, diffusion models are…

计算机视觉与模式识别 · 计算机科学 2024-09-17 Zhen Xing , Qijun Feng , Haoran Chen , Qi Dai , Han Hu , Hang Xu , Zuxuan Wu , Yu-Gang Jiang

Street view imagery has become an essential source for geospatial data collection and urban analytics, enabling the extraction of valuable insights that support informed decision-making. However, synthesizing street-view images from…

计算机视觉与模式识别 · 计算机科学 2025-09-30 Khawlah Bajbaa , Abbas Anwar , Muhammad Saqib , Hafeez Anwar , Nabin Sharma , Muhammad Usman

Generative Adversarial Networks (GANs) have made a dramatic leap in high-fidelity image synthesis and stylized face generation. Recently, a layer-swapping mechanism has been developed to improve the stylization performance. However, this…

计算机视觉与模式识别 · 计算机科学 2021-10-25 Mingcong Liu , Qiang Li , Zekui Qin , Guoxin Zhang , Pengfei Wan , Wen Zheng

This survey provides a comprehensive review on recent advancements of generative learning models in robotic manipulation, addressing key challenges in the field. Robotic manipulation faces critical bottlenecks, including significant…

Current face reenactment and swapping methods mainly rely on GAN frameworks, but recent focus has shifted to pre-trained diffusion models for their superior generation capabilities. However, training these models is resource-intensive, and…

计算机视觉与模式识别 · 计算机科学 2024-07-10 Yue Han , Junwei Zhu , Keke He , Xu Chen , Yanhao Ge , Wei Li , Xiangtai Li , Jiangning Zhang , Chengjie Wang , Yong Liu

This Paper deals with robotic arm embed controller system, with distributed system based on protocol communication between one server supporting multiple points and mobile applications trough sockets .The proposed system utilizes hand with…

机器人学 · 计算机科学 2014-04-15 Luiz Cortinhas , Patrick Monteiro , Amir Zahlan , Gabriel Vianna , Marcio Moscoso