English
Related papers

Related papers: Articulated Kinematics Distillation from Video Dif…

200 papers

Knowledge distillation is normally used to compress a big network, or teacher, onto a smaller one, the student, by training it to match its outputs. Recently, some works have shown that robustness against adversarial attacks can also be…

Machine Learning · Computer Science 2022-03-15 Javier Maroto , Guillermo Ortiz-Jiménez , Pascal Frossard

Generating high-quality 3D assets from textual descriptions remains a pivotal challenge in computer graphics and vision research. Due to the scarcity of 3D data, state-of-the-art approaches utilize pre-trained 2D diffusion priors, optimized…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Ling Yang , Zixiang Zhang , Junlin Han , Bohan Zeng , Runjia Li , Philip Torr , Wentao Zhang

In this paper, we address the challenge of reconstructing general articulated 3D objects from a single video. Existing works employing dynamic neural radiance fields have advanced the modeling of articulated objects like humans and animals…

Computer Vision and Pattern Recognition · Computer Science 2024-04-18 Chaoyue Song , Jiacheng Wei , Chuan-Sheng Foo , Guosheng Lin , Fayao Liu

Recent breakthroughs in text-to-4D generation rely on pre-trained text-to-image and text-to-video models to generate dynamic 3D scenes. However, current text-to-4D methods face a three-way tradeoff between the quality of scene appearance,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Sherwin Bahmani , Ivan Skorokhodov , Victor Rong , Gordon Wetzstein , Leonidas Guibas , Peter Wonka , Sergey Tulyakov , Jeong Joon Park , Andrea Tagliasacchi , David B. Lindell

Action-conditioned surgical video generation is a critical yet highly challenging problem for robotic surgery. The core difficulty is that low-dimensional control vectors must precisely govern complex image-space evolution. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Bohan Li , Shuojue Yang , Baorui Peng , Xianda Guo , Erli Zhang , Youqi Tao , Junfeng Duan , Daguang Xu , Qi Dou , Xin Jin , Wenjun Zeng , Hao Zhao , Yueming Jin

Despite tremendous recent progress in human video generation, generative video diffusion models still struggle to capture the dynamics and physics of human motions faithfully. In this paper, we propose a new framework for human video…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Tao Hu , Varun Jampani

This paper proposes a real-time dynamic scene reconstruction method capable of reproducing the motion, geometry, and segmentation simultaneously given live depth stream from a single RGB-D camera. Our approach fuses geometry frame by frame…

Computer Vision and Pattern Recognition · Computer Science 2018-07-20 Chao Li , Zheheng Zhao , Xiaohu Guo

High-performance Radar-Camera 3D object detection can be achieved by leveraging knowledge distillation without using LiDAR at inference time. However, existing distillation methods typically transfer modality-specific features directly to…

Computer Vision and Pattern Recognition · Computer Science 2025-12-18 Shashank Mishra , Karan Patil , Didier Stricker , Jason Rambach

Articulated 3D objects are critical for embodied AI, robotics, and interactive scene understanding, yet creating simulation-ready assets remains labor-intensive and requires expert modeling of part hierarchies and motion structures. We…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Yumeng He , Ying Jiang , Jiayin Lu , Yin Yang , Chenfanfu Jiang

Articulated objects used in simulation and embodied AI are typically specified by geometry and kinematic structure, but lack the fine-grained dynamical effects that govern realistic mechanical behavior, such as frictional holding, detents,…

Robotics · Computer Science 2026-05-12 Tianhong Gao , Cheng Yu , Yinghao Xu , Mengyu Chu

Knowledge distillation (KD) is a promising yet challenging model compression technique that transfers rich learning representations from a well-performing but cumbersome teacher model to a compact student model. Previous methods for image…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Simiao Li , Yun Zhang , Wei Li , Hanting Chen , Wenjia Wang , Bingyi Jing , Shaohui Lin , Jie Hu

Data-free knowledge distillation (DFKD) has emerged as a pivotal technique in the domain of model compression, substantially reducing the dependency on the original training data. Nonetheless, conventional DFKD methods that employ…

Computer Vision and Pattern Recognition · Computer Science 2024-10-24 Muquan Li , Dongyang Zhang , Tao He , Xiurui Xie , Yuan-Fang Li , Ke Qin

Generative priors of large-scale text-to-image diffusion models enable a wide range of new generation and editing applications on diverse visual modalities. However, when adapting these priors to complex visual modalities, often represented…

Computer Vision and Pattern Recognition · Computer Science 2023-07-12 Subin Kim , Kyungmin Lee , June Suk Choi , Jongheon Jeong , Kihyuk Sohn , Jinwoo Shin

The widespread adoption of Large Language Models (LLMs) for code generation, exemplified by GitHub Copilot\footnote{A coding extension powered by a Code-LLM to assist in code completion tasks} surpassing a million users, highlights the…

Software Engineering · Computer Science 2025-05-13 Ilyas Oulkadda , Julien Perez

Recent advancements in human image animation have been propelled by video diffusion models, yet their reliance on numerous iterative denoising steps results in high inference costs and slow speeds. An intuitive solution involves adopting…

Computer Vision and Pattern Recognition · Computer Science 2025-04-16 Xiang Wang , Shiwei Zhang , Hangjie Yuan , Yujie Wei , Yingya Zhang , Changxin Gao , Yuehuan Wang , Nong Sang

Dynamic 3D interaction has been attracting a lot of attention recently. However, creating such 4D content remains challenging. One solution is to animate 3D scenes with physics-based simulation, which requires manually assigning precise…

Computer Vision and Pattern Recognition · Computer Science 2024-12-19 Tianyu Huang , Haoze Zhang , Yihan Zeng , Zhilu Zhang , Hui Li , Wangmeng Zuo , Rynson W. H. Lau

Distribution matching distillation (DMD) facilitates few-step image generation by aligning a distilled student with a reference multi-step teacher. In practice, however, optimizing DMD can reduce sample diversity in few-step synthesis, and…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Tianhe Wu , Ruibin Li , Lei Zhang , Kede Ma

Diffusion models are the main driver of progress in image and video synthesis, but suffer from slow inference speed. Distillation methods, like the recently introduced adversarial diffusion distillation (ADD) aim to shift the model from…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Axel Sauer , Frederic Boesel , Tim Dockhorn , Andreas Blattmann , Patrick Esser , Robin Rombach

Distribution Matching Distillation (DMD) is a promising score distillation technique that compresses pre-trained teacher diffusion models into efficient one-step or multi-step student generators. Nevertheless, its reliance on the reverse…

Computer Vision and Pattern Recognition · Computer Science 2025-07-25 Yanzuo Lu , Yuxi Ren , Xin Xia , Shanchuan Lin , Xing Wang , Xuefeng Xiao , Andy J. Ma , Xiaohua Xie , Jian-Huang Lai

3D point cloud segmentation faces practical challenges due to the computational complexity and deployment limitations of large-scale transformer-based models. To address this, we propose a novel Structure- and Relation-aware Knowledge…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Yuqi Li , Junhao Dong , Zeyu Dong , Chuanguang Yang , Zhulin An , Yongjun Xu