中文
相关论文

相关论文: Interactive Generation of Laparoscopic Videos with…

200 篇论文

Data scarcity in medical imaging poses significant challenges due to privacy concerns. Diffusion models, a recent generative modeling technique, offer a potential solution by generating synthetic and realistic data. However, questions…

图像与视频处理 · 电气工程与系统科学 2024-12-24 Abdullah al Nomaan Nafi , Md. Alamgir Hossain , Rakib Hossain Rifat , Md Mahabub Uz Zaman , Md Manjurul Ahsan , Shivakumar Raman

Zero-shot, training-free, image-based text-to-video generation is an emerging area that aims to generate videos using existing image-based diffusion models. Current methods in this space require specific architectural changes to image…

计算机视觉与模式识别 · 计算机科学 2025-04-10 Diljeet Jagpal , Xi Chen , Vinay P. Namboodiri

Despite the advances in text-to-image synthesis, particularly with diffusion models, generating visual instructions that require consistent representation and smooth state transitions of objects across sequential steps remains a formidable…

计算机视觉与模式识别 · 计算机科学 2024-06-11 Quynh Phung , Songwei Ge , Jia-Bin Huang

Large-scale generative models, such as text-to-image diffusion models, have garnered widespread attention across diverse domains due to their creative and high-fidelity image generation. Nonetheless, existing large-scale diffusion models…

计算机视觉与模式识别 · 计算机科学 2024-08-28 Younghyun Kim , Geunmin Hwang , Junyu Zhang , Eunbyung Park

Latent Diffusion Models (LDMs) enable high-quality image synthesis while avoiding excessive compute demands by training a diffusion model in a compressed lower-dimensional latent space. Here, we apply the LDM paradigm to high-resolution…

计算机视觉与模式识别 · 计算机科学 2023-12-29 Andreas Blattmann , Robin Rombach , Huan Ling , Tim Dockhorn , Seung Wook Kim , Sanja Fidler , Karsten Kreis

The open-domain video generation models are constrained by the scale of the training video datasets, and some less common actions still cannot be generated. Some researchers explore video editing methods and achieve action generation by…

计算机视觉与模式识别 · 计算机科学 2024-08-26 Jianzhi Liu , Junchen Zhu , Lianli Gao , Heng Tao Shen , Jingkuan Song

Video generation models are rapidly improving in their ability to synthesize human actions in novel contexts, holding the potential to serve as high-level planners for contextual robot control. To realize this potential, a key research…

机器人学 · 计算机科学 2025-12-12 James Ni , Zekai Wang , Wei Lin , Amir Bar , Yann LeCun , Trevor Darrell , Jitendra Malik , Roei Herzig

Recent advances in computer vision have shown promising results in image generation. Diffusion probabilistic models in particular have generated realistic images from textual input, as demonstrated by DALL-E 2, Imagen and Stable Diffusion.…

Long video generation remains a challenging and compelling topic in computer vision. Diffusion based models, among the various approaches to video generation, have achieved state of the art quality with their iterative denoising procedures.…

计算机视觉与模式识别 · 计算机科学 2025-03-14 Siyang Zhang , Harry Yang , Ser-Nam Lim

Recent text-to-video generation approaches rely on computationally heavy training and require large-scale video datasets. In this paper, we introduce a new task of zero-shot text-to-video generation and propose a low-cost approach (without…

计算机视觉与模式识别 · 计算机科学 2023-03-24 Levon Khachatryan , Andranik Movsisyan , Vahram Tadevosyan , Roberto Henschel , Zhangyang Wang , Shant Navasardyan , Humphrey Shi

Sub-visible particle analysis using flow imaging microscopy combined with deep learning has proven effective in identifying particle types, enabling the distinction of harmless components such as silicone oil from protein particles.…

计算机视觉与模式识别 · 计算机科学 2025-08-11 Utku Ozbulak , Michaela Cohrs , Hristo L. Svilenov , Joris Vankerschaver , Wesley De Neve

We present novel approaches involving generative adversarial networks and diffusion models in order to synthesize high quality, live and spoof fingerprint images while preserving features such as uniqueness and diversity. We generate live…

计算机视觉与模式识别 · 计算机科学 2024-03-22 W. Tang , D. Figueroa , D. Liu , K. Johnsson , A. Sopasakis

The task of video generation requires synthesizing visually realistic and temporally coherent video frames. Existing methods primarily use asynchronous auto-regressive models or synchronous diffusion models to address this challenge.…

计算机视觉与模式识别 · 计算机科学 2025-03-11 Mingzhen Sun , Weining Wang , Gen Li , Jiawei Liu , Jiahui Sun , Wanquan Feng , Shanshan Lao , SiYu Zhou , Qian He , Jing Liu

3D scene generation seeks to synthesize spatially structured, semantically meaningful, and photorealistic environments for applications such as immersive media, robotics, autonomous driving, and embodied AI. Early methods based on…

计算机视觉与模式识别 · 计算机科学 2025-05-09 Beichen Wen , Haozhe Xie , Zhaoxi Chen , Fangzhou Hong , Ziwei Liu

Generative models are used as an alternative data augmentation technique to alleviate the data scarcity problem faced in the medical imaging field. Diffusion models have gathered special attention due to their innovative generation…

图像与视频处理 · 电气工程与系统科学 2024-03-27 Ricardo Montoya-del-Angel , Karla Sam-Millan , Joan C Vilanova , Robert Martí

Diffusion models have achieved remarkable progress in the field of video generation. However, their iterative denoising nature requires a large number of inference steps to generate a video, which is slow and computationally expensive. In…

计算机视觉与模式识别 · 计算机科学 2025-03-26 Haiyu Zhang , Xinyuan Chen , Yaohui Wang , Xihui Liu , Yunhong Wang , Yu Qiao

The video generation field has witnessed rapid improvements with the introduction of recent diffusion models. While these models have successfully enhanced appearance quality, they still face challenges in generating coherent and natural…

计算机视觉与模式识别 · 计算机科学 2025-04-21 Yaosi Hu , Zhenzhong Chen , Chong Luo

Computer vision technologies markedly enhance the automation capabilities of robotic-assisted minimally invasive surgery (RAMIS) through advanced tool tracking, detection, and localization. However, the limited availability of comprehensive…

计算机视觉与模式识别 · 计算机科学 2024-07-29 Tianle Zeng , Gerardo Loza Galindo , Junlei Hu , Pietro Valdastri , Dominic Jones

Diffusion-based video generation techniques have significantly improved zero-shot talking-head avatar generation, enhancing the naturalness of both head motion and facial expressions. However, existing methods suffer from poor…

图形学 · 计算机科学 2025-04-24 Lingzhou Mu , Baiji Liu , Ruonan Zhang , Guiming Mo , Jiawei Jin , Kai Zhang , Haozhi Huang

Video diffusion models are able to generate high-quality videos by learning strong spatial-temporal priors on large-scale datasets. In this paper, we aim to investigate whether such priors derived from a generative process are suitable for…

计算机视觉与模式识别 · 计算机科学 2024-11-13 Zejia Weng , Xitong Yang , Zhen Xing , Zuxuan Wu , Yu-Gang Jiang