English
Related papers

Related papers: 3D-VirtFusion: Synthetic 3D Data Augmentation thro…

200 papers

The success of deep learning depends heavily on the availability of large datasets, but in robotic manipulation there are many learning problems for which such datasets do not exist. Collecting these datasets is time-consuming and…

Robotics · Computer Science 2022-07-21 Peter Mitrano , Dmitry Berenson

Diffusion-based models, widely used in text-to-image generation, have proven effective in 2D representation learning. Recently, this framework has been extended to 3D self-supervised learning by constructing a conditional point generator…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Yiyang Chen , Shanshan Zhao , Lunhao Duan , Changxing Ding , Dacheng Tao

Despite remarkable progress having been made on the problem of 3D human pose and shape estimation (HPS), current state-of-the-art methods rely heavily on either confined indoor mocap datasets or datasets generated by a rendering engine…

Computer Vision and Pattern Recognition · Computer Science 2025-10-20 Yongtao Ge , Wenjia Wang , Yongfan Chen , Fanzhou Wang , Lei Yang , Hao Chen , Chunhua Shen

Generating high-quality 3D assets from text and images has long been challenging, primarily due to the absence of scalable 3D representations capable of capturing intricate geometry distributions. In this work, we introduce Direct3D, a…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Shuang Wu , Youtian Lin , Feihu Zhang , Yifei Zeng , Jingxi Xu , Philip Torr , Xun Cao , Yao Yao

Current deep networks are very data-hungry and benefit from training on largescale datasets, which are often time-consuming to collect and annotate. By contrast, synthetic data can be generated infinitely using generative models such as…

Computer Vision and Pattern Recognition · Computer Science 2023-10-11 Weijia Wu , Yuzhong Zhao , Hao Chen , Yuchao Gu , Rui Zhao , Yefei He , Hong Zhou , Mike Zheng Shou , Chunhua Shen

Text-to-image diffusion models have attracted considerable interest due to their wide applicability across diverse fields. However, challenges persist in creating controllable models for personalized object generation. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2023-06-30 Yuheng Li , Haotian Liu , Yangming Wen , Yong Jae Lee

In this paper, we propose a novel data augmentation technique called GenMix, which combines generative and mixture approaches to leverage the strengths of both methods. While generative models excel at creating new data patterns, they face…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Hansang Lee , Haeil Lee , Helen Hong

Many approaches have been proposed to use diffusion models to augment training datasets for downstream tasks, such as classification. However, diffusion models are themselves trained on large datasets, often with noisy annotations, and it…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Max F. Burg , Florian Wenzel , Dominik Zietlow , Max Horn , Osama Makansi , Francesco Locatello , Chris Russell

Generating diverse and high-quality 3D assets automatically poses a fundamental yet challenging task in 3D computer vision. Despite extensive efforts in 3D generation, existing optimization-based approaches struggle to produce large-scale…

Computer Vision and Pattern Recognition · Computer Science 2024-05-15 Ziang Cao , Fangzhou Hong , Tong Wu , Liang Pan , Ziwei Liu

Neuron segmentation in electron microscopy (EM) aims to reconstruct the complete neuronal connectome; however, current deep learning-based methods are limited by their reliance on large-scale training data and extensive, time-consuming…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Liuyun Jiang , Yanchao Zhang , Jinyue Guo , Yizhuo Lu , Ruining Zhou , Hua Han

Diffusion models are a special type of generative model, capable of synthesising new data from a learnt distribution. We introduce DISPR, a diffusion-based model for solving the inverse problem of three-dimensional (3D) cell shape…

Computer Vision and Pattern Recognition · Computer Science 2023-03-15 Dominik J. E. Waibel , Ernst Röell , Bastian Rieck , Raja Giryes , Carsten Marr

The ability to generate virtual environments is crucial for applications ranging from gaming to physical AI domains such as robotics, autonomous driving, and industrial AI. Current learning-based 3D reconstruction methods rely on the…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Sherwin Bahmani , Tianchang Shen , Jiawei Ren , Jiahui Huang , Yifeng Jiang , Haithem Turki , Andrea Tagliasacchi , David B. Lindell , Zan Gojcic , Sanja Fidler , Huan Ling , Jun Gao , Xuanchi Ren

Recent advances in generative models, such as diffusion models, have made generating high-quality synthetic images widely accessible. Prior works have shown that training on synthetic images improves many perception tasks, such as image…

Computer Vision and Pattern Recognition · Computer Science 2024-04-18 Jacob Schnell , Jieke Wang , Lu Qi , Vincent Tao Hu , Meng Tang

Object manipulation in images aims to not only edit the object's presentation but also gift objects with motion. Previous methods encountered challenges in concurrently handling static editing and dynamic generation, while also struggling…

Computer Vision and Pattern Recognition · Computer Science 2025-01-23 Ruisi Zhao , Zechuan Zhang , Zongxin Yang , Yi Yang

Ensuring the robustness of deep learning models requires comprehensive and diverse testing. Existing approaches, often based on simple data augmentation techniques or generative adversarial networks, are limited in producing realistic and…

Computer Vision and Pattern Recognition · Computer Science 2025-02-10 Luciano Baresi , Davide Yi Xian Hu , Muhammad Irfan Mas'udi , Giovanni Quattrocchi

In this paper, we investigate the use of diffusion models which are pre-trained on large-scale image-caption pairs for open-vocabulary 3D semantic understanding. We propose a novel method, namely Diff2Scene, which leverages frozen…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Xiaoyu Zhu , Hao Zhou , Pengfei Xing , Long Zhao , Hao Xu , Junwei Liang , Alexander Hauptmann , Ting Liu , Andrew Gallagher

Recent years have witnessed remarkable progress in multi-view diffusion models for 3D content creation. However, there remains a significant gap in image quality and prompt-following ability compared to 2D diffusion models. A critical…

Computer Vision and Pattern Recognition · Computer Science 2024-10-04 Zeyi Sun , Tong Wu , Pan Zhang , Yuhang Zang , Xiaoyi Dong , Yuanjun Xiong , Dahua Lin , Jiaqi Wang

Nuclei segmentation is a fundamental but challenging task in the quantitative analysis of histopathology images. Although fully-supervised deep learning-based methods have made significant progress, a large number of labeled images are…

Image and Video Processing · Electrical Eng. & Systems 2024-01-22 Xinyi Yu , Guanbin Li , Wei Lou , Siqi Liu , Xiang Wan , Yan Chen , Haofeng Li

Modern 3D generation methods can rapidly create shapes from sparse or single views, but their outputs often lack geometric detail due to computational constraints. We present DetailGen3D, a generative approach specifically designed to…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Ken Deng , Yuan-Chen Guo , Jingxiang Sun , Zi-Xin Zou , Yangguang Li , Xin Cai , Yan-Pei Cao , Yebin Liu , Ding Liang

Generative models have been widely studied in computer vision. Recently, diffusion models have drawn substantial attention due to the high quality of their generated images. A key desired property of image generative models is the ability…

Computer Vision and Pattern Recognition · Computer Science 2022-12-20 Qiucheng Wu , Yujian Liu , Handong Zhao , Ajinkya Kale , Trung Bui , Tong Yu , Zhe Lin , Yang Zhang , Shiyu Chang