English
Related papers

Related papers: Blaze3DM: Marry Triplane Representation with Diffu…

200 papers

Inverse design refers to the problem of optimizing the input of an objective function in order to enact a target outcome. For many real-world engineering problems, the objective function takes the form of a simulator that predicts how the…

Predictive models trained on imbalanced data tend to produce biased results. This problem is exacerbated when there is not just one output label, but a set of them. This is the case for multilabel learning (MLL) algorithms used to classify…

Machine Learning · Computer Science 2025-01-22 Francisco Charte , Miguel Ángel Dávila , María Dolores Pérez-Godoy , María José del Jesus

Latent diffusion models (LDMs) achieve state-of-the-art performance across various tasks, including image generation and video synthesis. However, they generally lack robustness, a limitation that remains not fully explored in current…

Machine Learning · Computer Science 2025-06-10 Boris Martirosyan , Alexey Karmanov

Many inverse problems are ill-posed and need to be complemented by prior information that restricts the class of admissible models. Bayesian approaches encode this information as prior distributions that impose generic properties on the…

Machine Learning · Computer Science 2024-12-20 Julian L. Möbius , Michael Habeck

Generating diverse and high-quality 3D assets automatically poses a fundamental yet challenging task in 3D computer vision. Despite extensive efforts in 3D generation, existing optimization-based approaches struggle to produce large-scale…

Computer Vision and Pattern Recognition · Computer Science 2024-05-15 Ziang Cao , Fangzhou Hong , Tong Wu , Liang Pan , Ziwei Liu

We address the problem of data augmentation in a rotating turbulence set-up, a paradigmatic challenge in geophysical applications. The goal is to reconstruct information in two-dimensional (2D) cuts of the three-dimensional flow fields,…

3D anomaly detection plays a crucial role in monitoring parts for localized inherent defects in precision manufacturing. Embedding-based and reconstruction-based approaches are among the most popular and successful methods. However, there…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Zheyuan Zhou , Le Wang , Naiyu Fang , Zili Wang , Lemiao Qiu , Shuyou Zhang

Diffusion model-based approaches recently achieved re-markable success in MRI reconstruction, but integration into clinical routine remains challenging due to its time-consuming convergence. This phenomenon is partic-ularly notable when…

Image and Video Processing · Electrical Eng. & Systems 2024-11-07 Yu Guan , Qinrong Cai , Wei Li , Qiuyun Fan , Dong Liang , Qiegen Liu

Diffusion models have achieved great success in generating 2D images. However, the quality and generalizability of 3D content generation remain limited. State-of-the-art methods often require large-scale 3D assets for training, which are…

Graphics · Computer Science 2025-03-24 Jiantao Lin , Xin Yang , Meixi Chen , Yingjie Xu , Dongyu Yan , Leyi Wu , Xinli Xu , Lie XU , Shunsi Zhang , Ying-Cong Chen

Diffusion models have recently emerged as powerful generative models in medical imaging. However, it remains a major challenge to combine these data-driven models with domain knowledge to guide brain imaging problems. In neuroimaging,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-19 Ana Lawry Aguila , Dina Zemlyanker , You Cheng , Sudeshna Das , Daniel C. Alexander , Oula Puonti , Annabel Sorby-Adams , W. Taylor Kimberly , Juan Eugenio Iglesias

3D object generation from a single image involves estimating the full 3D geometry and texture of unseen views from an unposed RGB image captured in the wild. Accurately reconstructing an object's complete 3D structure and texture has…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 Hritam Basak , Hadi Tabatabaee , Shreekant Gayaka , Ming-Feng Li , Xin Yang , Cheng-Hao Kuo , Arnie Sen , Min Sun , Zhaozheng Yin

Different modalities of medical images provide unique physiological and anatomical information for diseases. Multi-modal medical image fusion integrates useful information from different complementary medical images with different…

Computer Vision and Pattern Recognition · Computer Science 2025-09-12 Yushen Xu , Xiaosong Li , Yuchun Wang , Xiaoqi Cheng , Huafeng Li , Haishu Tan

In this work, we introduce Wonder3D, a novel method for efficiently generating high-fidelity textured meshes from single-view images.Recent methods based on Score Distillation Sampling (SDS) have shown the potential to recover 3D geometry…

Computer Vision and Pattern Recognition · Computer Science 2023-11-10 Xiaoxiao Long , Yuan-Chen Guo , Cheng Lin , Yuan Liu , Zhiyang Dou , Lingjie Liu , Yuexin Ma , Song-Hai Zhang , Marc Habermann , Christian Theobalt , Wenping Wang

Diffusion MRI (dMRI) is an advanced imaging technique characterizing tissue microstructure and white matter structural connectivity of the human brain. The demand for high-quality dMRI data is growing, driven by the need for better…

Image and Video Processing · Electrical Eng. & Systems 2024-08-26 Xi Zhu , Wei Zhang , Yijie Li , Lauren J. O'Donnell , Fan Zhang

In the medical domain, acquiring large datasets is challenging due to both accessibility issues and stringent privacy regulations. Consequently, data availability and privacy protection are major obstacles to applying machine learning in…

Image and Video Processing · Electrical Eng. & Systems 2025-07-02 Wenwu Tang , Khaled Seyam , Bin Yang

Recent advancements in 3D content generation from text or a single image struggle with limited high-quality 3D datasets and inconsistency from 2D multi-view generation. We introduce DiffSplat, a novel 3D generative framework that natively…

Computer Vision and Pattern Recognition · Computer Science 2025-01-29 Chenguo Lin , Panwang Pan , Bangbang Yang , Zeming Li , Yadong Mu

Denoising diffusion models have demonstrated outstanding results in 2D image generation, yet it remains a challenge to replicate its success in 3D shape generation. In this paper, we propose leveraging multi-view depth, which represents…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Zhen Wang , Qiangeng Xu , Feitong Tan , Menglei Chai , Shichen Liu , Rohit Pandey , Sean Fanello , Achuta Kadambi , Yinda Zhang

Text-to-image diffusion models pre-trained on billions of image-text pairs have recently enabled 3D content creation by optimizing a randomly initialized differentiable 3D representation with score distillation. However, the optimization…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Yukun Huang , Jianan Wang , Yukai Shi , Boshi Tang , Xianbiao Qi , Lei Zhang

We propose \textbf{DMV3D}, a novel 3D generation approach that uses a transformer-based 3D large reconstruction model to denoise multi-view diffusion. Our reconstruction model incorporates a triplane NeRF representation and can denoise…

Computer Vision and Pattern Recognition · Computer Science 2023-11-16 Yinghao Xu , Hao Tan , Fujun Luan , Sai Bi , Peng Wang , Jiahao Li , Zifan Shi , Kalyan Sunkavalli , Gordon Wetzstein , Zexiang Xu , Kai Zhang

We present DiffInDScene, a novel framework for tackling the problem of high-quality 3D indoor scene generation, which is challenging due to the complexity and diversity of the indoor scene geometry. Although diffusion-based generative…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Xiaoliang Ju , Zhaoyang Huang , Yijin Li , Guofeng Zhang , Yu Qiao , Hongsheng Li