English
Related papers

Related papers: M^3ashy: Multi-Modal Material Synthesis via Hyperd…

200 papers

The novel neural networks show great potential in solving partial differential equations. For single-phase flow problems in subsurface porous media with high-contrast coefficients, the key is to develop neural operators with accurate…

Machine Learning · Computer Science 2025-09-17 Peiqi Li , Jie Chen

Recent years have witnessed remarkable progress in multi-view diffusion models for 3D content creation. However, there remains a significant gap in image quality and prompt-following ability compared to 2D diffusion models. A critical…

Computer Vision and Pattern Recognition · Computer Science 2024-10-04 Zeyi Sun , Tong Wu , Pan Zhang , Yuhang Zang , Xiaoyi Dong , Yuanjun Xiong , Dahua Lin , Jiaqi Wang

Creating diverse and high-quality 3D assets with an automatic generative model is highly desirable. Despite extensive efforts on 3D generation, most existing works focus on the generation of a single category or a few categories. In this…

Computer Vision and Pattern Recognition · Computer Science 2023-09-18 Ziang Cao , Fangzhou Hong , Tong Wu , Liang Pan , Ziwei Liu

We introduce PolyDiff, the first diffusion-based approach capable of directly generating realistic and diverse 3D polygonal meshes. In contrast to methods that use alternate 3D shape representations (e.g. implicit representations), our…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Antonio Alliegro , Yawar Siddiqui , Tatiana Tommasi , Matthias Nießner

We present a diffusion-based model for 3D-aware generative novel view synthesis from as few as a single input image. Our model samples from the distribution of possible renderings consistent with the input and, even in the presence of…

Computer Vision and Pattern Recognition · Computer Science 2023-04-06 Eric R. Chan , Koki Nagano , Matthew A. Chan , Alexander W. Bergman , Jeong Joon Park , Axel Levy , Miika Aittala , Shalini De Mello , Tero Karras , Gordon Wetzstein

Understanding and generating the fine-grained structure of objects -- such as birds with species-specific beaks, wings, and tails -- is a long-standing challenge in computer vision. We propose Chirpy3D, a part-aware multi-view diffusion…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Kam Woh Ng , Jing Yang , Jia Wei Sii , Chee Seng Chan , Jiankang Deng , Yi-Zhe Song , Tao Xiang , Xiatian Zhu

Texture map production is an important part of 3D modeling and determines the rendering quality. Recently, diffusion-based methods have opened a new way for texture generation. However, restricted control flexibility and limited prompt…

Graphics · Computer Science 2025-06-04 Dongyu Yan , Leyi Wu , Jiantao Lin , Luozhou Wang , Tianshuo Xu , Zhifei Chen , Zhen Yang , Lie Xu , Shunsi Zhang , Yingcong Chen

Recent advances in text-to-image generation with diffusion models present transformative capabilities in image quality. However, user controllability of the generated image, and fast adaptation to new tasks still remains an open challenge,…

Computer Vision and Pattern Recognition · Computer Science 2023-02-17 Omer Bar-Tal , Lior Yariv , Yaron Lipman , Tali Dekel

Advancements in text-to-image diffusion models have led to significant progress in fast 3D content creation. One common approach is to generate a set of multi-view images of an object, and then reconstruct it into a 3D model. However, this…

Computer Vision and Pattern Recognition · Computer Science 2024-12-04 Yiftach Edelstein , Or Patashnik , Dana Cohen-Bar , Lihi Zelnik-Manor

Recently, Hyperspectral Image (HSI) classification has attracted increasing attention in remote sensing. However, HSI data are inherently high-dimensional but low-rank, with discriminative information concentrated on a low-dimensional…

Computer Vision and Pattern Recognition · Computer Science 2026-04-30 Boxiang Yang , Ning Chen , Xia Yue , Yichang Luo , Yingbo Fan , Haoyuan Zhang , Haoyu Ma , Jun Yue , Shanjun Mao

Recent advancements in 3D generation are predominantly propelled by improvements in 3D-aware image diffusion models. These models are pretrained on Internet-scale image data and fine-tuned on massive 3D data, offering the capability of…

Computer Vision and Pattern Recognition · Computer Science 2024-10-03 Zeyu Yang , Zijie Pan , Chun Gu , Li Zhang

Anomaly synthesis is one of the effective methods to augment abnormal samples for training. However, current anomaly synthesis methods predominantly rely on texture information as input, which limits the fidelity of synthesized abnormal…

Computer Vision and Pattern Recognition · Computer Science 2024-05-03 Jie Hu , Yawen Huang , Yilin Lu , Guoyang Xie , Guannan Jiang , Yefeng Zheng , Zhichao Lu

Reconstructing 3D objects from extremely sparse views is a long-standing and challenging problem. While recent techniques employ image diffusion models for generating plausible images at novel viewpoints or for distilling pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Zi-Xin Zou , Weihao Cheng , Yan-Pei Cao , Shi-Sheng Huang , Ying Shan , Song-Hai Zhang

We introduce Intrinsic Image Fusion, a method that reconstructs high-quality physically based materials from multi-view images. Material reconstruction is highly underconstrained and typically relies on analysis-by-synthesis, which requires…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Peter Kocsis , Lukas Höllein , Matthias Nießner

Generating high-quality physically based rendering (PBR) materials is important to achieve realistic rendering in the downstream tasks, yet it remains challenging due to the intertwined effects of materials and lighting. While existing…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Xiaokang Wei , Bowen Zhang , Xianghui Yang , Yuxuan Wang , Chunchao Guo , Xi Zhao , Yan Luximon

As generative models expand the possibilities of visual content creation, layered image synthesis has emerged as a promising direction for controllable and creative editing. However, existing methods struggle to fully realize this…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Kyoungkook Kang , Gyujin Sim , Sunghyun Cho

In this work, we introduce Unique3D, a novel image-to-3D framework for efficiently generating high-quality 3D meshes from single-view images, featuring state-of-the-art generation fidelity and strong generalizability. Previous methods based…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Kailu Wu , Fangfu Liu , Zhihan Cai , Runjie Yan , Hanyang Wang , Yating Hu , Yueqi Duan , Kaisheng Ma

Recent 3D large reconstruction models typically employ a two-stage process, including first generate multi-view images by a multi-view diffusion model, and then utilize a feed-forward model to reconstruct images to 3D content.However,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Zhenyu Tang , Junwu Zhang , Xinhua Cheng , Wangbo Yu , Chaoran Feng , Yatian Pang , Bin Lin , Li Yuan

Efficient exploration of the vast chemical space is a fundamental challenge in materials design and discovery, particularly for designing functional inorganic crystalline materials with targeted properties. Diffusion-based generative models…

Materials Science · Physics 2026-03-20 Sourav Mal , Nehad Ahmed , Junaid Jami , Subhankar Mishra , Prasenjit Sen

Generative diffusion priors have recently achieved state-of-the-art performance in natural image super-resolution, demonstrating a powerful capability to synthesize photorealistic details. However, their direct application to remote sensing…

Computer Vision and Pattern Recognition · Computer Science 2026-04-16 Enzhuo Zhang , Sijie Zhao , Dilxat Muhtar , Zhenshi Li , Xueliang Zhang , Pengfeng Xiao