English
Related papers

Related papers: Periodic Materials Generation using Text-Guided Jo…

200 papers

Due to the vast chemical space, discovering materials with a specific function is challenging. Chemical formulas are obligated to conform to a set of exacting criteria such as charge neutrality, balanced electronegativity, synthesizability,…

Materials Science · Physics 2023-10-03 Rongzhi Dong , Nihang Fu , dirisuriya M. D. Siriwardane , Jianjun Hu

We present a novel method for exemplar-based image translation, called matching interleaved diffusion models (MIDMs). Most existing methods for this task were formulated as GAN-based matching-then-generation framework. However, in this…

Computer Vision and Pattern Recognition · Computer Science 2023-03-30 Junyoung Seo , Gyuseong Lee , Seokju Cho , Jiyoung Lee , Seungryong Kim

Determining whether a candidate crystalline material is thermodynamically stable depends on identifying its true ground-state structure, a central challenge in computational materials science. We introduce CrystalGRW, a diffusion-based…

Two dimensional (2D) materials have emerged as promising functional materials with many applications such as semiconductors and photovoltaics because of their unique optoelectronic properties. While several thousand 2D materials have been…

Materials Science · Physics 2020-12-18 Yuqi Song , Edirisuriya M. Dilanga Siriwardane , Yong Zhao , Jianjun Hu

Density-functional theory with extended Hubbard functionals (DFT+$U$+$V$) provides a robust framework to accurately describe complex materials containing transition-metal or rare-earth elements. It does so by mitigating self-interaction…

Materials Science · Physics 2025-01-30 Martin Uhrin , Austin Zadoks , Luca Binci , Nicola Marzari , Iurii Timrov

Diffusion models, as a novel generative paradigm, have achieved remarkable success in various image generation tasks such as image inpainting, image-to-text translation, and video generation. Graph generation is a crucial computational task…

Machine Learning · Computer Science 2023-08-29 Chengyi Liu , Wenqi Fan , Yunqing Liu , Jiatong Li , Hang Li , Hui Liu , Jiliang Tang , Qing Li

Diffusion Transformers (DiT) trained with flow matching in a VAE latent space have unified visual generation across images and videos. A natural next step toward a single architecture for both generation (visual synthesis) and understanding…

Computation and Language · Computer Science 2026-05-11 Jiaxiu Jiang , Jingjing Ren , Wenbo Li , Bo Wang , Haoze Sun , Yijun Yang , Jianhui Liu , Yanbing Zhang , Shenghe Zheng , Yuan Zhang , Haoyang Huang , Nan Duan , Wangmeng Zuo

Artificial Intelligence-Generated Content (AIGC)-content autonomously produced by AI systems without human intervention-has significantly boosted efficiency across various fields. However, AIGC in material science faces challenges in…

Materials Science · Physics 2025-07-28 Zhilong Song , Shuaihua Lu , Qionghua Zhou , Jinlan Wang

3D molecule generation is crucial for drug discovery and material science, requiring models to process complex multi-modalities, including atom types, chemical bonds, and 3D coordinates. A key challenge is integrating these modalities of…

Machine Learning · Computer Science 2025-10-14 Yanchen Luo , Zhiyuan Liu , Yi Zhao , Sihang Li , Hengxing Cai , Kenji Kawaguchi , Tat-Seng Chua , Yang Zhang , Xiang Wang

3D asset generation is getting massive amounts of attention, inspired by the recent success of text-guided 2D content creation. Existing text-to-3D methods use pretrained text-to-image diffusion models in an optimization problem or…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Lukas Höllein , Aljaž Božič , Norman Müller , David Novotny , Hung-Yu Tseng , Christian Richardt , Michael Zollhöfer , Matthias Nießner

Many generative tasks in chemistry and science involve distributions invariant to group symmetries (e.g., permutation and rotation). A common strategy enforces invariance and equivariance through architectural constraints such as…

Machine Learning · Computer Science 2026-02-17 Cai Zhou , Zijie Chen , Zian Li , Jike Wang , Kaiyi Jiang , Pan Li , Rose Yu , Muhan Zhang , Stephen Bates , Tommi Jaakkola

Despite remarkable progress in autoregressive language models, alternative generative paradigms beyond left-to-right generation are still being actively explored. Discrete diffusion models, with the capacity for parallel generation, have…

Computation and Language · Computer Science 2025-03-10 Minkai Xu , Tomas Geffner , Karsten Kreis , Weili Nie , Yilun Xu , Jure Leskovec , Stefano Ermon , Arash Vahdat

Recent 3D generative models have achieved remarkable performance in synthesizing high resolution photorealistic images with view consistency and detailed 3D shapes, but training them for diverse domains is challenging since it requires…

Computer Vision and Pattern Recognition · Computer Science 2023-04-03 Gwanghyun Kim , Se Young Chun

The recent progress of using graph based encoding of crystal structures for high throughput material property prediction has been quite successful. However, using a single modality model prevents us from exploiting the advantages of an…

Machine Learning · Computer Science 2025-05-09 Abhiroop Bhattacharya , Sylvain G. Cloutier

Multimodal contrastive models have achieved strong performance in text-audio retrieval and zero-shot settings, but improving joint embedding spaces remains an active research area. Less attention has been given to making these systems…

Sound · Computer Science 2025-06-25 Julien Guinot , Elio Quinton , György Fazekas

This work introduces the generative fractional diffusion model for protein generation (ProT-GFDM), a novel generative framework that employs fractional stochastic dynamics for protein backbone structure modeling. This approach builds on the…

Quantitative Methods · Quantitative Biology 2025-05-01 Xiao Liang , Wentao Ma , Eric Paquet , Herna Lydia Viktor , Wojtek Michalowski

Recent strides in Text-to-3D techniques have been propelled by distilling knowledge from powerful large text-to-image diffusion models (LDMs). Nonetheless, existing Text-to-3D approaches often grapple with challenges such as…

Computer Vision and Pattern Recognition · Computer Science 2023-08-23 Yiwen Chen , Chi Zhang , Xiaofeng Yang , Zhongang Cai , Gang Yu , Lei Yang , Guosheng Lin

Existing neural rendering-based text-to-3D-portrait generation methods typically make use of human geometry prior and diffusion models to obtain guidance. However, relying solely on geometry information introduces issues such as the Janus…

Computer Vision and Pattern Recognition · Computer Science 2024-04-17 Yiqian Wu , Hao Xu , Xiangjun Tang , Xien Chen , Siyu Tang , Zhebin Zhang , Chen Li , Xiaogang Jin

Recent advances in generative models have enabled significant progress in tasks such as generating and editing images from text, as well as creating videos from text prompts, and these methods are being applied across various fields.…

Artificial Intelligence · Computer Science 2025-09-03 Taegyeong Lee , Jiwon Park , Kyunga Bang , Seunghyun Hwang , Ung-Jin Jang

Accelerating inverse design of crystalline materials with generative models has significant implications for a range of technologies. Unlike other atomic systems, 3D crystals are invariant to discrete groups of isometries called the space…

Materials Science · Physics 2025-10-27 Rees Chang , Angela Pak , Alex Guerra , Ni Zhan , Nick Richardson , Elif Ertekin , Ryan P. Adams