English
Related papers

Related papers: Lang2Str: Two-Stage Crystal Structure Generation w…

200 papers

We consider the problem of crystal materials generation using language models (LMs). A key step is to convert 3D crystal structures into 1D sequences to be processed by LMs. Prior studies used the crystallographic information framework…

Generative models trained on internet-scale data are capable of generating novel and realistic texts, images, and videos. A natural next question is whether these models can advance science, for example by generating novel stable materials.…

Machine Learning · Computer Science 2024-06-05 Sherry Yang , KwangHwan Cho , Amil Merchant , Pieter Abbeel , Dale Schuurmans , Igor Mordatch , Ekin Dogus Cubuk

Large Language Models (LLMs) have demonstrated exceptional performance across diverse natural language processing tasks. However, these models exhibit a critical limitation in output diversity, often generating highly similar content across…

Computation and Language · Computer Science 2025-11-04 Zhiwen Ruan , Yixia Li , Yefeng Liu , Yun Chen , Weihua Luo , Peng Li , Yang Liu , Guanhua Chen

Large language models (LLMs) have demonstrated impressive abilities in generating unstructured natural language according to instructions. However, their performance can be inconsistent when tasked with producing text that adheres to…

Computation and Language · Computer Science 2024-02-22 Yinghao Li , Rampi Ramprasad , Chao Zhang

Autonomous materials discovery with desired properties is one of the ultimate goals for materials science, and the current studies have been focusing mostly on high-throughput screening based on density functional theory calculations and…

Accessing the synthesizability of crystal structures is pivotal for advancing the practical application of theoretical material structures designed by machine learning or high-throughput screening. However, a significant gap exists between…

Materials Science · Physics 2024-07-10 Zhilong Song , Shuaihua Lu , Minggang Ju , Qionghua Zhou , Jinlan Wang

Recent advancements in text-to-image (T2I) generative models have shown remarkable capabilities in producing diverse and imaginative visuals based on text prompts. Despite the advancement, these diffusion models sometimes struggle to…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Xiaohui Chen , Yongfei Liu , Yingxiang Yang , Jianbo Yuan , Quanzeng You , Li-Ping Liu , Hongxia Yang

Generative modeling has emerged as a promising approach for crystal structure discovery. However, existing LLM-based generative models struggle with low-level atomic precision, while diffusion-based methods fall short in integrating…

Artificial Intelligence · Computer Science 2026-05-18 Yuyang Wu , Stefano Falletta , Delia McGrath , Sherry Yang

Generating molecules that satisfy precise numeric constraints over multiple physicochemical properties is critical and challenging. Although large language models (LLMs) are expressive, they struggle with precise multi-objective control and…

Artificial Intelligence · Computer Science 2026-01-19 Yizhan Li , Florence Cloutier , Sifan Wu , Ali Parviz , Boris Knyazev , Yan Zhang , Glen Berseth , Bang Liu

Crystal structure prediction is a long-standing challenge in materials science, with most data-driven methods developed for inorganic systems. This leaves an important gap for organic crystals, which are central to pharmaceuticals,…

Materials Science · Physics 2026-02-25 Mohammadmahdi Vahediahmar , Matthew A. McDonald , Feng Liu

Crystal generative models have shown rapid progress for accelerating the discovery of bulk, periodic materials. However, many material systems such as 2D superconductors, thin film semiconductors, and catalytic surfaces are diperiodic,…

Materials Science · Physics 2026-05-12 Rees Chang , Andrew Novick , Ryan P Adams , Elif Ertekin

CO2 reduction requires efficient catalysts, yet materials discovery remains bottlenecked by 10-20 year development cycles requiring deep domain expertise. This paper demonstrates how large language models can assist the catalyst discovery…

Materials Science · Physics 2026-03-18 AI Scientists , Xinyi Lin , Danqing Yin , Ying Guo

Large language models have demonstrated remarkable reasoning capabilities across diverse natural language tasks. However, comparable breakthroughs in scientific discovery are more limited, because understanding complex physical phenomena…

Machine Learning · Computer Science 2025-10-27 Jiyu Cui , Fang Wu , Haokai Zhao , Minggao Feng , Xenophon Evangelopoulos , Andrew I. Cooper , Yejin Choi

Generative models have demonstrated substantial promise in Natural Language Processing (NLP) and have found application in designing molecules, as seen in General Pretrained Transformer (GPT) models. In our efforts to develop such a tool…

Machine Learning · Computer Science 2023-11-27 Niklas Dobberstein , Astrid Maass , Jan Hamaekers

Self-supervised neural language models have recently achieved unprecedented success, from natural language processing to learning the languages of biological sequences and organic molecules. These models have demonstrated superior…

In the field of material design, traditional crystal structure prediction approaches require extensive structural sampling through computationally expensive energy minimization methods using either force fields or quantum mechanical…

The design of materials with tailored properties is crucial for technological progress. However, most deep generative models focus exclusively on perfectly ordered crystals, neglecting the important class of disordered materials. To address…

Machine Learning · Computer Science 2026-02-05 Liming Wu , Rui Jiao , Qi Li , Mingze Li , Songyou Li , Shifeng Jin , Wenbing Huang

Recent advances in deep learning have enabled the generation of realistic data by training generative models on large datasets of text, images, and audio. While these models have demonstrated exceptional performance in generating novel and…

Materials Science · Physics 2024-06-17 Izumi Takahara , Kiyou Shibata , Teruyasu Mizoguchi

Materials discovery and development are critical for addressing global challenges. Yet, the exponential growth in materials science literature comprising vast amounts of textual data has created significant bottlenecks in knowledge…

Finding a suitable layout represents a crucial task for diverse applications in graphic design. Motivated by simpler and smoother sampling trajectories, we explore the use of Flow Matching as an alternative to current diffusion-based layout…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Julian Jorge Andrade Guerreiro , Naoto Inoue , Kento Masui , Mayu Otani , Hideki Nakayama