English
Related papers

Related papers: LLM4Mat-Bench: Benchmarking Large Language Models …

200 papers

Large Language Models (LLMs) hold significant potential for advancing fact-checking by leveraging their capabilities in reasoning, evidence retrieval, and explanation generation. However, existing benchmarks fail to comprehensively evaluate…

Computation and Language · Computer Science 2025-06-17 Shuo Yang , Yuqin Dai , Guoqing Wang , Xinran Zheng , Jinfeng Xu , Jinze Li , Zhenzhe Ying , Weiqiang Wang , Edith C. H. Ngai

Recently, large language models (LLMs) have achieved remarkable breakthroughs in general domains such as programming and writing, and have demonstrated strong potential in various scientific research scenarios. However, the capabilities of…

Machine Learning · Computer Science 2025-09-16 Yonghao Weng , Liqiang Gao , Linwu Zhu , Jian Huang

Information extraction and textual comprehension from materials literature are vital for developing an exhaustive knowledge base that enables accelerated materials discovery. Language models have demonstrated their capability to answer…

Computation and Language · Computer Science 2023-08-21 Mohd Zaki , Jayadeva , Mausam , N. M. Anoop Krishnan

The recent progress of using graph based encoding of crystal structures for high throughput material property prediction has been quite successful. However, using a single modality model prevents us from exploiting the advantages of an…

Machine Learning · Computer Science 2025-05-09 Abhiroop Bhattacharya , Sylvain G. Cloutier

Property prediction accuracy has long been a key parameter of machine learning in materials informatics. Accordingly, advanced models showing state-of-the-art performance turn into highly parameterized black boxes missing interpretability.…

Materials Science · Physics 2023-08-03 Vadim Korolev , Pavel Protsenko

As the application of large language models in various fields continues to expand, materials science also ushers in opportunities for AI-driven innovation. The traditional way of relying on manual search for materials science-related…

Artificial Intelligence · Computer Science 2024-11-14 Chao Huang , Huichen Xiao , Chen Chen , Chunyan Chen , Yi Zhao , Shiyu Du , Yiming Zhang , He Sha , Ruixin Gu

Discovering new materials can have significant scientific and technological implications but remains a challenging problem today due to the enormity of the chemical space. Recent advances in machine learning have enabled data-driven methods…

Materials Science · Physics 2024-06-21 Shuyi Jia , Chao Zhang , Victor Fung

Metal-organic frameworks (MOFs) are porous crystalline materials with broad applications such as carbon capture and drug delivery, yet accurately predicting their 3D structures remains a significant challenge. While Large Language Models…

Machine Learning · Computer Science 2026-01-15 Mianzhi Pan , JianFei Li , Peishuo Liu , Botian Wang , Yawen Ouyang , Yiming Rong , Hao Zhou , Jianbing Zhang

Large language models have demonstrated remarkable reasoning capabilities across diverse natural language tasks. However, comparable breakthroughs in scientific discovery are more limited, because understanding complex physical phenomena…

Machine Learning · Computer Science 2025-10-27 Jiyu Cui , Fang Wu , Haokai Zhao , Minggao Feng , Xenophon Evangelopoulos , Andrew I. Cooper , Yejin Choi

The parallels between protein sequences and natural language in their sequential structures have inspired the application of large language models (LLMs) to protein understanding. Despite the success of LLMs in NLP, their effectiveness in…

Quantitative Methods · Quantitative Biology 2024-07-09 Yiqing Shen , Zan Chen , Michail Mamalakis , Luhan He , Haiyang Xia , Tianbin Li , Yanzhou Su , Junjun He , Yu Guang Wang

The capabilities of large language models (LLMs) have expanded beyond natural language processing to scientific prediction tasks, including molecular property prediction. However, their effectiveness in in-context learning remains…

Large Language Models (LLMs) have made significant progress in reasoning, demonstrating their capability to generate human-like responses. This study analyzes the problem-solving capabilities of LLMs in the domain of thermodynamics. A…

Computational Engineering, Finance, and Science · Computer Science 2025-12-18 Rebecca Loubet , Pascal Zittlau , Luisa Vollmer , Marco Hoffmann , Sophie Fellenz , Fabian Jirasek , Heike Leitte , Hans Hasse

With the emergence of Multimodal Large Language Models (MLLMs), hundreds of benchmarks have been developed to ensure the reliability of MLLMs in downstream tasks. However, the evaluation mechanism itself may not be reliable. For developers…

Computation and Language · Computer Science 2025-03-14 Chunyi Li , Xiaozhe Li , Zicheng Zhang , Yuan Tian , Ziheng Jia , Xiaohong Liu , Xiongkuo Min , Jia Wang , Haodong Duan , Kai Chen , Guangtao Zhai

In this work we introduce an open-ended question benchmark, ALDbench, to evaluate the performance of large language models (LLMs) in materials synthesis, and in particular in the field of atomic layer deposition, a thin film growth…

Goal-oriented de novo molecule design, namely generating molecules with specific property or substructure constraints, is a crucial yet challenging task in drug discovery. Existing methods, such as Bayesian optimization and reinforcement…

Computational Engineering, Finance, and Science · Computer Science 2025-02-28 Chuanliu Fan , Ziqiang Cao , Zicheng Ma , Nan Yu , Yimin Peng , Jun Zhang , Yiqin Gao , Guohong Fu

Large language models are increasingly applied to materials science, yet fundamental questions remain about their reliability and knowledge encoding. Evaluating 25 LLMs across four materials science tasks -- over 200 base and fine-tuned…

Materials Science · Physics 2026-03-03 Vineeth Venugopal , Soroush Mahjoubi , Elsa Olivetti

Large language models (LLMs) offer new opportunities for automated data extraction and property prediction across materials science, yet their use in superconductivity research remains limited. Here we construct a large experimental…

Materials Science · Physics 2025-12-12 Suman Itani , Yibo Zhang , Ranjit Itani , Jiadong Zang

Large Language Models (LLMs) have seen great advance in both academia and industry, and their popularity results in numerous open-source frameworks and techniques in accelerating LLM pre-training, fine-tuning, and inference. Training and…

Performance · Computer Science 2023-12-04 Longteng Zhang , Xiang Liu , Zeyu Li , Xinglin Pan , Peijie Dong , Ruibo Fan , Rui Guo , Xin Wang , Qiong Luo , Shaohuai Shi , Xiaowen Chu

Large language models (LLMs) are rapidly transforming materials science. This review examines recent LLM applications across the materials discovery pipeline, focusing on three key areas: mining scientific literature , predictive modelling,…

Computation and Language · Computer Science 2025-11-17 Fengxu Yang , Weitong Chen , Jack D. Evans

As educational systems evolve, ensuring that assessment items remain aligned with content standards is essential for maintaining fairness and instructional relevance. Traditional human alignment reviews are accurate but slow and…

Artificial Intelligence · Computer Science 2025-11-26 Farzan Karimi-Malekabadi , Pooya Razavi , Sonya Powers