English
Related papers

Related papers: PFT: Phonon Fine-tuning for Machine Learned Intera…

200 papers

We introduce a computational framework leveraging universal machine learning interatomic potentials (MLIPs) to dramatically accelerate the calculation of photoluminescence (PL) spectra of atomic or molecular emitters with ab initio…

Recently, prompt tuning (PT) has gained increasing attention as a parameter-efficient way of tuning pre-trained language models (PLMs). Despite extensively reducing the number of tunable parameters and achieving satisfying performance, PT…

Computation and Language · Computer Science 2022-11-15 Yufei Huang , Yujia Qin , Huadong Wang , Yichun Yin , Maosong Sun , Zhiyuan Liu , Qun Liu

Accurate molecular property predictions require 3D geometries, which are typically obtained using expensive methods such as density functional theory (DFT). Here, we attempt to obtain molecular geometries by relying solely on machine…

One of the ultimate goals of computational modeling in condensed matter is to be able to accurately compute materials properties with minimal empirical information. First-principles approaches such as the density functional theory (DFT)…

Machine-learned interatomic potentials (MLIPs) are revolutionizing computational materials science and chemistry by offering an efficient alternative to {\em ab initio} molecular dynamics (MD) simulations. However, fitting high-quality…

Computational Physics · Physics 2025-12-12 Ilgar Baghishov , Jan Janssen , Graeme Henkelman , Danny Perez

Supervised fine-tuning (SFT) is a standard approach to adapting large language models (LLMs) to new domains. In this work, we improve the statistical efficiency of SFT by selecting an informative subset of training examples. Specifically,…

Machine Learning · Computer Science 2025-05-22 Rohan Deb , Kiran Thekumparampil , Kousha Kalantari , Gaurush Hiranandani , Shoham Sabach , Branislav Kveton

Machine-learned interatomic potentials (MLIPs) have rapidly progressed in accuracy, speed, and data efficiency in recent years. However, training robust MLIPs in multicomponent systems still remains a challenge. In this work, we train a…

Large Language Models (LLMs) are composed of neurons that exhibit various behaviors and roles, which become increasingly diversified as models scale. Recent studies have revealed that not all neurons are active across different datasets,…

Computation and Language · Computer Science 2024-03-19 Haoyun Xu , Runzhe Zhan , Derek F. Wong , Lidia S. Chao

Information over the phonon band structure is crucial to predicting many thermodynamic properties of materials, such as thermal transport coefficients. Highly accurate phonon dispersion curves can be, in principle, calculated in the…

Materials Science · Physics 2020-11-25 Miquel Royo , Konstanze R. Hahn , Massimiliano Stengel

Parameter-efficient fine-tuning (PEFT) of pre-trained language models (PLMs) has emerged as a highly successful approach, with training only a small number of parameters without sacrificing performance and becoming the de-facto learning…

Computation and Language · Computer Science 2023-10-20 Baohao Liao , Shaomu Tan , Christof Monz

The properties of lithium metal are key parameters in the design of lithium ion and lithium metal batteries. They are difficult to probe experimentally due to the high reactivity and low melting point of lithium as well as the microscopic…

The rapid expansion of large foundation models within the pre-training and fine-tuning framework has underscored that larger models often yield better results. However, the scaling up of large foundation models has led to soaring costs in…

Machine Learning · Computer Science 2024-12-30 Chongjie Si , Xiaokang Yang , Wei Shen

Large language models (LLMs) have shown remarkable abilities in diverse natural language processing (NLP) tasks. The LLMs generally undergo supervised fine-tuning (SFT) followed by preference alignment to be usable in downstream…

Computation and Language · Computer Science 2024-06-27 Shiva Kumar Pentyala , Zhichao Wang , Bin Bi , Kiran Ramnath , Xiang-Bo Mao , Regunathan Radhakrishnan , Sitaram Asur , Na , Cheng

Once trained, machine-learned interatomic potentials (MLIPs) provide a fast and accurate way to study catalytic reaction pathways, but their performance strongly depends on the training set. Here, we compare nine MLIPs trained with…

Moment Tensor Potentials (MTPs) are machine-learning interatomic potentials whose basis functions are typically selected using a level-based scheme that is data-agnostic. We introduce a post-training, cost-aware pruning strategy that…

Materials Science · Physics 2025-10-23 Zijian Meng , Karim Zongo , Matthew Thoms , Ryan Eric Grant , Laurent Karim Béland

Parameter Efficient Fine-Tuning (PEFT) methods have emerged as effective and promising approaches for fine-tuning pre-trained language models. Compared with Full parameter Fine-Tuning (FFT), PEFT achieved comparable task performance with a…

Machine Learning · Computer Science 2025-06-10 Tongzhou Yu , Zhuhao Zhang , Guanghui Zhu , Shen Jiang , Meikang Qiu , Yihua Huang

Machine-learned interatomic potentials (MLIPs) have become the gold standard for atomistic simulations, yet their extension to magnetic materials remains challenging because spin fluctuations must be captured either explicitly or…

Materials Science · Physics 2025-07-28 E. O. Khazieva , N. M. Chtchelkatchev , R. E. Ryltsev

Phonons, quantized vibrations of the atomic lattice, are fundamental to understanding thermal transport, structural stability, and phase behavior in crystalline solids. Despite advances in computational materials science, most predictions…

Materials Science · Physics 2026-01-15 Huiju Lee , Zhi Li , Jiangang he , Yi Xia

Point cloud foundation models demonstrate strong generalization, yet adapting them to downstream tasks remains challenging in low-data regimes. Full fine-tuning often leads to overfitting and significant drift from pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Sneha Paul , Zachary Patterson , Nizar Bouguila

The optical properties of defects in solids produce rich physics, from gemstone coloration to single-photon emission for quantum networks. Essential to describing optical transitions is electron-phonon coupling, which can be predicted from…

Materials Science · Physics 2026-04-21 Mark E. Turiansky , John L. Lyons , Noam Bernstein