English
Related papers

Related papers: A cost-effective strategy of enhancing machine lea…

200 papers

Obtaining the atomistic structure and dynamics of disordered condensed phase systems from first principles remains one of the forefront challenges of chemical theory. Here we exploit recent advances in periodic electronic structure to show…

The attention mechanism has become a go-to technique for natural language processing and computer vision tasks. Recently, the MLP-Mixer and other MLP-based architectures, based simply on multi-layer perceptrons (MLPs), are also powerful…

Computer Vision and Pattern Recognition · Computer Science 2022-05-31 Tian Lv , Chongyang Bai , Chaojie Wang

The combination of multilingual pre-trained representations and cross-lingual transfer learning is one of the most effective methods for building functional NLP systems for low-resource languages. However, for extremely low-resource…

Computation and Language · Computer Science 2021-04-19 Mengzhou Xia , Guoqing Zheng , Subhabrata Mukherjee , Milad Shokouhi , Graham Neubig , Ahmed Hassan Awadallah

Massive data is often considered essential for deep learning applications, but it also incurs significant computational and infrastructural costs. Therefore, dataset pruning (DP) has emerged as an effective way to improve data efficiency by…

Machine Learning · Computer Science 2023-11-21 Yihua Zhang , Yimeng Zhang , Aochuan Chen , Jinghan Jia , Jiancheng Liu , Gaowen Liu , Mingyi Hong , Shiyu Chang , Sijia Liu

The rapid development of universal machine learning interatomic potentials (uMLIPs) has demonstrated the possibility for generalizable learning of the universal potential energy surface. In principle, the accuracy of uMLIPs can be further…

Materials Science · Physics 2025-04-09 Xu Huang , Bowen Deng , Peichen Zhong , Aaron D. Kaplan , Kristin A. Persson , Gerbrand Ceder

Machine learning interatomic potentials (MLIPs) achieve excellent accuracy when trained on large Density Functional Theory (DFT) data. To be useful in practice, they must often be adapted to target chemistries using small and expensive…

Applying DevOps practices to machine learning system is termed as MLOps and machine learning systems evolve on new data unlike traditional systems on requirements. The objective of MLOps is to establish a connection between different…

Software Engineering · Computer Science 2024-02-21 Pir Sami Ullah Shah , Naveed Ahmad , Mirza Omer Beg

Machine Learning Operations (MLOps) is becoming a highly crucial part of businesses looking to capitalize on the benefits of AI and ML models. This research presents a detailed review of MLOps, its benefits, difficulties, evolutions, and…

Software Engineering · Computer Science 2023-06-01 A. I. Ullah Tabassam

Neural machine translation is known to require large numbers of parallel training sentences, which generally prevent it from excelling on low-resource language pairs. This thesis explores the use of cross-lingual transfer learning on neural…

Computation and Language · Computer Science 2020-01-07 Tom Kocmi

Machine learning interatomic potentials (MLIPs) offer first-principles accuracy with reduced computational cost, but their transferability across different thermodynamic states remains questionable, particularly for fluid systems where…

Chemical Physics · Physics 2026-05-08 Minwoo Kim , Seungtae Kim , Je-Yeon Jung , Min Young Ha , Won Bo Lee

Machine learning interatomic potentials (MLIPs) enable atomistic simulations with near ab initio accuracy at significantly reduced computational cost, but their broader adoption is often limited by fragmented tooling, limited scalability,…

Deep learning is known to be data-hungry, which hinders its application in many areas of science when datasets are small. Here, we propose to use transfer learning methods to migrate knowledge between different physical scenarios and…

Computer Vision and Pattern Recognition · Computer Science 2019-05-06 Yurui Qu , Li Jing , Yichen Shen , Min Qiu , Marin Soljacic

Machine learning plays an important and growing role in molecular simulation. The newest version of the OpenMM molecular dynamics toolkit introduces new features to support the use of machine learning potentials. Arbitrary PyTorch models…

Over the past decade inter-atomic potentials based on machine-learning (ML) techniques have become an indispensable tool in the atomic-scale modeling of materials. Trained on energies and forces obtained from electronic-structure…

Materials Science · Physics 2022-08-15 Michele Ceriotti

Machine learning potentials (MLPs) have become indispensable for performing accurate large-scale atomistic simulations and predicting crystal structures. This study introduces the development of a polynomial MLP specifically for the ternary…

Materials Science · Physics 2024-07-31 Atsuto Seko

The pretrain-finetune paradigm is a classical pipeline in visual learning. Recent progress on unsupervised pretraining methods shows superior transfer performance to their supervised counterparts. This paper revisits this phenomenon and…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Yizhou Wang , Shixiang Tang , Feng Zhu , Lei Bai , Rui Zhao , Donglian Qi , Wanli Ouyang

The vastness of chemical space makes generalization a central challenge in the development of machine learning interatomic potentials (MLIPs). While MLIPs could enable large-scale atomistic simulations with near-quantum accuracy, their…

Chemical Physics · Physics 2026-03-20 Michal Sanocki , Julija Zavadlav

As the atomistic simulations of materials science move from traditional potentials to machine learning interatomic potential (MLIP), the field is entering the second phase focused on discovering and explaining new material phenomena. While…

Materials Science · Physics 2025-01-27 Musanna Galib , Mewael Isiet , Mauricio Ponga

The emergence of artificial intelligence has profoundly impacted computational chemistry, particularly through machine-learned potentials (MLPs), which offer a balance of accuracy and efficiency in calculating atomic energies and forces to…

Chemical Physics · Physics 2024-12-17 Rolf David , Miguel de la Puente , Axel Gomez , Olaia Anton , Guillaume Stirnemann , Damien Laage

We present a simple deep learning-based framework commonly used in computer vision and demonstrate its effectiveness for cross-dataset transfer learning in mental imagery decoding tasks that are common in the field of Brain-Computer…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Pierre Guetschel , Michael Tangermann