English
Related papers

Related papers: Mixture of Experts Framework in Machine Learning I…

200 papers

Leveraging machine learning (ML) to predict an initial solution for mixed-integer linear programming (MILP) has gained considerable popularity in recent years. These methods predict a solution and fix a subset of variables to reduce the…

Machine Learning · Computer Science 2025-03-04 Haoyang Liu , Jie Wang , Zijie Geng , Xijun Li , Yuxuan Zong , Fangzhou Zhu , Jianye Hao , Feng Wu

Scaling large language models has driven remarkable advancements across various domains, yet the continual increase in model size presents significant challenges for real-world deployment. The Mixture of Experts (MoE) architecture offers a…

Machine Learning · Computer Science 2025-03-18 Shwai He , Daize Dong , Liang Ding , Ang Li

Accurate atomistic simulations of gas-surface scattering require potential energy surfaces that remain reliable over broad configurational and energetic ranges while retaining the efficiency needed for extensive trajectory sampling. Here,…

Physics-informed neural networks (PINNs) are capable of finding the solution for a given boundary value problem. We employ several ideas from the finite element method (FEM) to enhance the performance of existing PINNs in engineering…

Computational Engineering, Finance, and Science · Computer Science 2022-10-05 Shahed Rezaei , Ali Harandi , Ahmad Moeineddin , Bai-Xiang Xu , Stefanie Reese

Machine learning potentials (MLPs) trained on data from quantum-mechanics based first-principles methods can approach the accuracy of the reference method at a fraction of the computational cost. To facilitate efficient MLP-based molecular…

Materials Science · Physics 2021-08-17 Michael S. Chen , Tobias Morawietz , Hideki Mori , Thomas E. Markland , Nongnuch Artrith

Linear mixed-effects model (LMM) is a cornerstone of longitudinal data analysis, but is limited to adeptly make heterogeneous analyses predictable under both group-specific fixed effects and subject-specific random effects. To address this…

Methodology · Statistics 2026-03-10 Xinkai Yue , Xiaodong Yan , Haohui Han , Liya Fu

The need to use a short time step is a key limit on the speed of molecular dynamics (MD) simulations. Simulations governed by classical potentials are often accelerated by using a multiple-time-step (MTS) integrator that evaluates certain…

Chemical Physics · Physics 2023-10-24 Xiang Fu , Albert Musaelian , Anders Johansson , Tommi Jaakkola , Boris Kozinsky

Accuracy of molecular dynamics simulations depends crucially on the interatomic potential used to generate forces. The gold standard would be first-principles quantum mechanics (QM) calculations, but these become prohibitively expensive at…

Recent developments in machine learning interatomic potentials (MLIPs) have empowered even non-experts in machine learning to train MLIPs for accelerating materials simulations. However, the current literature lacks clear standards for…

Chemical Physics · Physics 2024-01-05 Tristan Maxson , Ademola Soyemi , Benjamin W. J. Chen , Tibor Szilvási

We propose a simple yet effective approach to enhance the performance of feed-forward 3D reconstruction models. Existing methods often struggle near depth discontinuities, where standard regression losses encourage spatial averaging and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Zichen Wang , Ang Cao , Liam J. Wang , Jeong Joon Park

The past few years have seen the development of ``universal'' machine-learning interatomic potentials (uMLIPs) capable of approximating the ground-state potential energy surface across a wide range of chemical structures and compositions…

Chemical Physics · Physics 2026-04-20 Sofiia Chorna , Davide Tisi , Cesare Malosso , Wei Bin How , Michele Ceriotti , Sanggyu Chong

The development of accurate constitutive models for materials that undergo path-dependent processes continues to be a complex challenge in computational solid mechanics. Challenges arise both in considering the appropriate model assumptions…

Machine Learning · Computer Science 2023-02-22 Jan N. Fuhg , Craig M. Hamel , Kyle Johnson , Reese Jones , Nikolaos Bouklas

High-resolution simulation models are essential for representing complex physical systems, yet their substantial computational cost severely limits the number of feasible high-fidelity (HF) evaluations. This problem is often addressed…

Methodology · Statistics 2026-04-21 Hossein Mohammadi

The Mixture of Experts (MoE) is a widely known neural architecture where an ensemble of specialized sub-models optimizes overall performance with a constant computational cost. However, conventional MoEs pose challenges at scale due to the…

Computation and Language · Computer Science 2023-09-12 Ted Zadouri , Ahmet Üstün , Arash Ahmadian , Beyza Ermiş , Acyr Locatelli , Sara Hooker

In the past two decades, machine learning potentials (MLP) have reached a level of maturity that now enables applications to large-scale atomistic simulations of a wide range of systems in chemistry, physics and materials science. Different…

Chemical Physics · Physics 2021-07-09 Emir Kocer , Tsz Wai Ko , Jörg Behler

Large-scale first principles molecular dynamics are crucial for simulating complex processes in chemical, biomedical, and materials sciences. However, the unfavorable time complexity with respect to system sizes leads to prohibitive…

Most atomistic machine learning (ML) models rely on a locality ansatz, and decompose the energy into a sum of short-ranged, atom-centered contributions. This leads to clear limitations when trying to describe problems that are dominated by…

The ever-increasing power of supercomputers coupled with highly scalable simulation codes have made molecular dynamics an indispensable tool in applications ranging from predictive modeling of materials to computational design and discovery…

Computational Engineering, Finance, and Science · Computer Science 2020-02-25 Henry Chan , Badri Narayanan , Mathew Cherukara , Troy D. Loeffler , Michael G. Sternberg , Anthony Avarca , Subramanian K. R. S. Sankaranarayanan

The recent success of specialized Large Language Models (LLMs) in domains such as mathematical reasoning and coding has led to growing interest in methods for merging these expert LLMs into a unified Mixture-of-Experts (MoE) model, with the…

Computation and Language · Computer Science 2025-02-18 Yuhang Zhou , Giannis Karamanolakis , Victor Soto , Anna Rumshisky , Mayank Kulkarni , Furong Huang , Wei Ai , Jianhua Lu

Metal-organic frameworks (MOFs) are highly interesting and tunable materials. By incorporating spatial defects into their atomic structure, MOFs can be finetuned to exhibit precise chemical functionalities, extending their applicability in…

Materials Science · Physics 2025-04-08 Pieter Dobbelaere , Sander Vandenhaute , Veronique Van Speybroeck