English
Related papers

Related papers: Lightweight equivariant model for efficient machin…

200 papers

Designing machine learning architectures for processing neural networks in their raw weight matrix form is a newly introduced research direction. Unfortunately, the unique symmetry structure of deep weight spaces makes this design very…

Machine Learning · Computer Science 2023-06-02 Aviv Navon , Aviv Shamsian , Idan Achituve , Ethan Fetaya , Gal Chechik , Haggai Maron

Road segmentation is a fundamental perception task for autonomous driving and intelligent robotic systems, requiring both high accuracy and real-time inference, especially for deployment on resource-constrained edge devices. Existing…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Daojie Peng , Bingtao Wang , Fulong Ma , Liang Zhang , Jun Ma

Message-passing neural networks (MPNN) have shown extremely high efficiency and accuracy in predicting the physical properties of molecules and crystals, and are expected to become the next-generation material simulation tool after the…

Materials Science · Physics 2022-01-19 Yang Zhong , Hongyu Yu , Xingao Gong , Hongjun Xiang

We review a novel neural network architecture called lattice gauge equivariant convolutional neural networks (L-CNNs), which can be applied to generic machine learning problems in lattice gauge theory while exactly preserving gauge…

High Energy Physics - Lattice · Physics 2021-11-09 Matteo Favoni , Andreas Ipp , David I. Müller , Daniel Schuh

Simulating rigid collisions among arbitrary shapes is notoriously difficult due to complex geometry and the strong non-linearity of the interactions. While graph neural network (GNN)-based models are effective at learning to simulate…

Equivariant Graph Neural Networks (EGNNs) have demonstrated significant success in modeling microscale systems, including those in chemistry, biology and materials science. However, EGNNs face substantial computational challenges due to the…

Machine Learning · Computer Science 2025-11-04 Yunyang Li , Lin Huang , Zhihao Ding , Chu Wang , Xinran Wei , Han Yang , Zun Wang , Chang Liu , Yu Shi , Peiran Jin , Tao Qin , Mark Gerstein , Jia Zhang

The accurate prediction of changes in protein stability under multiple amino acid substitutions is essential for realising true in-silico protein re-design. To this purpose, we propose improvements to state-of-the-art Deep learning (DL)…

Biomolecules · Quantitative Biology 2023-06-01 Sebastien Boyer , Sam Money-Kyrle , Oliver Bent

Pre-trained Language Models have emerged as promising tools for predicting molecular properties, yet their development is in its early stages, necessitating further research to enhance their efficacy and address challenges such as…

Machine Learning · Computer Science 2023-10-24 Eduardo Soares , Akihiro Kishimoto , Emilio Vital Brazil , Seiji Takeda , Hiroshi Kajino , Renato Cerqueira

Recent studies have demonstrated that the convolutional networks heavily rely on the quality and quantity of generated features. However, in lightweight networks, there are limited available feature information because these networks tend…

Computer Vision and Pattern Recognition · Computer Science 2019-05-30 Yang Yao , Xu Zhang , Baile Xu , Furao Shen , Jian Zhao

Recently, deep neural network (DNN)-based drug-target interaction (DTI) models were highlighted for their high accuracy with affordable computational costs. Yet, the models' insufficient generalization remains a challenging problem in the…

Biomolecules · Quantitative Biology 2021-12-14 Seokhyun Moon , Wonho Zhung , Soojung Yang , Jaechang Lim , Woo Youn Kim

Data-driven soft sensors provide a potentially cost-effective and more accurate modeling approach to measure difficult-to-measure indices in industrial processes compared to mechanistic approaches. Artificial intelligence (AI) techniques,…

Machine Learning · Statistics 2023-12-20 Jing Nan , Yan Qin , Wei Dai , Chau Yuen

We introduce a lightweight universal machine-learning interatomic potential (uMLIP), SevenNet-Nano, based on the graph neural network architecture SevenNet and enabled by a knowledge-distillation framework. The model inherits the broad…

Materials Science · Physics 2026-04-14 Sangmin Oh , Jinmu You , Jaesun Kim , Jiho Lee , Hyungmin An , Seungwu Han , Youngho Kang

Predicting electronic energies, densities, and related chemical properties can facilitate the discovery of novel catalysts, medicines, and battery materials. By developing a physics-inspired equivariant neural network, we introduce a method…

Graph neural networks (GNNs) have shown considerable promise in computational chemistry. However, the limited availability of molecular data raises concerns regarding GNNs' ability to effectively capture the fundamental principles of…

Machine Learning · Computer Science 2025-03-12 Junyi An , Chao Qu , Yun-Fei Shi , XinHao Liu , Qianwei Tang , Fenglei Cao , Yuan Qi

Accurate modeling of the solvent environment for biological molecules is crucial for computational biology and drug design. A popular approach to achieve long simulation time scales for large system sizes is to incorporate the effect of the…

Computational Physics · Physics 2021-08-27 Yaoyi Chen , Andreas Krämer , Nicholas E. Charron , Brooke E. Husic , Cecilia Clementi , Frank Noé

Invariant models, one important class of geometric deep learning models, are capable of generating meaningful geometric representations by leveraging informative geometric features in point clouds. These models are characterized by their…

Machine Learning · Computer Science 2025-06-17 Zian Li , Xiyuan Wang , Shijia Kang , Muhan Zhang

Heterogeneous graphs, comprising diverse node and edge types connected through varied relations, are ubiquitous in real-world applications. Message-passing heterogeneous graph neural networks (HGNNs) have emerged as a powerful model class…

Machine Learning · Computer Science 2025-12-10 Junwei Su , Lingjun Mao , Zheng Da , Chuan Wu

Machine learning (ML) based models have greatly enhanced the traditional materials discovery and design pipeline. Specifically, in recent years, surrogate ML models for material property prediction have demonstrated success in predicting…

Materials Science · Physics 2022-01-21 Prathik R Kaundinya , Kamal Choudhary , Surya R. Kalidindi

Point defects play a central role in driving the properties of materials. First-principles methods are widely used to compute defect energetics and structures, including at scale for high-throughput defect databases. However, these methods…

Machine Learning · Computer Science 2025-09-30 Evan Dramko , Yihuang Xiong , Yizhi Zhu , Geoffroy Hautier , Thomas Reps , Christopher Jermaine , Anastasios Kyrillidis

Equivariant graph neural networks force fields (EGraFFs) have shown great promise in modelling complex interactions in atomic systems by exploiting the graphs' inherent symmetries. Recent works have led to a surge in the development of…