English
Related papers

Related papers: Geometric Transformer for End-to-End Molecule Prop…

200 papers

The problem of accelerating drug discovery relies heavily on automatic tools to optimize precursor molecules to afford them with better biochemical properties. Our work in this paper substantially extends prior state-of-the-art on…

Chemical Physics · Physics 2019-10-22 Wengong Jin , Regina Barzilay , Tommi Jaakkola

The identification of the interfacial molecules in fluid-fluid equilibrium is a long-standing problem in the area of simulation. We here propose a new point of view, making use of concepts taken from the field of computational geometry,…

Soft Condensed Matter · Physics 2009-04-30 Florencio Balboa Usabiaga , Daniel Duque

Prediction of a molecule's 3D conformer ensemble from the molecular graph holds a key role in areas of cheminformatics and drug discovery. Existing generative models have several drawbacks including lack of modeling important molecular…

Graph Transformers (GTs) have demonstrated a strong capability in modeling graph structures by addressing the intrinsic limitations of graph neural networks (GNNs), such as over-smoothing and over-squashing. Recent studies have proposed…

Machine Learning · Computer Science 2025-02-28 Chaohao Yuan , Kangfei Zhao , Ercan Engin Kuruoglu , Liang Wang , Tingyang Xu , Wenbing Huang , Deli Zhao , Hong Cheng , Yu Rong

Predicting physical properties of materials from their crystal structures is a fundamental problem in materials science. In peripheral areas such as the prediction of molecular properties, fully connected attention networks have been shown…

Machine Learning · Computer Science 2024-03-19 Tatsunori Taniai , Ryo Igarashi , Yuta Suzuki , Naoya Chiba , Kotaro Saito , Yoshitaka Ushiku , Kanta Ono

Procuring expressive molecular representations underpins AI-driven molecule design and scientific discovery. The research mainly focuses on atom-level homogeneous molecular graphs, ignoring the rich information in subgraphs or motifs.…

Quantitative Methods · Quantitative Biology 2023-01-10 Fang Wu , Dragomir Radev , Stan Z. Li

As transformers are equivariant to the permutation of input tokens, encoding the positional information of tokens is necessary for many tasks. However, since existing positional encoding schemes have been initially designed for NLP tasks,…

Computer Vision and Pattern Recognition · Computer Science 2024-06-10 Takeru Miyato , Bernhard Jaeger , Max Welling , Andreas Geiger

Predicting the structure of multi-protein complexes is a grand challenge in biochemistry, with major implications for basic science and drug discovery. Computational structure prediction methods generally leverage pre-defined structural…

Biomolecules · Quantitative Biology 2021-01-26 Stephan Eismann , Raphael J. L. Townshend , Nathaniel Thomas , Milind Jagota , Bowen Jing , Ron O. Dror

Geometric deep learning (GDL), which is based on neural network architectures that incorporate and process symmetry information, has emerged as a recent paradigm in artificial intelligence. GDL bears particular promise in molecular modeling…

Chemical Physics · Physics 2022-01-03 Kenneth Atz , Francesca Grisoni , Gisbert Schneider

In this work we introduce an Autoencoder for molecular conformations. Our proposed model converts the discrete spatial arrangements of atoms in a given molecular graph (conformation) into and from a continuous fixed-sized latent…

Machine Learning · Computer Science 2021-01-06 Robin Winter , Frank Noé , Djork-Arné Clevert

Predicting electronic band structures from crystal structures is crucial for understanding structure-property correlations in materials science. First-principles approaches are accurate but computationally intensive. Recent years, machine…

Materials Science · Physics 2025-10-02 Weiyi Gong , Tao Sun , Hexin Bai , Jeng-Yuan Tsai , Haibin Ling , Qimin Yan

One of the main challenges of Topological Data Analysis (TDA) is to extract features from persistent diagrams directly usable by machine learning algorithms. Indeed, persistence diagrams are intrinsically (multi-)sets of points in…

Machine Learning · Computer Science 2022-09-27 Raphael Reinauer , Matteo Caorsi , Nicolas Berkouk

Ground-state 3D geometries of molecules are essential for many molecular analysis tasks. Modern quantum mechanical methods can compute accurate 3D geometries but are computationally prohibitive. Currently, an efficient alternative to…

Chemical Physics · Physics 2023-05-24 Zhao Xu , Yaochen Xie , Youzhi Luo , Xuan Zhang , Xinyi Xu , Meng Liu , Kaleb Dickerson , Cheng Deng , Maho Nakata , Shuiwang Ji

Transformer architectures rely on explicit position encodings in order to preserve a notion of word order. In this paper, we argue that existing work does not fully utilize position information. For example, the initial proposal of a…

Computation and Language · Computer Science 2020-09-30 Zhiheng Huang , Davis Liang , Peng Xu , Bing Xiang

Recent advances in molecular representation learning have produced highly effective encodings of molecules for numerous cheminformatics and bioinformatics tasks. However, extracting general chemical insight while balancing predictive…

Machine Learning · Computer Science 2025-09-26 Rahul Khorana

We introduce a novel equivariant graph neural network (GNN) architecture designed to predict the tensorial response properties of molecules. Unlike traditional frameworks that focus on regressing scalar quantities and derive tensorial…

Machine Learning · Computer Science 2025-11-11 Jean Philip Filling , Felix Post , Michael Wand , Denis Andrienko

Large-scale molecular representation methods have revolutionized applications in material science, such as drug discovery, chemical modeling, and material design. With the rise of transformers, models now learn representations directly from…

Computational Engineering, Finance, and Science · Computer Science 2024-10-17 Indra Priyadarsini , Seiji Takeda , Lisa Hamada , Emilio Vital Brazil , Eduardo Soares , Hajime Shinohara

Transformers generate valid and diverse chemical structures, but little is known about the mechanisms that enable these models to capture the rules of molecular representation. We present a mechanistic analysis of autoregressive…

Machine Learning · Computer Science 2025-12-11 Kristof Varadi , Mark Marosi , Peter Antal

Recent advancements in transformer-based models have greatly improved time series analysis, providing robust solutions for tasks such as forecasting, anomaly detection, and classification. A crucial element of these models is positional…

Machine Learning · Computer Science 2026-05-07 Habib Irani , Vangelis Metsis

Machine-learning models in chemistry - when based on descriptors of atoms embedded within molecules - face essential challenges in transferring the quality of predictions of local electronic structures and their associated properties across…

Chemical Physics · Physics 2024-09-27 Frederik Ø. Kjeldal , Janus J. Eriksen