English
Related papers

Related papers: One Transformer Can Understand Both 2D & 3D Molecu…

200 papers

Well-designed molecular representations (fingerprints) are vital to combine medical chemistry and deep learning. Whereas incorporating 3D geometry of molecules (i.e. conformations) in their representations seems beneficial, current 3D…

Machine Learning · Computer Science 2021-05-11 Ziyao Li , Shuwen Yang , Guojie Song , Lingsheng Cai

Recently, self-supervised pre-training has advanced Vision Transformers on various tasks w.r.t. different data modalities, e.g., image and 3D point cloud data. In this paper, we explore this learning paradigm for 3D mesh data analysis based…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Yaqian Liang , Shanshan Zhao , Baosheng Yu , Jing Zhang , Fazhi He

How to effectively represent molecules is a long-standing challenge for molecular property prediction and drug discovery. This paper studies this problem and proposes to incorporate chemical domain knowledge, specifically related to…

Machine Learning · Computer Science 2023-05-04 Liang Zeng , Lanqing Li , Jian Li

The key to success in machine learning (ML) is the use of effective data representations. Traditionally, data representations were hand-crafted. Recently it has been demonstrated that, given sufficient data, deep neural networks can learn…

Machine Learning · Computer Science 2018-11-09 Ivan Olier , Oghenejokpeme I. Orhobor , Joaquin Vanschoren , Ross D. King

Molecular representation learning is the first yet vital step in combining deep learning and molecular science. To push the boundaries of molecular representation learning, we present PhysChem, a novel neural architecture that learns…

Quantitative Methods · Quantitative Biology 2021-12-10 Shuwen Yang , Ziyao Li , Guojie Song , Lingsheng Cai

Representation learning on networks aims to derive a meaningful vector representation for each node, thereby facilitating downstream tasks such as link prediction, node classification, and node clustering. In heterogeneous text-rich…

Computation and Language · Computer Science 2023-06-06 Bowen Jin , Yu Zhang , Qi Zhu , Jiawei Han

Diffusion generative models have emerged as a powerful framework for addressing problems in structural biology and structure-based drug design. These models operate directly on 3D molecular structures. Due to the unfavorable scaling of…

Biomolecules · Quantitative Biology 2024-05-10 Ian Dunn , David Ryan Koes

Remarkable performance from Transformer networks in Natural Language Processing promote the development of these models in dealing with computer vision tasks such as image recognition and segmentation. In this paper, we introduce a novel…

Computer Vision and Pattern Recognition · Computer Science 2022-10-26 Qi Zhong , Xian-Feng Han

Proteins are essential macromolecules defined by their amino acid sequences, which determine their three-dimensional structures and, consequently, their functions in all living organisms. Therefore, generative protein modeling necessitates…

Machine Learning · Computer Science 2024-10-18 Xinyou Wang , Zaixiang Zheng , Fei Ye , Dongyu Xue , Shujian Huang , Quanquan Gu

Organic reaction, the foundation of modern chemical industry, is crucial for new material development and drug discovery. However, deciphering reaction mechanisms and modeling multi-molecular relationships remain formidable challenges due…

Chemical Physics · Physics 2025-08-13 Lirong Wu , Junjie Wang , Zhifeng Gao , Xiaohong Ji , Rong Zhu , Xinyu Li , Linfeng Zhang , Guolin Ke , Weinan E

The rational design of molecules with desired properties is a long-standing challenge in chemistry. Generative neural networks have emerged as a powerful approach to sample novel molecules from a learned distribution. Here, we propose a…

Cells receive signaling molecules by receptors and relay information via sensory networks so that they can respond properly depending on the type of signal. Recent studies have shown that cells can extract multi-dimensional information from…

Biological Physics · Physics 2018-02-14 Yoshihiko Hasegawa

Discrete structure rules for validating molecular structures are usually limited to fulfillment of the octet rule or similar simple deterministic heuristics. We propose a model, inspired by language modeling from natural language…

Deep learning has the potential to revolutionize quantum chemistry as it is ideally suited to learn representations for structured data and speed up the exploration of chemical space. While convolutional neural networks have proven to be…

Transformer architecture has become ubiquitous in the natural language processing field. To interpret the Transformer-based models, their attention patterns have been extensively analyzed. However, the Transformer architecture is not only…

Computation and Language · Computer Science 2021-09-16 Goro Kobayashi , Tatsuki Kuribayashi , Sho Yokoi , Kentaro Inui

In this paper, we show how a 3D Morphable Model (i.e. a statistical model of the 3D shape of a class of objects such as faces) can be used to spatially transform input data as a module (a 3DMM-STN) within a convolutional neural network.…

Computer Vision and Pattern Recognition · Computer Science 2018-04-20 Anil Bas , Patrik Huber , William A. P. Smith , Muhammad Awais , Josef Kittler

This article examines recent research in molecular communications from a telecommunications system design perspective. In particular, it focuses on channel models and state-of-the-art physical layer techniques. The goal is to provide a…

Emerging Technologies · Computer Science 2015-07-28 Weisi Guo , Taufiq Asyhari , Nariman Farsad , H. Birkan Yilmaz , Bin Li , Andrew Eckford , Chan-Byoung Chae

Molecular Representation Learning (MRL) has proven impactful in numerous biochemical applications such as drug discovery and enzyme design. While Graph Neural Networks (GNNs) are effective at learning molecular representations from a 2D…

During the last years, many advances have been made in tasks like3D model retrieval, 3D model classification, and 3D model segmentation.The typical 3D representations such as point clouds, voxels, and poly-gon meshes are mostly suitable for…

Computer Vision and Pattern Recognition · Computer Science 2021-03-08 Arniel Labrada , Benjamin Bustos , Ivan Sipiran

Accurate prediction of molecular properties in complex chemical systems is crucial for accelerating material discovery and chemical innovation. However, current computational methods often struggle to capture the intricate compositional…

Chemical Physics · Physics 2025-09-24 Jinming Fan , Chao Qian , Shaodong Zhou