English
Related papers

Related papers: 3D Interaction Geometric Pre-training for Molecula…

200 papers

We propose a deep reinforcement learning (DRL) methodology for the tracking, obstacle avoidance, and formation control of nonholonomic robots. By separating vision-based control into a perception module and a controller module, we can train…

Robotics · Computer Science 2019-11-19 Yanlin Zhou , Fan Lu , George Pu , Xiyao Ma , Runhan Sun , Hsi-Yuan Chen , Xiaolin Li , Dapeng Wu

We study how to generate molecule conformations (i.e., 3D structures) from a molecular graph. Traditional methods, such as molecular dynamics, sample conformations via computationally expensive simulations. Recently, machine learning…

Machine Learning · Computer Science 2021-04-01 Minkai Xu , Shitong Luo , Yoshua Bengio , Jian Peng , Jian Tang

Molecular pretrained representations (MPR) has emerged as a powerful approach for addressing the challenge of limited supervised data in applications such as drug discovery and material design. While early MPR methods relied on 1D sequences…

Biomolecules · Quantitative Biology 2025-03-19 Shuqi Lu , Xiaohong Ji , Bohang Zhang , Lin Yao , Siyuan Liu , Zhifeng Gao , Linfeng Zhang , Guolin Ke

The Deep Material Network (DMN) has emerged as a powerful framework for multiscale materials modeling, enabling efficient and accurate prediction of material behavior across different length scales. Unlike conventional data-driven…

Computational Engineering, Finance, and Science · Computer Science 2026-03-23 Ting-Ju Wei , Wen-Ning Wan , Chuin-Shan Chen

While Multimodal Large Language Models (MLLMs) have achieved remarkable success in 2D visual understanding, their ability to reason about 3D space remains limited. To address this gap, we introduce geometrically referenced 3D scene…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Jiangye Yuan , Gowri Kumar , Baoyuan Wang

Machine learning (ML) has been widely applied to the upper layers of wireless communication systems for various purposes, such as deployment of cognitive radio and communication network. However, its application to the physical layer is…

Information Theory · Computer Science 2017-10-30 Tianqi Wang , Chao-Kai Wen , Hanqing Wang , Feifei Gao , Tao Jiang , Shi Jin

Deep Reinforcement Learning (DRL) is a quickly evolving research field rooted in operations research and behavioural psychology, with potential applications extending across various domains, including robotics. This thesis delineates the…

Robotics · Computer Science 2023-12-11 Luca Renna

In recent years, Deep Reinforcement Learning (DRL) has emerged as a promising method for robot collision avoidance. However, such DRL models often come with limitations, such as adapting effectively to structured environments containing…

Robotics · Computer Science 2023-10-27 Max Asselmeier , Zhaoyi Li , Kelin Yu , Danfei Xu

A critical bottleneck in deep reinforcement learning (DRL) is sample inefficiency, as training high-performance agents often demands extensive environmental interactions. Model-based reinforcement learning (MBRL) mitigates this by building…

Machine Learning · Computer Science 2025-09-30 Boxuan Zhang , Runqing Wang , Wei Xiao , Weipu Zhang , Jian Sun , Gao Huang , Jie Chen , Gang Wang

Multimodal learning combines multiple data modalities, broadening the types and complexity of data our models can utilize: for example, from plain text to image-caption pairs. Most multimodal learning algorithms focus on modeling simple…

Artificial Intelligence · Computer Science 2023-10-13 Minji Yoon , Jing Yu Koh , Bryan Hooi , Ruslan Salakhutdinov

Deep reinforcement learning (DRL) is a very active research area. However, several technical and scientific issues require to be addressed, amongst which we can mention data inefficiency, exploration-exploitation trade-off, and multi-task…

Machine Learning · Computer Science 2020-11-24 Mohammad Reza Samsami , Hossein Alimadad

Deep reinforcement learning (DRL) has emerged as a promising solution to mastering explosive and versatile quadrupedal jumping skills. However, current DRL-based frameworks usually rely on pre-existing reference trajectories obtained by…

Robotics · Computer Science 2024-10-28 Vassil Atanassov , Jiatao Ding , Jens Kober , Ioannis Havoutis , Cosimo Della Santina

Reinforcement learning (RL) algorithms have been around for decades and employed to solve various sequential decision-making problems. These algorithms however have faced great challenges when dealing with high-dimensional environments. The…

Machine Learning · Computer Science 2020-04-01 Thanh Thi Nguyen , Ngoc Duy Nguyen , Saeid Nahavandi

An excellent representation is crucial for reinforcement learning (RL) performance, especially in vision-based reinforcement learning tasks. The quality of the environment representation directly influences the achievement of the learning…

Computer Vision and Pattern Recognition · Computer Science 2024-08-07 Jiaxu Wang , Qiang Zhang , Jingkai Sun , Jiahang Cao , Gang Han , Wen Zhao , Weining Zhang , Yecheng Shao , Yijie Guo , Renjing Xu

Recent advances in 3D perception have shown impressive progress in understanding geometric structures of 3Dshapes and even scenes. Inspired by these advances in geometric understanding, we aim to imbue image-based perception with…

Computer Vision and Pattern Recognition · Computer Science 2021-12-21 Ji Hou , Saining Xie , Benjamin Graham , Angela Dai , Matthias Nießner

Molecular dynamics (MD) simulations employing classical force fields constitute the cornerstone of contemporary atomistic modeling in chemistry, biology, and materials science. However, the predictive power of these simulations is only as…

Chemical Physics · Physics 2018-09-26 Stefan Chmiela , Huziel E. Sauceda , Klaus-Robert Müller , Alexandre Tkatchenko

Deep Metric Learning (DML) proposes to learn metric spaces which encode semantic similarities as embedding space distances. These spaces should be transferable to classes beyond those seen during training. Commonly, DML methods task…

Computer Vision and Pattern Recognition · Computer Science 2022-03-17 Karsten Roth , Oriol Vinyals , Zeynep Akata

Global machine learning force fields (MLFFs), that have the capacity to capture collective many-atom interactions in molecular systems, currently only scale up to a few dozen atoms due a considerable growth of the model complexity with…

Machine Learning (ML) has become a promising tool for improving the quality of atomistic simulations. Using formaldehyde as a benchmark system for intramolecular interactions, a comparative assessment of ML models based on state-of-the-art…

Reinforcement learning (RL) approaches based on Markov Decision Processes (MDPs) are predominantly applied in the robot joint space, often relying on limited task-specific information and partial awareness of the 3D environment. In…

Robotics · Computer Science 2026-03-09 Bingkun Huang , Yuhe Gong , Zewen Yang , Tianyu Ren , Luis Figueredo