English
Related papers

Related papers: Symmetry-Aware Actor-Critic for 3D Molecular Desig…

200 papers

Reinforcement learning (RL) is a powerful tool for solving complex decision-making problems, but its lack of transparency and interpretability has been a major challenge in domains where decisions have significant real-world consequences.…

Artificial Intelligence · Computer Science 2023-09-12 Muzhe Guo , Feixu Yu , Tian Lan , Fang Jin

Recent advances in robot imitation learning have yielded powerful visuomotor policies capable of manipulating a wide variety of objects directly from monocular visual inputs. However, monocular observations inherently lack reliable depth…

Robotics · Computer Science 2026-05-12 Evans Han , Yunfan Jiang , Yingke Wang , Haoyue Xiao , Huang Huang , Jianwen Xie , Jiajun Wu , Li Fei-Fei , Ruohan Zhang

Discovering novel stable molecules without training data remains a grand scientific challenge. Current molecular generative models are trained on large, pre-curated datasets, which introduce biases and limit exploration of novel chemistry.…

Machine Learning · Computer Science 2026-05-28 Bjarke Hastrup , Francois Cornet , Tejs Vegge , Arghya Bhowmik

3-D image registration, which involves aligning two or more images, is a critical step in a variety of medical applications from diagnosis to therapy. Image registration is commonly performed by optimizing an image matching metric as a cost…

Computer Vision and Pattern Recognition · Computer Science 2016-12-01 Rui Liao , Shun Miao , Pierre de Tournemire , Sasa Grbic , Ali Kamen , Tommaso Mansi , Dorin Comaniciu

Designing new molecules with a set of predefined properties is a core problem in modern drug discovery and development. There is a growing need for de-novo design methods that would address this problem. We present MolecularRNN, the graph…

Machine Learning · Computer Science 2019-06-03 Mariya Popova , Mykhailo Shvets , Junier Oliva , Olexandr Isayev

Deep reinforcement learning has been applied successfully to solve various real-world problems and the number of its applications in the multi-agent settings has been increasing. Multi-agent learning distinctly poses significant challenges…

Machine Learning · Computer Science 2021-02-24 Ngoc Duy Nguyen , Thanh Thi Nguyen , Doug Creighton , Saeid Nahavandi

Molecular property prediction is an important problem in drug discovery and materials science. As geometric structures have been demonstrated necessary for molecular property prediction, 3D information has been combined with various graph…

Quantitative Methods · Quantitative Biology 2023-07-04 Xu Wang , Huan Zhao , Weiwei Tu , Quanming Yao

Generating molecules that bind to specific proteins is an important but challenging task in drug discovery. Previous works usually generate atoms in an auto-regressive way, where element types and 3D coordinates of atoms are generated one…

Biomolecules · Quantitative Biology 2024-07-16 Haitao Lin , Yufei Huang , Odin Zhang , Siqi Ma , Meng Liu , Xuanjing Li , Lirong Wu , Jishui Wang , Tingjun Hou , Stan Z. Li

We study the problem of symmetry detection of 3D shapes from single-view RGB-D images, where severely missing data renders geometric detection approach infeasible. We propose an end-to-end deep neural network which is able to predict both…

Computer Vision and Pattern Recognition · Computer Science 2020-09-01 Yifei Shi , Junwen Huang , Hongjia Zhang , Xin Xu , Szymon Rusinkiewicz , Kai Xu

Model-based reinforcement learning (RL) has proven to be a data efficient approach for learning control tasks but is difficult to utilize in domains with complex observations such as images. In this paper, we present a method for learning…

Machine Learning · Computer Science 2019-06-25 Marvin Zhang , Sharad Vikram , Laura Smith , Pieter Abbeel , Matthew J. Johnson , Sergey Levine

Optimizing the injection process in particle accelerators is crucial for enhancing beam quality and operational efficiency. This paper presents a framework for utilizing Reinforcement Learning (RL) to optimize the injection process at…

Accelerator Physics · Physics 2025-03-19 Awal Awal , Jan Hetzel , Ralf Gebel , Jörg Pretz

Automatic heuristic design (AHD) has emerged as a promising paradigm for solving NP-hard combinatorial optimization problems (COPs). Recent works show that large language models (LLMs), when integrated into well-designed frameworks (i.e.,…

Artificial Intelligence · Computer Science 2026-05-12 Haoze Lv , Ning Lu , Ziang Zhou , Shengcai Liu

Structure-based drug design uses three-dimensional geometric information of macromolecules, such as proteins or nucleic acids, to identify suitable ligands. Geometric deep learning, an emerging concept of neural-network-based machine…

Chemical Physics · Physics 2022-10-21 Clemens Isert , Kenneth Atz , Gisbert Schneider

Deep Learning (DL) algorithms hold great promise for applications in the field of computational biophysics. In fact, the vast amount of available molecular structures, as well as their notable complexity, constitutes an ideal context in…

Soft Condensed Matter · Physics 2019-01-07 Marco Giulini , Raffaello Potestio

Actor-critic (AC) methods are widely used in reinforcement learning (RL) and benefit from the flexibility of using any policy gradient method as the actor and value-based method as the critic. The critic is usually trained by minimizing the…

Machine Learning · Computer Science 2023-11-01 Sharan Vaswani , Amirreza Kazemi , Reza Babanezhad , Nicolas Le Roux

We consider molecule generation in 3D space using language models (LMs), which requires discrete tokenization of 3D molecular geometries. Although tokenization of molecular graphs exists, that for 3D geometries is largely unexplored. Here,…

Artificial Intelligence · Computer Science 2024-08-20 Xiner Li , Limei Wang , Youzhi Luo , Carl Edwards , Shurui Gui , Yuchao Lin , Heng Ji , Shuiwang Ji

Deep reinforcement learning (RL) is a data-driven, model-free method capable of discovering complex control strategies for macroscopic objectives in high-dimensional systems, making its application towards flow control promising. Many…

Machine Learning · Computer Science 2021-07-21 Kevin Zeng , Michael D. Graham

Molecular editing and optimization are multi-step problems that require iteratively improving properties while keeping molecules chemically valid and structurally similar. We frame both tasks as sequential, tool-guided decisions and…

Artificial Intelligence · Computer Science 2025-12-25 Zhuo Yang , Yeyun Chen , Jiaqing Xie , Ben Gao , Shuaike Shen , Wanhao Liu , Liujia Yang , Beilun Wang , Tianfan Fu , Yuqiang Li

We present a framework that extends the Actor-Critic architecture to creative 3D modeling through multi-agent self-reflection and human-in-the-loop supervision. While existing approaches rely on single-prompt agents that directly execute…

Multiagent Systems · Computer Science 2026-01-09 Jin Gao , Saichandu Juluri

Multi-agent reinforcement learning has emerged as a powerful framework for enabling agents to learn complex, coordinated behaviors but faces persistent challenges regarding its generalization, scalability and sample efficiency. Recent…

Robotics · Computer Science 2025-04-28 Nikolaos Bousias , Stefanos Pertigkiozoglou , Kostas Daniilidis , George Pappas