English

PICTS: A Novel Deep Reinforcement Learning Approach for Dynamic P-I Control in Scanning Probe Microscopy

Materials Science 2025-02-12 v1 Machine Learning Applied Physics
Authors: Ziwei Wei , Shuming Wei , Qibin Zeng , Wanheng Lu , Huajun Liu , Kaiyang Zeng
View on arXiv ↗ PDF ↗

Abstract

We have developed a Parallel Integrated Control and Training System, leveraging the deep reinforcement learning to dynamically adjust the control strategies in real time for scanning probe microscopy techniques.

Keywords

deep reinforcement learning scanning probe microscopy parallel control real-time adaptation

Cite

@article{arxiv.2502.07326,
  title  = {PICTS: A Novel Deep Reinforcement Learning Approach for Dynamic P-I Control in Scanning Probe Microscopy},
  author = {Ziwei Wei and Shuming Wei and Qibin Zeng and Wanheng Lu and Huajun Liu and Kaiyang Zeng},
  journal= {arXiv preprint arXiv:2502.07326},
  year   = {2025}
}

Comments

21 pages, 6 figures

Related papers

View all related →
Machine Learning · Computer Science
Using Deep Reinforcement Learning for the Continuous Control of Robotic Arms
Winfried Lötzsch
2018-10-17
Robotics · Computer Science
Deep Incremental Model Informed Reinforcement Learning for Continuous Robotic Control
Cong Li
2025-02-28
Robotics · Computer Science
Deep Reinforcement Learning for the Control of Robotic Manipulation: A Focussed Mini-Review
Rongrong Liu, Florent Nageotte, Philippe Zanne, Michel de Mathelin +1
2021-02-09
Machine Learning · Computer Science
Deep Inventory Management
Dhruv Madeka, Kari Torkkola, Carson Eisenach, Anna Luo +2
2022-11-30
Robotics · Computer Science
Sensor Fusion for Robot Control through Deep Reinforcement Learning
Steven Bohez, Tim Verbelen, Elias De Coninck, Bert Vankeirsbilck +2
2017-03-16
Mesoscale and Nanoscale Physics · Physics
Deep Reinforcement Learning for Efficient Measurement of Quantum Devices
V. Nguyen, S. B. Orbell, D. T. Lennon, H. Moon +8
2021-07-08
Robotics · Computer Science
Autonomous Navigation of an Ultrasound Probe Towards Standard Scan Planes with Deep Reinforcement Learning
Keyu Li, Jian Wang, Yangxin Xu, Hao Qin +3
2024-10-28
Machine Learning · Computer Science
A Meta-Reinforcement Learning Approach to Process Control
Daniel G. McClement, Nathan P. Lawrence, Philip D. Loewen, Michael G. Forbes +2
2021-11-16
Systems and Control · Electrical Eng. & Systems
Deep Reinforcement Learning with Shallow Controllers: An Experimental Application to PID Tuning
Nathan P. Lawrence, Michael G. Forbes, Philip D. Loewen, Daniel G. McClement +2
2022-01-14
Machine Learning · Computer Science
Control of a simulated MRI scanner with deep reinforcement learning
Simon Walker-Samuel
2023-05-24
Machine Learning · Computer Science
Deep Generative Models for Decision-Making and Control
Michael Janner
2023-07-13
Quantum Physics · Physics
Quantum Control based on Deep Reinforcement Learning
Zhikang Wang
2022-12-15
Machine Learning · Computer Science
Acceleration for Deep Reinforcement Learning using Parallel and Distributed Computing: A Survey
Zhihong Liu, Xin Xu, Peng Qiao, Dongsheng Li
2024-11-11
Robotics · Computer Science
Deep Reinforcement Learning for Robotic Manipulation with Asynchronous Off-Policy Updates
Shixiang Gu, Ethan Holly, Timothy Lillicrap, Sergey Levine
2016-11-24
Machine Learning · Computer Science
Deep Reinforcement Learning with Feedback-based Exploration
Jan Scholten, Daan Wout, Carlos Celemin, Jens Kober
2020-04-08
Machine Learning · Computer Science
Thinking While Moving: Deep Reinforcement Learning with Concurrent Control
Ted Xiao, Eric Jang, Dmitry Kalashnikov, Sergey Levine +3
2020-04-28
Machine Learning · Computer Science
Toward a Thinking Microscope: Deep Learning in Optical Microscopy and Image Reconstruction
Yair Rivenson, Aydogan Ozcan
2018-07-23
Robotics · Computer Science
Combining Deep Reinforcement Learning And Local Control For The Acrobot Swing-up And Balance Task
Sean Gillen, Marco Molnar, Katie Byl
2020-12-23
Robotics · Computer Science
Exploring Deep Reinforcement Learning for Robust Target Tracking using Micro Aerial Vehicles
Alberto Dionigi, Mirko Leomanni, Alessandro Saviolo, Giuseppe Loianno +1
2024-02-08
Optimization and Control · Mathematics
Reinforcement Learning based Design of Linear Fixed Structure Controllers
Nathan P. Lawrence, Gregory E. Stewart, Philip D. Loewen, Michael G. Forbes +2
2021-04-22
Systems and Control · Electrical Eng. & Systems
Integrating Reinforcement Learning and Model Predictive Control with Applications to Microgrids
Caio Fabio Oliveira da Silva, Azita Dabiri, Bart De Schutter
2025-04-15
Networking and Internet Architecture · Computer Science
Deep Reinforcement Learning Based Power control for Wireless Multicast Systems
Ramkumar Raghu, Pratheek Upadhyaya, Mahadesh Panju, Vaneet Aggarwal +1
2019-10-25
Quantum Physics · Physics
Quantum optimal control of multi-level dissipative quantum systems with Reinforcement Learning
Zheng An, Qi-Kai He, Hai-Jing Song, D. L. Zhou
2021-01-20
Medical Physics · Physics
Learning to Scan: A Deep Reinforcement Learning Approach for Personalized Scanning in CT Imaging
Ziju Shen, Yufei Wang, Dufan Wu, Xu Yang +1
2021-09-15
Machine Learning · Computer Science
Comparing Deep Reinforcement Learning and Evolutionary Methods in Continuous Control
Shangtong Zhang, Osmar R. Zaiane
2018-03-08