English
Related papers

Related papers: CryoRL: Reinforcement Learning Enables Efficient C…

200 papers

In recent years, Reinforcement Learning (RL), has become a popular field of study as well as a tool for enterprises working on cutting-edge artificial intelligence research. To this end, many researchers have built RL frameworks such as…

Electron Cryo-Tomography (ECT) enables 3D visualization of macromolecule structure inside single cells. Macromolecule classification approaches based on convolutional neural networks (CNN) were developed to separate millions of…

Quantitative Methods · Quantitative Biology 2018-03-28 Jialiang Guo , Bo Zhou , Xiangrui Zeng , Zachary Freyberg , Min Xu

Integrating causal inference (CI) with reinforcement learning (RL) has emerged as a powerful paradigm to address critical limitations in classical RL, including low explainability, lack of robustness and generalization failures. Traditional…

Artificial Intelligence · Computer Science 2025-12-23 Cristiano da Costa Cunha , Wei Liu , Tim French , Ajmal Mian

Reinforcement Learning (RL) faces significant challenges in adaptive healthcare interventions, such as dementia care, where data is scarce, decisions require interpretability, and underlying patient-state dynamic are complex and causal in…

Robotics · Computer Science 2025-12-02 Wenzheng Zhao , Ran Zhang , Ruth Palan Lopez , Shu-Fen Wung , Fengpei Yuan

Hierarchical reinforcement learning (HRL) improves the efficiency of long-horizon reinforcement-learning tasks with sparse rewards by decomposing the task into a hierarchy of subgoals. The main challenge of HRL is efficient discovery of the…

Machine Learning · Computer Science 2025-07-08 Sadegh Khorasani , Saber Salehkaleybar , Negar Kiyavash , Matthias Grossglauser

We study constrained reinforcement learning (CRL) from a novel perspective by setting constraints directly on state density functions, rather than the value functions considered by previous works. State density has a clear physical and…

Machine Learning · Computer Science 2021-06-25 Zengyi Qin , Yuxiao Chen , Chuchu Fan

We present a generic Reinforcement Learning (RL) framework optimized for crafting adversarial attacks on different model types spanning from ECG signal analysis (1D), image classification (2D), and video classification (3D). The framework…

Machine Learning · Computer Science 2024-04-23 Soumyendu Sarkar , Ashwin Ramesh Babu , Sajad Mousavi , Vineet Gundecha , Avisek Naug , Sahand Ghorbanpour

The group synchronization problem involves estimating a collection of group elements from noisy measurements of their pairwise ratios. This task is a key component in many computational problems, including the molecular reconstruction…

Signal Processing · Electrical Eng. & Systems 2022-12-09 Noam Janco , Tamir Bendory

Motivation: Medical image analysis involves tasks to assist physicians in qualitative and quantitative analysis of lesions or anatomical structures, significantly improving the accuracy and reliability of diagnosis and prognosis.…

Computer Vision and Pattern Recognition · Computer Science 2022-06-30 Mingzhe Hu , Jiahan Zhang , Luke Matkovic , Tian Liu , Xiaofeng Yang

Transmission electron diffraction is a powerful and versatile structural probe for the characterization of a broad range of materials, from nanocrystalline thin films to single crystals. With recent developments in fast electron detectors…

Materials Science · Physics 2021-10-06 Jian-Min Zuo , Renliang Yuan , Yu-Tsun Shao , Haw-Wen Hsiao , Saran Pidaparthy , Yang Hu , Qun Yang , Jiong Zhang

Background: Clinical diagnosis is typically reached by following a series of steps recommended by guidelines authored by colleges of experts. Accordingly, guidelines play a crucial role in rationalizing clinical decisions but suffer from…

Machine Learning · Computer Science 2024-04-10 Lillian Muyama , Antoine Neuraz , Adrien Coulet

Identifying complex neural circuitry from electron microscopic (EM) images may help unlock the mysteries of the brain. However, identifying this circuitry requires time-consuming, manual tracing (proofreading) due to the size and intricacy…

Quantitative Methods · Quantitative Biology 2014-09-04 Stephen M. Plaza

Reinforcement learning (RL) has become an effective approach for fine-tuning large language models (LLMs), particularly to enhance their reasoning capabilities. However, RL fine-tuning remains highly resource-intensive, and existing work…

Machine Learning · Computer Science 2026-02-17 Yifan Sun , Jingyan Shen , Yibin Wang , Tianyu Chen , Zhendong Wang , Mingyuan Zhou , Huan Zhang

Electron cryotomography (CryoET) is currently the only method capable of visualizing cells in 3D at nanometer resolutions. While modern instruments produce massive amounts of tomography data containing extremely rich structural information,…

Quantitative Methods · Quantitative Biology 2021-07-01 Muyuan Chen , James M. Bell , Xiaodong Shi , Stella Y. Sun , Zhao Wang , Steven J. Ludtke

The ongoing energy transition drives the development of decentralised renewable energy sources, which are heterogeneous and weather-dependent, complicating their integration into energy systems. This study tackles this issue by introducing…

Machine Learning · Computer Science 2024-07-01 Marine Cauz , Adrien Bolland , Nicolas Wyrsch , Christophe Ballif

We revisit the topic of common lines between projection images in single particle cryo-electron microscopy (cryo-EM). We derive a novel low-rank constraint on a certain $2n \times n$ matrix storing properly-scaled basis vectors for the…

Optimization and Control · Mathematics 2024-06-10 Tommi Muller , Adriana L. Duncan , Eric J. Verbeke , Joe Kileel

Fluorescence lifetime imaging microscopy (FLIM) is a powerful technique in biomedical research that uses the fluorophore decay rate to provide additional contrast in fluorescence microscopy. However, at present, the calculation, analysis,…

Image and Video Processing · Electrical Eng. & Systems 2021-06-09 Varun Mannam , Yide Zhang , Xiaotong Yuan , Cara Ravasio , Scott S. Howard

Cryo-electron microscopy (cryo-EM) has emerged as a powerful technique for resolving the three-dimensional structures of macromolecules. A key challenge in cryo-EM is characterizing continuous heterogeneity, where molecules adopt a…

Machine Learning · Statistics 2026-02-20 Roey Yadgar , Roy R. Lederman , Yoel Shkolnisky

Millions of sensors, cameras, meters, and other edge devices are deployed in networks to collect and analyse data. In many cases, such devices are powered only by Energy Harvesting(EH) and have limited energy available to analyse acquired…

Networking and Internet Architecture · Computer Science 2022-05-31 Jernej Hribar , Ryoichi Shinkuma , George Iosifidis , Ivana Dusparic

Precise robot manipulation is critical for fine-grained applications such as chemical and biological experiments, where even small errors (e.g., reagent spillage) can invalidate an entire task. Existing approaches often rely on…

Robotics · Computer Science 2026-02-13 Xiangyu Chen , Chuhao Zhou , Yuxi Liu , Jianfei Yang