English
Related papers

Related papers: Deep Generative Modeling for Volume Reconstruction…

200 papers

Cryo-electron microscopy (cryo-EM) is a widely used technique for recovering the 3-D structure of biological molecules from a large number of experimentally generated noisy 2-D tomographic projection images of the 3-D structure, taken from…

Numerical Analysis · Mathematics 2025-11-17 Jeremy Hoskins , Yuehaw Khoo , Oscar Mickelin , Amit Singer , Yuguan Wang

The recent improvements in cryo-electron microscopy (cryo-EM) in the past few years are now allowing to observe molecular complexes at atomic resolution. As a consequence, numerous structures derived from cryo-EM are now available in the…

Biomolecules · Quantitative Biology 2020-05-04 Mikael Trellet , Gydo van Zundert , Alexandre M. J. J. Bonvin

Deep generative models have been praised for their ability to learn smooth latent representation of images, text, and audio, which can then be used to generate new, plausible data. However, current generative models are unable to work with…

Machine Learning · Computer Science 2019-09-09 Bidisha Samanta , Abir De , Gourhari Jana , Pratim Kumar Chattaraj , Niloy Ganguly , Manuel Gomez-Rodriguez

Deep learning is transforming many areas in science, and it has great potential in modeling molecular systems. However, unlike the mature deployment of deep learning in computer vision and natural language processing, its development in…

Computational Physics · Physics 2021-03-19 Jun Zhang , Yao-Kun Lei , Zhen Zhang , Junhan Chang , Maodong Li , Xu Han , Lijiang Yang , Yi Isaac Yang , Yi Qin Gao

While recent machine learning research has revealed connections between deep generative models such as VAEs and rate-distortion losses used in learned compression, most of this work has focused on images. In a similar spirit, we view…

Image and Video Processing · Electrical Eng. & Systems 2024-10-28 Ruihan Yang , Yibo Yang , Joseph Marino , Stephan Mandt

Automatic 3D neuron reconstruction is critical for analysing the morphology and functionality of neurons in brain circuit activities. However, the performance of existing tracing algorithms is hinged by the low image quality. Recently, a…

Image and Video Processing · Electrical Eng. & Systems 2021-09-17 Heng Wang , Chaoyi Zhang , Jianhui Yu , Yang Song , Siqi Liu , Wojciech Chrzanowski , Weidong Cai

Multi-scale 3D characterization is widely used by materials scientists to further their understanding of the relationships between microscopic structure and macroscopic function. Scientific computed tomography (CT) instruments are one of…

Image and Video Processing · Electrical Eng. & Systems 2022-01-12 S. V. Venkatakrishnan , K. Aditya Mohan , Amir Koushyar Ziabari , Charles A. Bouman

Deep generative models (DGM) are neural networks with many hidden layers trained to approximate complicated, high-dimensional probability distributions using a large number of samples. When trained successfully, we can use the DGMs to…

Machine Learning · Computer Science 2021-04-13 Lars Ruthotto , Eldad Haber

High-resolution structure determination by cryo-electron microscopy (cryo-EM) requires the accurate fitting of an atomic model into an experimental density map. Traditional refinement pipelines such as Phenix.real_space_refine and Rosetta…

Biomolecules · Quantitative Biology 2026-03-10 Fuyao Huang , Xiaozhu Yu , Kui Xu , Qiangfeng Cliff Zhang

The rapid advancement of high-throughput sequencing and other assay technologies has resulted in the generation of large and complex multi-omics datasets, offering unprecedented opportunities for advancing precision medicine strategies.…

Quantitative Methods · Quantitative Biology 2025-01-30 Ana R. Baião , Zhaoxiang Cai , Rebecca C Poulos , Phillip J. Robinson , Roger R Reddel , Qing Zhong , Susana Vinga , Emanuel Gonçalves

Super-resolution microscopy overcomes the diffraction limit of conventional light microscopy in spatial resolution. By providing novel spatial or spatio-temporal information on biological processes at nanometer resolution with molecular…

Biological Physics · Physics 2021-11-10 Tianjie Yang , Yaoru Luo , Wei Ji , Ge Yang

Simulation-based inference provides a powerful framework for cryo-electron microscopy, employing neural networks in methods like CryoSBI to infer biomolecular conformations via learned latent representations. This latent space represents a…

Quantitative Methods · Quantitative Biology 2025-09-05 Luke Evans , Octavian-Vlad Murad , Lars Dingeldein , Pilar Cossio , Roberto Covino , Marina Meila

Magnetic resonance imaging (MRI) is renowned for its exceptional soft tissue contrast and high spatial resolution, making it a pivotal tool in medical imaging. The integration of deep learning algorithms offers significant potential for…

Image and Video Processing · Electrical Eng. & Systems 2024-06-06 Wanyu Bian

In medical imaging, generative models are increasingly relied upon for two distinct but equally critical tasks: reconstruction, where the goal is to restore medical imaging (usually inverse problems like inpainting or superresolution), and…

Image and Video Processing · Electrical Eng. & Systems 2025-07-28 Niklas Bubeck , Yundi Zhang , Suprosanna Shit , Daniel Rueckert , Jiazhen Pan

Cryo-Electron Microscopy (cryo-EM) has become an extremely powerful method for resolving structural details of large biomolecular complexes. However, challenging problems in single-particle methods remain open because of (1) the low…

Biomolecules · Quantitative Biology 2019-08-12 Shengnan Lyu , Christian Wülker , Yuqing Pan , Amitesh S. Jayaraman , Jianhao Zheng , Yilin Cai , Gregory S. Chirikjian

Deep generative models have shown significant promise in generating valid 3D molecular structures, with the GEOM-Drugs dataset serving as a key benchmark. However, current evaluation protocols suffer from critical flaws, including incorrect…

Machine Learning · Computer Science 2025-05-19 Filipp Nikitin , Ian Dunn , David Ryan Koes , Olexandr Isayev

Recently, deep learning approaches have become the main research frontier for biological image reconstruction and enhancement problems thanks to their high performance, along with their ultra-fast inference times. However, due to the…

Image and Video Processing · Electrical Eng. & Systems 2022-03-18 Mehmet Akçakaya , Burhaneddin Yaman , Hyungjin Chung , Jong Chul Ye

Deep generative models are able to suggest new organic molecules by generating strings, trees, and graphs representing their structure. While such models allow one to generate molecules with desirable properties, they give no guarantees…

Machine Learning · Computer Science 2019-12-05 John Bradshaw , Brooks Paige , Matt J. Kusner , Marwin H. S. Segler , José Miguel Hernández-Lobato

Enhancing cryogenic electron microscopy (cryo-EM) 3D density maps at intermediate resolution (4-8 {\AA}) is crucial in protein structure determination. Recent advances in deep learning have led to the development of automated approaches for…

Computer Vision and Pattern Recognition · Computer Science 2025-05-16 Chenwei Zhang , Khanh Dao Duc

Cryo-electron microscopy (cryo-EM) studies using single particle reconstruction are extensively used to reveal structural information on macromolecular complexes. Aiming at the highest achievable resolution, state of the art electron…