English
Related papers

Related papers: CryoFormer: Continuous Heterogeneous Cryo-EM Recon…

200 papers

Deep learning applied to the reconstruction of 3D shapes has seen growing interest. A popular approach to 3D reconstruction and generation in recent years has been the CNN encoder-decoder model usually applied in voxel space. However, this…

Computer Vision and Pattern Recognition · Computer Science 2020-05-12 Mateusz Michalkiewicz , Eugene Belilovsky , Mahsa Baktashmotlagh , Anders Eriksson

Constructing atomic models from cryo-electron microscopy (cryo-EM) maps is a crucial yet intricate task in structural biology. While advancements in deep learning, such as convolutional neural networks (CNNs) and graph neural networks…

Quantitative Methods · Quantitative Biology 2024-11-01 Xin , Ma , Dong Si

In cryo-electron microscopy (EM), molecular structures are determined from large numbers of projection images of individual particles. To harness the full power of this single-molecule information, we use the Bayesian inference of EM…

Biomolecules · Quantitative Biology 2018-01-17 Pilar Cossio , David Rohr , Fabio Baruffa , Markus Rampp , Volker Lindenstruth , Gerhard Hummer

Structure-informed protein representation learning is essential for effective protein function annotation and \textit{de novo} design. However, the presence of inherent noise in both crystal and AlphaFold-predicted structures poses…

Biomolecules · Quantitative Biology 2025-03-25 Zhongyue Zhang , Runze Ma , Yanjie Huang , Shuangjia Zheng

Structured reconstruction is a non-trivial dense prediction problem, which extracts structural information (\eg, building corners and edges) from a raster image, then reconstructs it to a 2D planar graph accordingly. Compared with common…

Computer Vision and Pattern Recognition · Computer Science 2023-12-13 Hongbo Tian , Yulong Li , Linzhi Huang , Xu Ling , Yue Yang , Jiani Hu

We target the problem of estimating the center of mass of noisy 2-D images. We assume that the noise dominates the image, and thus many standard approaches are vulnerable to estimation errors. Our approach uses a surrogate function to the…

Image and Video Processing · Electrical Eng. & Systems 2021-03-04 Ayelet Heimowitz , Nir Sharon , Amit Singer

Curvilinear structures frequently appear in microscopy imaging as the object of interest. Crystallographic defects, i.e., dislocations, are one of the curvilinear structures that have been repeatedly investigated under transmission electron…

Image and Video Processing · Electrical Eng. & Systems 2021-10-19 Okan Altingövde , Anastasiia Mishchuk , Gulnaz Ganeeva , Emad Oveisi , Cecile Hebert , Pascal Fua

High-fidelity electron microscopy simulations required for quantitative crystal structure refinements face a fundamental challenge: while physical interactions are well-described theoretically, real-world experimental effects are…

Convolutional neural network (CNN) based methods have achieved great successes in medical image segmentation, but their capability to learn global representations is still limited due to using small effective receptive fields of convolution…

Computer Vision and Pattern Recognition · Computer Science 2022-11-17 Pengfei Gu , Yejia Zhang , Chaoli Wang , Danny Z. Chen

The interaction of a protein with its environment can be understood and controlled via its 3D structure. Experimental methods for protein structure determination, such as X-ray crystallography or cryogenic electron microscopy, shed light on…

Machine Learning · Computer Science 2025-04-24 Axel Levy , Eric R. Chan , Sara Fridovich-Keil , Frédéric Poitevin , Ellen D. Zhong , Gordon Wetzstein

Recent developments in deep learning-based methods demonstrated its potential to predict the 3D protein structures using inputs such as protein sequences, Cryo-Electron microscopy (Cryo-EM) images of proteins, etc. However, these methods…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Jaydeep Rade , Soumik Sarkar , Anwesha Sarkar , Adarsh Krishnamurthy

The fusion of rigorous physical laws with flexible data-driven learning represents a new frontier in scientific simulation, yet bridging the gap between physical interpretability and computational efficiency remains a grand challenge. In…

Advances on cryo-electron imaging technologies have led to a rapidly increasing number of density maps. Alignment and comparison of density maps play a crucial role in interpreting structural information, such as conformational…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Bintao He , Fa Zhang , Chenjie Feng , Jianyi Yang , Xin Gao , Renmin Han

The availability of affordable and portable depth sensors has made scanning objects and people simpler than ever. However, dealing with occlusions and missing parts is still a significant challenge. The problem of reconstructing a (possibly…

Computer Vision and Pattern Recognition · Computer Science 2018-04-05 Or Litany , Alex Bronstein , Michael Bronstein , Ameesh Makadia

Cryogenic electron tomography is a technique for imaging biological samples in 3D. A microscope collects a series of 2D projections of the sample, and the goal is to reconstruct the 3D density of the sample called the tomogram.…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Simon Wiedemann , Reinhard Heckel

The computational pipelines of single-particle cryo-electron microscopy (cryo-EM) and cryo-electron tomography (cryo-ET) include an early particle-picking stage, in which a micrograph or tomogram is scanned to extract candidate particles,…

Signal Processing · Electrical Eng. & Systems 2026-04-14 Amnon Balanov , Alon Zabatani , Tamir Bendory

Cryo-Electron Microscopy (cryo-EM) has become an extremely powerful method for resolving structural details of large biomolecular complexes. However, challenging problems in single-particle methods remain open because of (1) the low…

Biomolecules · Quantitative Biology 2019-08-12 Shengnan Lyu , Christian Wülker , Yuqing Pan , Amitesh S. Jayaraman , Jianhao Zheng , Yilin Cai , Gregory S. Chirikjian

The alignment of serial-section electron microscopy (ssEM) images is critical for efforts in neuroscience that seek to reconstruct neuronal circuits. However, each ssEM plane contains densely packed structures that vary from one section to…

Computer Vision and Pattern Recognition · Computer Science 2017-12-06 Inwan Yoo , David G. C. Hildebrand , Willie F. Tobin , Wei-Chung Allen Lee , Won-Ki Jeong

We introduce a framework for recovering an image from its rotationally and translationally invariant features based on autocorrelation analysis. This work is an instance of the multi-target detection statistical model, which is mainly used…

Image and Video Processing · Electrical Eng. & Systems 2022-03-03 Nicholas F. Marshall , Ti-Yen Lan , Tamir Bendory , Amit Singer

Direct observation of nanoscale transformations in three dimensions (3D) is essential for understanding materials evolution under operating conditions, yet dynamic electron tomography remains limited by slow tilt series acquisition and by…