English
Related papers

Related papers: CryoFastAR: Fast Cryo-EM Ab Initio Reconstruction …

200 papers

3D foundation models (3DFMs) have recently transformed 3D vision, enabling joint prediction of depths, poses, and point maps directly from images. Yet their ability to reason under extreme, non-overlapping views remains largely unexplored.…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Yiwen Zhang , Joseph Tung , Ruojin Cai , David Fouhey , Hadar Averbuch-Elor

Cryo-electron microscopy (cryo-EM) emerges as a pivotal technology for determining the architecture of cells, viruses, and protein assemblies at near-atomic resolution. Traditional particle picking, a key step in cryo-EM, struggles with…

Biomolecules · Quantitative Biology 2024-04-17 Chentianye Xu , Xueying Zhan , Min Xu

Electron cryo-tomography (cryo-ET) enables 3D imaging of complex, radiation-sensitive structures with molecular detail. However, image contrast from the interference of scattered electrons is nonlinear with atomic density and multiple…

Cryo-electron microscopy (cryo-EM) is an indispensable technique for determining the 3D structures of dynamic biomolecular complexes. While typically applied to image a single molecular species, cryo-EM has the potential for structure…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Jeffrey Gu , Minkyu Jeon , Ambri Ma , Serena Yeung-Levy , Ellen D. Zhong

Cryo-electron tomography (cryoET) is a technique that captures images of biological samples at different tilts, preserving their native state as much as possible. Along with the partial tilt series and noise, one of the major challenges in…

Signal Processing · Electrical Eng. & Systems 2023-07-26 Vinith Kishore , Valentin Debarnot , Ivan Dokmanić

Single-particle cryo-electron microscopy (cryo-EM) is an emerging imaging modality capable of visualizing proteins and macro-molecular complexes at near-atomic resolution. The low electron-doses used to prevent sample radiation damage,…

Image and Video Processing · Electrical Eng. & Systems 2020-11-24 Qinwen Huang , Ye Zhou , Xiaochen Du , Reed Chen , Jianyou Wang , Cynthia Rudin , Alberto Bartesaghi

Motivated by the task of 2-D classification in single particle reconstruction by cryo-electron microscopy (cryo-EM), we consider the problem of heterogeneous multireference alignment of images. In this problem, the goal is to estimate a…

Image and Video Processing · Electrical Eng. & Systems 2019-10-03 Chao Ma , Tamir Bendory , Nicolas Boumal , Fred Sigworth , Amit Singer

Pose estimation of 3D objects in monocular images is a fundamental and long-standing problem in computer vision. Existing deep learning approaches for 6D pose estimation typically rely on the assumption of availability of 3D object models…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Fu Li , Hao Yu , Ivan Shugurov , Benjamin Busam , Shaowu Yang , Slobodan Ilic

This work targets to construct a robust human pose prior. However, it remains a persistent challenge due to biomechanical constraints and diverse human movements. Traditional priors like VAEs and NDFs often exhibit shortcomings in realism…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Junzhe Lu , Jing Lin , Hongkun Dou , Ailing Zeng , Yue Deng , Yulun Zhang , Haoqian Wang

Constructing of molecular structural models from Cryo-Electron Microscopy (Cryo-EM) density volumes is the critical last step of structure determination by Cryo-EM technologies. Methods have evolved from manual construction by structural…

Machine Learning · Computer Science 2019-02-13 Kui Xu , Zhe Wang , Jiangping Shi , Hongsheng Li , Qiangfeng Cliff Zhang

Cryo-electron microscopy (cryo-EM) has become a major experimental technique to determine the structures of large protein complexes and molecular assemblies, as evidenced by the 2017 Nobel Prize. Although cryo-EM has been drastically…

Biomolecules · Quantitative Biology 2021-06-01 Dong Si , Andrew Nakamura , Runbang Tang , Haowen Guan , Jie Hou , Ammaar Firozi , Renzhi Cao , Kyle Hippe , Minglei Zhao

Cryo-electron microscopy (cryo-EM) enables the atomic-resolution visualization of biomolecules; however, modern direct detectors generate data volumes that far exceed the available storage and transfer bandwidth, thereby constraining…

Image and Video Processing · Electrical Eng. & Systems 2026-03-31 Zain Shabeeb , Daniel Saeedi , Darin Tsui , Vida Jamali , Amirali Aghazadeh

We propose a framework to jointly determine the deformation parameters and reconstruct the unknown volume in electron cryotomography (CryoET). CryoET aims to reconstruct three-dimensional biological samples from two-dimensional projections.…

Image and Video Processing · Electrical Eng. & Systems 2023-10-17 Valentin Debarnot , Sidharth Gupta , Konik Kothari , Ivan Dokmanic

Accurate depth and camera pose estimation is essential for achieving high-quality 3D visualisations in robotic-assisted surgery. Despite recent advancements in foundation model adaptation to monocular depth estimation of endoscopic scenes…

Computer Vision and Pattern Recognition · Computer Science 2025-08-21 Mona Sheikh Zeinoddin , Mobarak I. Hoque , Zafer Tandogdu , Greg Shaw , Matthew J. Clarkson , Evangelos Mazomenos , Danail Stoyanov

Existing methods for 3D-aware image synthesis largely depend on the 3D pose distribution pre-estimated on the training set. An inaccurate estimation may mislead the model into learning faulty geometry. This work proposes PoF3D that frees…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Zifan Shi , Yujun Shen , Yinghao Xu , Sida Peng , Yiyi Liao , Sheng Guo , Qifeng Chen , Dit-Yan Yeung

We introduce HuMoR: a 3D Human Motion Model for Robust Estimation of temporal pose and shape. Though substantial progress has been made in estimating 3D human motion and shape from dynamic observations, recovering plausible pose sequences…

Computer Vision and Pattern Recognition · Computer Science 2021-08-19 Davis Rempe , Tolga Birdal , Aaron Hertzmann , Jimei Yang , Srinath Sridhar , Leonidas J. Guibas

In recent years, an abundance of new molecular structures have been elucidated using cryo-electron microscopy (cryo-EM), largely due to advances in hardware technology and data processing techniques. Owing to these new exciting…

Information Theory · Computer Science 2020-04-22 Tamir Bendory , Alberto Bartesaghi , Amit Singer

Accurate orientation estimation is a crucial component of 3D molecular structure reconstruction, both in single-particle cryo-electron microscopy (cryo-EM) and in the increasingly popular field of cryo-electron tomography (cryo-ET). The…

Applications · Statistics 2026-02-25 Sheng Xu , Amnon Balanov , Amit Singer , Tamir Bendory

As a critical modality for structural biology, cryogenic electron microscopy (cryo-EM) facilitates the determination of macromolecular structures at near-atomic resolution. The core computational task in single-particle cryo-EM is to…

Image and Video Processing · Electrical Eng. & Systems 2026-05-04 Suyi Chen , Haibin Ling

We propose a novel efficient and lightweight model for human pose estimation from a single image. Our model is designed to achieve competitive results at a fraction of the number of parameters and computational cost of various…

Computer Vision and Pattern Recognition · Computer Science 2020-02-11 Hossam Isack , Christian Haene , Cem Keskin , Sofien Bouaziz , Yuri Boykov , Shahram Izadi , Sameh Khamis