English
Related papers

Related papers: Amortized Inference for Heterogeneous Reconstructi…

200 papers

Simulation-based inference provides a powerful framework for cryo-electron microscopy, employing neural networks in methods like CryoSBI to infer biomolecular conformations via learned latent representations. This latent space represents a…

Quantitative Methods · Quantitative Biology 2025-09-05 Luke Evans , Octavian-Vlad Murad , Lars Dingeldein , Pilar Cossio , Roberto Covino , Marina Meila

We present a novel analysis method for image reconstruction in emission tomography. The method, named Reconstructed Image from Simulations Ensemble (RISE), utilizes statistical physics concepts and Monte Carlo techniques to extract the…

Medical Physics · Physics 2018-04-12 Costas N. Papanicolas , Loizos Koutsantonis , Efstathios Stiliaris

Accurate and robust object pose estimation for robotics applications requires verification and refinement steps. In this work, we propose to integrate hypotheses verification with object pose refinement guided by physics simulation. This…

Computer Vision and Pattern Recognition · Computer Science 2020-05-19 Dominik Bauer , Timothy Patten , Markus Vincze

3D scene reconstruction is a long-standing vision task. Existing approaches can be categorized into geometry-based and learning-based methods. The former leverages multi-view geometry but can face catastrophic failures due to the reliance…

Computer Vision and Pattern Recognition · Computer Science 2023-08-11 Guangkai Xu , Wei Yin , Hao Chen , Chunhua Shen , Kai Cheng , Feng Zhao

Learning compact and interpretable representations of data is a critical challenge in scientific image analysis. Here, we introduce Affinity-VAE, a generative model that enables us to impose our scientific intuition about the similarity of…

Cellular electron cryo-tomography enables the 3D visualization of cellular organization in the near-native state and at submolecular resolution. However, the contents of cellular tomograms are often complex, making it difficult to…

Quantitative Methods · Quantitative Biology 2017-12-29 Xiangrui Zeng , Miguel Ricardo Leung , Tzviya Zeev-Ben-Mordehai , Min Xu

Egocentric motion capture with a head-mounted body-facing stereo camera is crucial for VR and AR applications but presents significant challenges such as heavy occlusions and limited annotated real-world data. Existing methods rely on…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Andrea Boscolo Camiletto , Jian Wang , Eduardo Alvarado , Rishabh Dabral , Thabo Beeler , Marc Habermann , Christian Theobalt

Modern electron tomography has progressed to higher resolution at lower doses by leveraging compressed sensing methods that minimize total variation (TV). However, these sparsity-emphasized reconstruction algorithms introduce tunable…

Medical Physics · Physics 2023-09-12 William Millsaps , Jonathan Schwartz , Zichao Wendy Di , Yi Jiang , Robert Hovden

Knowledge of a protein's atomic conformational ensemble is critical to determining its function, yet state-of-the-art ensemble prediction models are limited by lack of high-quality conformational data from simulation or experiment. Recent…

Machine Learning · Computer Science 2026-05-12 Jay Shenoy , Miro Astore , Axel Levy , Frédéric Poitevin , Sonya M. Hanson , Gordon Wetzstein

Single-Particle Reconstruction (SPR) in Cryo-Electron Microscopy (cryo-EM) is the task of estimating the 3D structure of a molecule from a set of noisy 2D projections, taken from unknown viewing directions. Many algorithms for SPR start…

Optimization and Control · Mathematics 2018-01-09 Eitan Levin , Tamir Bendory , Nicolas Boumal , Joe Kileel , Amit Singer

We present HumanNeRF-SE, a simple yet effective method that synthesizes diverse novel pose images with simple input. Previous HumanNeRF works require a large number of optimizable parameters to fit the human images. Instead, we reload these…

Computer Vision and Pattern Recognition · Computer Science 2024-04-05 Caoyuan Ma , Yu-Lun Liu , Zhixiang Wang , Wu Liu , Xinchen Liu , Zheng Wang

Direct detector device (DDD) cameras have revolutionized single particle electron cryomicroscopy (cryo-EM). In addition to an improved camera detective quantum efficiency, acquisition of DDD movies allows for correction of movement of the…

Quantitative Methods · Quantitative Biology 2015-11-23 John L. Rubinstein , Marcus A. Brubaker

The growing volume of high-resolution Whole Slide Images in digital histopathology poses significant storage, transmission, and computational efficiency challenges. Standard compression methods, such as JPEG, reduce file sizes but often…

Image and Video Processing · Electrical Eng. & Systems 2025-03-17 Srikar Yellapragada , Alexandros Graikos , Kostas Triaridis , Zilinghan Li , Tarak Nath Nandi , Ravi K Madduri , Prateek Prasanna , Joel Saltz , Dimitris Samaras

Enhancing cryogenic electron microscopy (cryo-EM) 3D density maps at intermediate resolution (4-8 {\AA}) is crucial in protein structure determination. Recent advances in deep learning have led to the development of automated approaches for…

Computer Vision and Pattern Recognition · Computer Science 2025-05-16 Chenwei Zhang , Khanh Dao Duc

Multislice electron ptychography (MEP) is an inverse imaging technique that computationally reconstructs the highest-resolution images of atomic crystal structures from diffraction patterns. Available algorithms often solve this inverse…

Image and Video Processing · Electrical Eng. & Systems 2025-07-28 Christian K. Belardi , Chia-Hao Lee , Yingheng Wang , Justin Lovelace , Kilian Q. Weinberger , David A. Muller , Carla P. Gomes

Achieving high-quality High Dynamic Range (HDR) imaging on resource-constrained edge devices is a critical challenge in computer vision, as its performance directly impacts downstream tasks such as intelligent surveillance and autonomous…

Computer Vision and Pattern Recognition · Computer Science 2025-09-25 Yu-Shen Huang , Tzu-Han Chen , Cheng-Yen Hsiao , Shaou-Gang Miaou

Over the past decade, cryogenic electron microscopy (cryo-EM) has emerged as a primary method for determining near-native, near-atomic resolution 3D structures of biological macromolecules. In order to meet increasing demand for cryo-EM,…

Image and Video Processing · Electrical Eng. & Systems 2022-01-19 Paul T. Kim , Alex J. Noble , Anchi Cheng , Tristan Bepler

Advances on cryo-electron imaging technologies have led to a rapidly increasing number of density maps. Alignment and comparison of density maps play a crucial role in interpreting structural information, such as conformational…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Bintao He , Fa Zhang , Chenjie Feng , Jianyi Yang , Xin Gao , Renmin Han

Electron cryotomography (CryoET) is currently the only method capable of visualizing cells in 3D at nanometer resolutions. While modern instruments produce massive amounts of tomography data containing extremely rich structural information,…

Quantitative Methods · Quantitative Biology 2021-07-01 Muyuan Chen , James M. Bell , Xiaodong Shi , Stella Y. Sun , Zhao Wang , Steven J. Ludtke

X-ray images ease the diagnosis and treatment process due to their rapid imaging speed and high resolution. However, due to the projection process of X-ray imaging, much spatial information has been lost. To accurately provide efficient…

Image and Video Processing · Electrical Eng. & Systems 2024-08-06 Lixing Tan , Shuang Song , Yaofeng He , Kangneng Zhou , Tong Lu , Ruoxiu Xiao