English
Related papers

Related papers: CryoFastAR: Fast Cryo-EM Ab Initio Reconstruction …

200 papers

While object reconstruction has made great strides in recent years, current methods typically require densely captured images and/or known camera poses, and generalize poorly to novel object categories. To step toward object reconstruction…

Computer Vision and Pattern Recognition · Computer Science 2024-01-29 Hanwen Jiang , Zhenyu Jiang , Kristen Grauman , Yuke Zhu

We consider the problem of recovering the three-dimensional atomic structure of a flexible macromolecule from a heterogeneous cryo-EM dataset. The dataset contains noisy tomographic projections of the electrostatic potential of the…

Image and Video Processing · Electrical Eng. & Systems 2023-02-08 Carlos Esteve-Yagüe , Willem Diepeveen , Ozan Öktem , Carola-Bibiane Schönlieb

The growing role of data-driven approaches to scientific discovery has unveiled a large class of models that involve latent transformations with a rigid algebraic constraint. Three-dimensional molecule reconstruction in Cryo-Electron…

Information Theory · Computer Science 2019-06-04 Amelia Perry , Jonathan Weed , Afonso S. Bandeira , Philippe Rigollet , Amit Singer

Estimating relative camera poses between images has been a central problem in computer vision. Methods that find correspondences and solve for the fundamental matrix offer high precision in most cases. Conversely, methods predicting pose…

Computer Vision and Pattern Recognition · Computer Science 2024-03-06 Chris Rockwell , Nilesh Kulkarni , Linyi Jin , Jeong Joon Park , Justin Johnson , David F. Fouhey

Recent advancements in deep learning for predicting 3D protein structures have shown promise, particularly when leveraging inputs like protein sequences and Cryo-Electron microscopy (Cryo-EM) images. However, these techniques often fall…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Jaydeep Rade , Ethan Herron , Soumik Sarkar , Anwesha Sarkar , Adarsh Krishnamurthy

Advances in imagery at atomic and near-atomic resolution, such as cryogenic electron microscopy (cryo-EM), have led to an influx of high resolution images of proteins and other macromolecular structures to data banks worldwide. Producing a…

Quantitative Methods · Quantitative Biology 2021-04-06 Nathan Ranno , Dong Si

Real-time dense scene reconstruction during unstable camera motions is crucial for robotics, yet current RGB-D SLAM systems fail when cameras experience large viewpoint changes, fast motions, or sudden shaking. Classical optimization-based…

Robotics · Computer Science 2026-03-04 Siyan Dong , Zijun Wang , Lulu Cai , Yi Ma , Yanchao Yang

Room layout estimation from multiple-perspective images is poorly investigated due to the complexities that emerge from multi-view geometry, which requires muti-step solutions such as camera intrinsic and extrinsic estimation, image…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Yaxuan Huang , Xili Dai , Jianan Wang , Xianbiao Qi , Yixing Yuan , Xiangyu Yue

The 3D reconstruction of objects is a prerequisite for many highly relevant applications of computer vision such as mobile robotics or autonomous driving. To deal with the inverse problem of reconstructing 3D objects from their 2D…

Computer Vision and Pattern Recognition · Computer Science 2021-12-09 Max Coenen , Franz Rottensteiner

3D scene reconstruction is a long-standing vision task. Existing approaches can be categorized into geometry-based and learning-based methods. The former leverages multi-view geometry but can face catastrophic failures due to the reliance…

Computer Vision and Pattern Recognition · Computer Science 2023-08-11 Guangkai Xu , Wei Yin , Hao Chen , Chunhua Shen , Kai Cheng , Feng Zhao

AI-based in silico methods have improved protein structure prediction but often struggle with large protein complexes (PCs) involving multiple interacting proteins due to missing 3D spatial cues. Experimental techniques like Cryo-EM are…

Echocardiography is a key imaging modality for cardiac assessment but remains highly operator-dependent, and access to trained sonographers is limited in underserved settings. Teleoperated robotic echocardiography has been proposed as a…

Single-particle cryo-electron microscopy (cryo-EM) has become a cornerstone of structural biology, enabling near-atomic resolution analysis of macromolecules through advanced computational methods. However, the development of cryo-EM…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Runmin Jiang , Genpei Zhang , Yuntian Yang , Siqi Wu , Minhao Wu , Wanyue Feng , Yizhou Zhao , Xi Xiao , Xiao Wang , Tianyang Wang , Xingjian Li , Muyuan Chen , Min Xu

State estimation from measured data is crucial for robotic applications as autonomous systems rely on sensors to capture the motion and localize in the 3D world. Among sensors that are designed for measuring a robot's pose, or for soft…

Robotics · Computer Science 2023-02-28 Jingpei Lu , Fei Liu , Cedric Girerd , Michael C. Yip

Single-particle cryo-electron microscopy (cryo-EM) has recently joined X-ray crystallography and NMR spectroscopy as a high-resolution structural method to resolve biological macromolecules. In a cryo-EM experiment, the microscope produces…

Information Theory · Computer Science 2022-10-28 Tamir Bendory , Nicolas Boumal , William Leeb , Eitan Levin , Amit Singer

Robust 3D geometry estimation from videos is critical for applications such as autonomous navigation, SLAM, and 3D scene reconstruction. Recent methods like DUSt3R demonstrate that regressing dense pointmaps from image pairs enables…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Xiaoshan Wu , Yifei Yu , Xiaoyang Lyu , Yihua Huang , Bo Wang , Baoheng Zhang , Zhongrui Wang , Xiaojuan Qi

We present a conditional estimation (CEST) framework to learn 3D facial parameters from 2D single-view images by self-supervised training from videos. CEST is based on the process of analysis by synthesis, where the 3D facial parameters…

Computer Vision and Pattern Recognition · Computer Science 2021-10-12 Yandong Wen , Weiyang Liu , Bhiksha Raj , Rita Singh

In cryo-electron microscopy (cryo-EM), a microscope generates a top view of a sample of randomly-oriented copies of a molecule. The problem of single particle reconstruction (SPR) from cryo-EM is to use the resulting set of noisy 2D…

Numerical Analysis · Mathematics 2014-09-16 Gene Katsevich , Alexander Katsevich , Amit Singer

Single-particle cryo-electron microscopy (cryo-EM) is a leading technology to resolve the structure of molecules. Early in the process, the user detects potential particle images in the raw data. Typically, there are many false detections…

Image and Video Processing · Electrical Eng. & Systems 2023-03-08 Gili Weiss-Dicker , Amitay Eldar , Yoel Shkolinsky , Tamir Bendory

Recovering camera poses from a set of images is a foundational task in 3D computer vision, which powers key applications such as 3D scene/object reconstructions. Classic methods often depend on feature correspondence, such as keypoints,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Hao Tang , Weiyao Wang , Pierre Gleize , Matt Feiszli