English
Related papers

Related papers: Towards Foundation Models for Cryo-ET Subtomogram …

200 papers

We present a novel approach for extracting 3D atomic-level information from transmission electron microscopy (TEM) images affected by significant noise. The approach is based on formulating depth estimation as a semantic segmentation…

Computer Vision and Pattern Recognition · Computer Science 2026-01-29 Matan Leibovich , Mai Tan , Ramon Manzorro , Adria Marcos-Morales , Sreyas Mohan , Peter A. Crozier , Carlos Fernandez-Granda

The recent improvements in cryo-electron microscopy (cryo-EM) in the past few years are now allowing to observe molecular complexes at atomic resolution. As a consequence, numerous structures derived from cryo-EM are now available in the…

Biomolecules · Quantitative Biology 2020-05-04 Mikael Trellet , Gydo van Zundert , Alexandre M. J. J. Bonvin

While transformers have surpassed convolutional neural networks (CNNs) in various computer vision tasks, microelectronics defect detection still largely relies on CNNs. We hypothesize that this gap is due to the fact that a) transformers…

Computer Vision and Pattern Recognition · Computer Science 2025-08-13 Nikolai Röhrich , Alwin Hoffmann , Richard Nordsieck , Emilio Zarbali , Alireza Javanmardi

While liquid crystals (LCs) have been extensively studied, obtaining a comprehensive nanoscale picture of their molecular organization remains challenging, as conventional techniques face an intrinsic trade-off between spatial and chemical…

Computed Tomography (CT) is an imaging technique where information about an object are collected at different angles (called projections or scans). Then the cross-sectional image showing the internal structure of the slice is produced by…

Image and Video Processing · Electrical Eng. & Systems 2022-09-07 Zhengchun Liu , Rajkumar Kettimuthu , Ian Foster

Single particle electron cryomicroscopy (cryo-EM) allows for structures of proteins and protein complexes to be determined from images of non-crystalline specimens. Cryo-EM data analysis requires electron microscope images of randomly…

Instrumentation and Detectors · Physics 2015-11-23 Jianhua Zhao , Marcus A. Brubaker , Samir Benlekbir , John L. Rubinstein

Electrical Impedance Tomography (EIT) is a powerful imaging technique with diverse applications, e.g., medical diagnosis, industrial monitoring, and environmental studies. The EIT inverse problem is about inferring the internal conductivity…

Machine Learning · Computer Science 2023-10-31 Derick Nganyu Tanyu , Jianfeng Ning , Andreas Hauptmann , Bangti Jin , Peter Maass

Deploying Vision Transformers (ViTs) on near-sensor analog accelerators demands training pipelines that are explicitly aligned with device-level noise and energy constraints. We introduce a compact framework for silicon-photonic execution…

Emerging Technologies · Computer Science 2026-04-07 Xuming Chen , Deniz Najafi , Chengwei Zhou , Pietro Mercati , Arman Roohi , Mohsen Imani , Mahdi Nikdast , Shaahin Angizi , Gourav Datta

Cryo-electron microscopy (cryo-EM) is a technique for reconstructing the 3-dimensional (3D) structure of biomolecules (especially large protein complexes and molecular assemblies). As the resolution increases to the near-atomic scale,…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Weijie Chen , Xinyan Wang , Yuhang Wang

Machine learning-based interatomic potentials and force fields depend critically on accurate atomic structures, yet such data are scarce due to the limited availability of experimentally resolved crystals. Although atomic-resolution…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Yaotian Yang , Yiwen Tang , Yizhe Chen , Xiao Chen , Jiangjie Qiu , Hao Xiong , Haoyu Yin , Zhiyao Luo , Yifei Zhang , Sijia Tao , Wentao Li , Qinghua Zhang , Yuqiang Li , Wanli Ouyang , Bin Zhao , Xiaonan Wang , Fei Wei

Recently, large-scale transformer-based models have been proven to be effective over various tasks across many domains. Nevertheless, applying them in industrial production requires tedious and heavy works to reduce inference costs. To fill…

Computation and Language · Computer Science 2022-05-25 Gongzheng Li , Yadong Xi , Jingzhen Ding , Duan Wang , Bai Liu , Changjie Fan , Xiaoxi Mao , Zeng Zhao

Electron tomography (ET) allows high-resolution reconstructions of macromolecular complexes at nearnative state. Cellular structures segmentation in the reconstruction data from electron tomographic images is often required for analyzing…

Computer Vision and Pattern Recognition · Computer Science 2018-11-29 Enze Zhang , Fa Zhang , Zhiyong Liu , Xiaohua Wan , Lifa Zhu

Electron cryomicroscopy (cryo-EM) is a technique in structural biology used to reconstruct accurate volumetric maps of molecules. One step of the cryo-EM pipeline involves solving an inverse-problem. This inverse-problem, referred to as…

Quantitative Methods · Quantitative Biology 2024-11-26 Aaditya V. Rangan , Wai-Shing Tang , Pilar Cossio , Kexin Zhang , Nikolaus Grigorieff

Quantization has become a predominant approach for model compression, enabling deployment of large models trained on GPUs onto smaller form-factor devices for inference. Quantization-aware training (QAT) optimizes model parameters with…

Machine Learning · Computer Science 2022-12-13 Zheng Wang , Juncheng B Li , Shuhui Qu , Florian Metze , Emma Strubell

There is a clear need for developments in characterisation techniques that provide detailed information about structure-function relationships in biology. Using electron microscopy to achieve high resolution while maintaining a broad field…

Quantitative Methods · Quantitative Biology 2023-09-12 Chen Huang , Judy S. Kim , Angus I. Kirkland

Atom probe tomography (APT) provides the three-dimensional composition of materials at near-atomic length scales, achieving detection limits in the range of tens of atomic parts-per-million regardless of element type. APT requires the…

Large-scale foundation models for EEG signals offer a promising path to generalizable brain-computer interface (BCI) applications, but they often suffer from misalignment between pretraining objectives and downstream tasks, as well as…

Machine Learning · Computer Science 2025-10-03 Suli Wang , Yangshen Deng , Zhenghua Bao , Xinyu Zhan , Yiqun Duan

Cryo-electron microscopy (EM) single particle reconstruction is an entirely general technique for 3D structure determination of macromolecular complexes. However, because the images are taken at low electron dose, it is extremely hard to…

Computer Vision and Pattern Recognition · Computer Science 2019-04-17 Yifeng Fan , Zhizhen Zhao

Learning robust representations of 3D shapes from voxelized data is essential for advancing AI methods in biomedical imaging. However, most contemporary 3D computer vision approaches operate on point clouds, meshes, or octrees, while…

Image and Video Processing · Electrical Eng. & Systems 2026-03-05 Rui Li , Artsemi Yushkevich , Mikhail Kudryashev , Artur Yakimovich

Pretraining on a large number of unlabeled 3D molecules has showcased superiority in various scientific applications. However, prior efforts typically focus on pretraining models in a specific domain, either proteins or small molecules,…

Machine Learning · Computer Science 2025-02-25 Rui Jiao , Xiangzhe Kong , Li Zhang , Ziyang Yu , Fangyuan Ren , Wenjuan Tan , Wenbing Huang , Yang Liu