English
Related papers

Related papers: UniEM-3M: A Universal Electron Micrograph Dataset …

200 papers

Cryo-electron microscopy (cryo-EM) allows for the high-resolution reconstruction of 3D structures of proteins and other biomolecules. Successful reconstruction of both shape and movement greatly helps understand the fundamental processes of…

Computer Vision and Pattern Recognition · Computer Science 2023-10-12 Xinhang Liu , Yan Zeng , Yifan Qin , Hao Li , Jiakai Zhang , Lan Xu , Jingyi Yu

Characterizing materials with electron micrographs is a crucial task in fields such as semiconductors and quantum materials. The complex hierarchical structure of micrographs often poses challenges for traditional classification methods. In…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Sakhinana Sagar Srinivas , Geethan Sannidhi , Venkataramana Runkana

Understanding charts requires models to jointly reason over geometric visual patterns, structured numerical data, and natural language -- a capability where current vision-language models (VLMs) remain limited. We introduce ChartNet, a…

Electromagnetic (EM) sensing is a wide-spread contactless examination technique in science, engineering and military. However, conventional sensing systems are mostly lack of intelligence, which not only require expensive hardware and…

Signal Processing · Electrical Eng. & Systems 2019-12-06 Hao-Yang Li , Han-Ting Zhao , Meng-Lin Wei , Heng-Xin Ruan , Ya Shuang , Tie Jun Cui , Lianlin Li

The promise of large-scale, high-resolution datasets from Electron Microscopy (EM) and X-ray Microtomography (XRM) lies in their ability to reveal neural structures and synaptic connectivity, which is critical for understanding the brain.…

This paper introduces M$^{3}$-20M, a large-scale Multi-Modal Molecule dataset that contains over 20 million molecules, with the data mainly being integrated from existing databases and partially generated by large language models. Designed…

Quantitative Methods · Quantitative Biology 2025-03-18 Siyuan Guo , Lexuan Wang , Chang Jin , Jinxian Wang , Han Peng , Huayang Shi , Wengen Li , Jihong Guan , Shuigeng Zhou

While recent multimodal large language models (MLLMs) have advanced automated ECG interpretation, they still face two key limitations: (1) insufficient multimodal synergy between time series signals and visual ECG representations, and (2)…

Computation and Language · Computer Science 2025-10-21 Xiang Lan , Feng Wu , Kai He , Qinghao Zhao , Shenda Hong , Mengling Feng

Significant advancements in Large Multimodal Models (LMMs) have enabled them to tackle complex problems involving visual-mathematical reasoning. However, their ability to identify geometric elements remains underexplored. To address this…

Computer Vision and Pattern Recognition · Computer Science 2024-12-18 Chao Zhang , Jiamin Tang , Jing Xiao

Cryo-Electron Microscopy (cryo-EM) has emerged as a key technology to determine the structure of proteins, particularly large protein complexes and assemblies in recent years. A key challenge in cryo-EM data analysis is to automatically…

Biomolecules · Quantitative Biology 2023-04-04 Nabin Giri , Raj S. Roy , Jianlin Cheng

Recently, a growing interest has been seen in deep learning-based semantic segmentation. UNet, which is one of deep learning networks with an encoder-decoder architecture, is widely used in medical image segmentation. Combining multi-scale…

Image and Video Processing · Electrical Eng. & Systems 2020-04-21 Huimin Huang , Lanfen Lin , Ruofeng Tong , Hongjie Hu , Qiaowei Zhang , Yutaro Iwamoto , Xianhua Han , Yen-Wei Chen , Jian Wu

Automated experimentation with real time data analysis in scanning transmission electron microscopy (STEM) often require end-to-end framework. The four-dimensional scanning transmission electron microscopy (4D-STEM) with high-throughput…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Mingyu Liu , Zian Mao , Zhu Liu , Haoran Zhang , Jintao Guo , Xiaoya He , Xi Huang , Shufen Chu , Chun Cheng , Jun Ding , Yujun Xie

Over the past decade, cryogenic electron microscopy (cryo-EM) has emerged as a primary method for determining near-native, near-atomic resolution 3D structures of biological macromolecules. In order to meet increasing demand for cryo-EM,…

Image and Video Processing · Electrical Eng. & Systems 2022-01-19 Paul T. Kim , Alex J. Noble , Anchi Cheng , Tristan Bepler

Transmission Electron Microscopy (TEM) is a powerful tool for imaging material structure and characterizing material chemistry. Recent advances in data collection technology for TEM have enabled high-volume and high-resolution data…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Josh Kacher , Yao Xie , Sven P. Voigt , Shixiang Zhu , Henry Yuchi , Jordan Key , Surya R. Kalidindi

Transductive few-shot learning has recently triggered wide attention in computer vision. Yet, current methods introduce key hyper-parameters, which control the prediction statistics of the test batches, such as the level of class balance,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-14 Long Zhou , Fereshteh Shakeri , Aymen Sadraoui , Mounir Kaaniche , Jean-Christophe Pesquet , Ismail Ben Ayed

A unified and versatile LiDAR segmentation model with strong robustness and generalizability is desirable for safe autonomous driving perception. This work presents M3Net, a one-of-a-kind framework for fulfilling multi-task, multi-dataset,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-03 Youquan Liu , Lingdong Kong , Xiaoyang Wu , Runnan Chen , Xin Li , Liang Pan , Ziwei Liu , Yuexin Ma

In light of globalized hardware supply chains, the assurance of hardware components has gained significant interest, particularly in cryptographic applications and high-stakes scenarios. Identifying metal lines on scanning electron…

Cryptography and Security · Computer Science 2026-03-18 Christian Gehrmann , Jonas Ricker , Simon Damm , Deruo Cheng , Julian Speith , Yiqiong Shi , Asja Fischer , Christof Paar

Cryo-EM is a transformational paradigm in molecular biology where computational methods are used to infer 3D molecular structure at atomic resolution from extremely noisy 2D electron microscope images. At the forefront of research is how to…

Quantitative Methods · Quantitative Biology 2025-06-12 Shayan Shekarforoush , David B. Lindell , Marcus A. Brubaker , David J. Fleet

Electron microscopy (EM) images exhibit anisotropic axial resolution due to the characteristics inherent to the imaging modality, presenting challenges in analysis and downstream tasks.In this paper, we propose a diffusion-model-based…

Computer Vision and Pattern Recognition · Computer Science 2023-08-04 Kyungryun Lee , Won-Ki Jeong

Differentiating signals from the background in micrographs is a critical initial step for cryogenic electron microscopy (cryo-EM), yet it remains laborious due to low signal-to-noise ratio (SNR), the presence of contaminants and densely…

Image and Video Processing · Electrical Eng. & Systems 2025-09-30 Szu-Chi Chung , Po-Cheng Chou

A single-particle cryo-electron microscopy (cryo-EM) measurement, called a micrograph, consists of multiple two-dimensional tomographic projections of a three-dimensional (3-D) molecular structure at unknown locations, taken under unknown…

Image and Video Processing · Electrical Eng. & Systems 2026-03-10 Shay Kreymer , Amit Singer , Tamir Bendory