English
Related papers

Related papers: Contrastive Image-Metadata Pre-Training for Materi…

200 papers

Unsupervised deep image prior (DIP) addresses shortcomings of training data requirements and limited generalization associated with supervised deep learning. The performance of DIP depends on the network architecture and the stopping point…

The atomic number contrast imaging technique reveals an increase in intensity at interfaces of a high and low-density material in case of relatively thick samples. Elastic scattering factors and absorption coefficients are incorporated in a…

Computational Physics · Physics 2019-12-25 Aniruddha Dutta , Helge Heinrich

Contrastive learning has emerged as a transformative method for learning effective visual representations through the alignment of image and text embeddings. However, pairwise similarity computation in contrastive loss between image and…

Computer Vision and Pattern Recognition · Computer Science 2024-04-25 Sachin Mehta , Maxwell Horton , Fartash Faghri , Mohammad Hossein Sekhavat , Mahyar Najibi , Mehrdad Farajtabar , Oncel Tuzel , Mohammad Rastegari

With exponential growth in the use of digital image data, the need for efficient transmission methods has become imperative. Traditional image compression techniques often sacrifice image fidelity for reduced file sizes, challenging…

Image and Video Processing · Electrical Eng. & Systems 2024-10-15 Aryan Kashyap Naveen , Sunil Thunga , Anuhya Murki , Mahati A Kalale , Shriya Anil

To support the development of the data processing pipeline and the scientific performance assessment for the Cool Planet Imaging Coronagraph (CPI-C) on the Chinese Space Station Survey Telescope (CSST), we have developed the end-to-end…

Instrumentation and Methods for Astrophysics · Physics 2025-11-14 Gang Zhao , Yiming Zhu , Jiangpei Dou , Yili Chen , Zhonghua Lv , Bingli Niu , Zhaojun Yan , Bo Ma , Ran Li

The simulation of transmission electron microscopy (TEM) images or diffraction patterns is often required to interpret their contrast and extract specimen features. This is especially true for high-resolution phase-contrast imaging of…

Materials Science · Physics 2021-03-30 Jacob Madsen , Timothy J. Pennycook , Toma Susi

A Transformer-based Image Compression (TIC) approach is developed which reuses the canonical variational autoencoder (VAE) architecture with paired main and hyper encoder-decoders. Both main and hyper encoders are comprised of a sequence of…

Image and Video Processing · Electrical Eng. & Systems 2021-11-15 Ming Lu , Peiyao Guo , Huiqing Shi , Chuntong Cao , Zhan Ma

Contrastive Language-Image Pre-training (CLIP) models have demonstrated remarkable performance in zero-shot classification tasks, yet their efficacy in handling complex multi-object scenarios remains challenging. This study presents a…

Computer Vision and Pattern Recognition · Computer Science 2025-02-28 Reza Abbasi , Ali Nazari , Aminreza Sefid , Mohammadali Banayeeanzade , Mohammad Hossein Rohban , Mahdieh Soleymani Baghshah

Natural signals and images are well-known to be approximately sparse in transform domains such as Wavelets and DCT. This property has been heavily exploited in various applications in image processing and medical imaging. Compressed sensing…

Machine Learning · Computer Science 2015-10-26 Saiprasad Ravishankar , Yoram Bresler

Millimetre-wave observations represent an important tool for Cosmology studies. The Line Intensity Mapping (LIM) technique has been proposed to map in three dimensions the specific intensity due to line (e.g. [CII], CO) emission, for…

Instrumentation and Methods for Astrophysics · Physics 2023-08-29 Usasi Chowdhury , Florence Levy-Bertrand , Martino Calvo , Johannes Goupy , Alessandro Monfardini

Lossy image coding standards such as JPEG and MPEG have successfully achieved high compression rates for human consumption of multimedia data. However, with the increasing prevalence of IoT devices, drones, and self-driving cars, machines…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Chen-Hsiu Huang , Ja-Ling Wu

Scanning Transmission Electron Microscopy (STEM) enables the observation of atomic arrangements at sub-angstrom resolution, allowing for atomically resolved analysis of the physical and chemical properties of materials. However, due to the…

Computer Vision and Pattern Recognition · Computer Science 2025-04-04 Hesong Li , Ziqi Wu , Ruiwen Shao , Tao Zhang , Ying Fu

Learned image compression (LIC) methods have exhibited promising progress and superior rate-distortion performance compared with classical image compression standards. Most existing LIC methods are Convolutional Neural Networks-based…

Image and Video Processing · Electrical Eng. & Systems 2023-03-28 Jinming Liu , Heming Sun , Jiro Katto

Atomic resolution imaging in transmission electron microscopy (TEM) and scanning TEM (STEM) of light elements in electron-transparent materials has long been a challenge. Biomolecular materials, for example, are rapidly altered when…

Instrumentation and Detectors · Physics 2018-12-05 Fehmi S. Yasin , Tyler R. Harvey , Jordan J. Chess , Jordan S. Pierce , Colin Ophus , Peter Ercius , Benjamin J. McMorran

Recent advances in vision language pretraining (VLP) have been largely attributed to the large-scale data collected from the web. However, uncurated dataset contains weakly correlated image-text pairs, causing data inefficiency. To address…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Bumsoo Kim , Jinhyung Kim , Yeonsik Jo , Seung Hwan Kim

It has been a general trend to develop low-voltage electron microscopes due to their high imaging contrast of the sample and low radiation damage. Atom-resolved transmission electron microscopes with voltages as low as 15-40 kV have been…

Instrumentation and Detectors · Physics 2015-12-29 Wei-Tse Chang , Chun-Yueh Lin , Wei-Hao Hsu , Mu-Tung Chang , Yi-Sheng Chen , En-Te Hwu , Ing-Shouh Hwang

Contrastive language-image pre-training aligns the features of text-image pairs in a common latent space via distinct encoders for each modality. While this approach achieves impressive performance in several zero-shot tasks, it cannot…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Christian Schlarmann , Francesco Croce , Nicolas Flammarion , Matthias Hein

Contrast transfer mechanisms for electron scattering have been extensively studied in transmission electron microscopy. Here we revisit H. Rose's generalized contrast formalism from scattering theory to understand where information is…

Optics · Physics 2025-10-28 Desheng Ma , Guanxing Li , David A Muller , Steven E Zeltmann

In the field of integrated circuit manufacturing, the detection and classification of nanoscale wafer defects are critical for subsequent root cause analysis and yield enhancement. The complex background patterns observed in scanning…

Computer Vision and Pattern Recognition · Computer Science 2025-02-24 Qian Jin , Yuqi Jiang , Xudong Lu , Yumeng Liu , Yining Chen , Dawei Gao , Qi Sun , Cheng Zhuo

Transmission Electron Microscopy (TEM) is a powerful tool for imaging material structure and characterizing material chemistry. Recent advances in data collection technology for TEM have enabled high-volume and high-resolution data…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Josh Kacher , Yao Xie , Sven P. Voigt , Shixiang Zhu , Henry Yuchi , Jordan Key , Surya R. Kalidindi