English
Related papers

Related papers: Multimodal transformers with elemental priors for …

200 papers

Photo- and charge-carrier induced ion migration is a major challenge when utilizing metal halide perovskite semiconductors for optoelectronic applications. For mixed iodide/bromide perovskites, the compositional instability due to light- or…

X-ray imaging is a rapid and cost-effective tool for visualizing internal human anatomy. While multi-view X-ray imaging provides complementary information that enhances diagnosis, intervention, and education, acquiring images from multiple…

Image and Video Processing · Electrical Eng. & Systems 2025-10-21 Chun Xie , Yuichi Yoshii , Itaru Kitahara

Accurate material recognition is a fundamental capability for intelligent perception systems to interact safely and effectively with the physical world. For instance, distinguishing visually similar objects like glass and plastic cups is…

Signal Processing · Electrical Eng. & Systems 2026-04-16 Jiangyou Zhu , He Chen

Visualizing the electron dynamics in four dimensions of space and time is crucial to the understanding of several ubiquitous processes in nature. Hence, ultrafast X-ray and electron imaging tools have been developed to probe the dynamics of…

Mesoscale and Nanoscale Physics · Physics 2024-11-26 Mingrui Yuan , Nikolay V. Golubev

Vision-Language Models (VLMs) have demonstrated impressive performance on various visual tasks, yet they still require adaptation on downstream tasks to achieve optimal performance. Recently, various adaptation technologies have been…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Chuanming Wang , Henming Mao , Huanhuan Zhang , Huiyuan Fu , Huadong Ma

Constructing a quantum description of crystals from scattering experiments is of paramount importance to explain their macroscopic properties and to evaluate the pertinence of theoretical ab-initio models. While reconstruction methods of…

Materials Science · Physics 2019-04-19 Benjamin De Bruyne , Jean-Michel Gillet

Infrared vibrational spectroscopy in the gas phase has emerged as a powerful tool to determine complex molecular structures with Angstrom accuracy. Among the different approaches IRMPD (InfraRed Multiple Photon Dissociation), which requires…

Chemical Physics · Physics 2024-06-24 Oznur Yeni , Baptiste Schindler , Baptiste Moge , Isabelle Compagnon

Determining the stability of chemical compounds is essential for advancing material discovery. In this study, we introduce a novel deep neural network model designed to predict a crystal's formation energy, which identifies its stability…

Materials Science · Physics 2026-04-21 V. Torlao , E. A. Fajardo

The core theme of X-ray crystallography is reconstructing the electron density distribution of crystals under the constraints of observed diffraction data. Nevertheless, the reconstruction of electron density distribution by straightforward…

Materials Science · Physics 2015-07-14 Hui Li , Meng He , Ze Zhang

Vision transformers (ViTs) have found only limited practical use in processing images, in spite of their state-of-the-art accuracy on certain benchmarks. The reason for their limited use include their need for larger training datasets and…

Computer Vision and Pattern Recognition · Computer Science 2022-01-26 Pranav Jeevan , Amit sethi

Phase fractions, compositions and energies of the stable phases as a function of macroscopic composition, temperature, and pressure (X-T-P) are the principle correlations needed for the design of new materials and improvement of existing…

Materials Science · Physics 2020-02-04 Noah H Paulson , Brandon J Bocklund , Richard A Otis , Zi-Kui Liu , Marius Stan

To determine crystal structures from an X-ray diffraction (XRD) pattern containing multiple unknown phases, a data-assimilated crystal growth (DACG) simulation method has been developed. The XRD penalty function selectively stabilizes the…

Materials Science · Physics 2024-05-17 Yuuki Kubo , Ryuhei Sato , Yuansheng Zhao , Takahiro Ishikawa , Shinji Tsuneyuki

Understanding the relationship between atomic structure (order) and chemical composition (chemistry) is critical for advancing materials science, yet traditional spectroscopic techniques can be slow and damaging to sensitive samples.…

Materials Science · Physics 2025-08-29 Mridul Kumar , Yevgeny Rakita

Disease classification relying solely on imaging data attracts great interest in medical image analysis. Current models could be further improved, however, by also employing Electronic Health Records (EHRs), which contain rich information…

Image and Video Processing · Electrical Eng. & Systems 2021-03-22 Tom van Sonsbeek , Xiantong Zhen , Marcel Worring , Ling Shao

Existing 2D methods utilize UNet-based diffusion models to generate multi-view physically-based rendering (PBR) maps but struggle with multi-view inconsistency, while some 3D methods directly generate UV maps, encountering generalization…

Computer Vision and Pattern Recognition · Computer Science 2024-12-19 Shenhao Zhu , Lingteng Qiu , Xiaodong Gu , Zhengyi Zhao , Chao Xu , Yuxiao He , Zhe Li , Xiaoguang Han , Yao Yao , Xun Cao , Siyu Zhu , Weihao Yuan , Zilong Dong , Hao Zhu

Self-supervised pretrain techniques have been widely used to improve the downstream tasks' performance. However, real-world magnetic resonance (MR) studies usually consist of different sets of contrasts due to different acquisition…

Image and Video Processing · Electrical Eng. & Systems 2025-06-17 Badhan Kumar Das , Ajay Singh , Gengyan Zhao , Han Liu , Thomas J. Re , Dorin Comaniciu , Eli Gibson , Andreas Maier

We apply pre-trained Vision Transformers (ViTs), originally developed for image recognition, to the analysis of astronomical spectral data. By converting traditional one-dimensional spectra into two-dimensional image representations, we…

Instrumentation and Methods for Astrophysics · Physics 2026-05-13 Luis Felipe Strano Moraes , Ignacio Becker , Pavlos Protopapas , Guillermo Cabrera-Vives

The rapid advancement of Deepfake technologies and video manipulation tools poses a critical challenge to multimedia forensics, judicial evidence integrity, and information authenticity. Current detectors rely on single-modality signals,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Hoda Osama Elkhodary , Sherin Mostafa Youssef , Marwa Elshenawy , Dalia Sobhy

The phase behavior is investigated for systems composed of a large number of macromolecular components N, with N greater or equal to 2. Liquid-liquid phase separation is modelled using a virial expansion up to the second order of the…

Soft Condensed Matter · Physics 2024-05-29 Arjen Bot , Erik van der Linden , Paul Venema

Liquid crystals (LCs) play a fundamental and significant role in modern technology. Recently, they have also been used in active switching, adaptive optics, and next-generation displays for augmented and virtual reality. This is due to the…

Optics · Physics 2022-08-18 N. Madadi , M. Amiri