English
Related papers

Related papers: Multimodal transformers with elemental priors for …

200 papers

Electron Backscattering Diffraction (EBSD) provides important information to discriminate phase transformation products in steels. This task is conventionally performed by an expert, who carries a high degree of subjectivity and requires…

Conventional class-guided diffusion models generally succeed in generating images with correct semantic content, but often struggle with texture details. This limitation stems from the usage of class priors, which only provide coarse and…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Xiaoyu Yue , Zidong Wang , Zeyu Lu , Shuyang Sun , Meng Wei , Wanli Ouyang , Lei Bai , Luping Zhou

A new method has been developed for the correction of the distortions and/or enhanced phase differentiation in Electron Backscatter Diffraction (EBSD) data. Using a multi-modal data approach, the method uses segmented images of the phase of…

Data Analysis, Statistics and Probability · Physics 2019-03-11 Marie-Agathe Charpagne , Florian Strub , Tresa M. Pollock

In this article, we report, for the first time, broadband multifunctional metasurfaces with more than four distinct functionalities. The constituent meta-atoms combine two different phase change materials, $\mathrm{VO_2}$ and…

Machine learning has become a crucial tool for predicting the properties of crystalline materials. However, existing methods primarily represent material information by constructing multi-edge graphs of crystal structures, often overlooking…

Machine Learning · Computer Science 2024-11-14 Chao Huang , Chunyan Chen , Ling Shi , Chen Chen

Referring segmentation aims to segment a target object related to a natural language expression. Key challenges of this task are understanding the meaning of complex and ambiguous language expressions and determining the relevant regions in…

Computer Vision and Pattern Recognition · Computer Science 2024-08-15 Yubin Cho , Hyunwoo Yu , Suk-ju Kang

Here we show that the low temperature phase of magnetite is associated with an effective, although fractional, ordering of the charge. Evidence and a quantitative evaluation of the atomic charges are achieved by using resonant x-ray…

Strongly Correlated Electrons · Physics 2009-11-11 E. Nazarenko , J. E. Lorenzo , Y. Joly , J. L. Hodeau , D. Mannix , C. Marin

Transient X-ray absorption techniques can measure ultrafast dynamics of the elemental edges in a material or multiple layer junction, giving them immense potential for deconvoluting concurrent processes. However, the interpretation of the…

Materials Science · Physics 2021-06-10 Hanzhe Liu , Isabel M. Klein , Jonathan M. Michelsen , Scott K. Cushing

Two-dimensional transition metal dichalcogenides (TMDs) can adopt one of several possible structures, with the most common being the trigonal prismatic and octahedral symmetry phases. Since the structure determines the electronic…

Materials Science · Physics 2022-09-20 Pankaj Kumar , Vinit Sharma , Sharmila Shirodkar , Pratibha Dev

Scientific researchers frequently use the in situ synchrotron high-energy powder X-ray diffraction (XRD) technique to examine the crystallographic structures of materials in functional devices such as rechargeable battery materials. We…

Time-resolved x-ray diffraction (TR-XRD) and ultrafast electron diffraction (TR-UED) are emerging tools for probing ultrafast quantum dynamics. From a theoretical perspective, they are commonly described within different frameworks and…

Quantum Physics · Physics 2026-05-04 Mingrui Yuan , Nikolay V. Golubev

Thyroid nodule classification using ultrasound imaging is essential for early diagnosis and clinical decision-making; however, despite promising performance on in-distribution data, existing deep learning methods often exhibit limited…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Yangmei Chen , Zhongyuan Zhang , Xikun Zhang , Xinyu Hao , Mingliang Hou , Renqiang Luo , Ziqi Xu

Novel materials drive advancements in fields ranging from energy storage to electronics, with crystal structure characterization forming a crucial yet challenging step in materials discovery. In this work, we introduce \emph{deCIFer}, an…

Machine learning has revolutionized many fields, including materials science. However, predicting properties of crystalline materials using machine learning faces challenges in input encoding, output versatility, and interpretability. We…

Materials Science · Physics 2025-05-22 Haosheng Xu , Dongheng Qian , Jing Wang

Many real-world tasks involve identifying patterns from data satisfying background or prior knowledge. In domains like materials discovery, due to the flaws and biases in raw experimental data, the identification of X-ray diffraction…

Computer Vision and Pattern Recognition · Computer Science 2018-12-12 Junwen Bai , Zihang Lai , Runzhe Yang , Yexiang Xue , John Gregoire , Carla Gomes

We present an approach to efficiently and effectively adapt a masked image modeling (MIM) pre-trained vanilla Vision Transformer (ViT) for object detection, which is based on our two novel observations: (i) A MIM pre-trained vanilla ViT…

Computer Vision and Pattern Recognition · Computer Science 2022-05-20 Yuxin Fang , Shusheng Yang , Shijie Wang , Yixiao Ge , Ying Shan , Xinggang Wang

We present Multiscale Vision Transformers (MViT) for video and image recognition, by connecting the seminal idea of multiscale feature hierarchies with transformer models. Multiscale Transformers have several channel-resolution scale…

Computer Vision and Pattern Recognition · Computer Science 2021-04-23 Haoqi Fan , Bo Xiong , Karttikeya Mangalam , Yanghao Li , Zhicheng Yan , Jitendra Malik , Christoph Feichtenhofer

Vision Transformer (ViT) is a pioneering deep learning framework that can address real-world computer vision issues, such as image classification and object recognition. Importantly, ViTs are proven to outperform traditional deep learning…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Yuda Bi , Anees Abrol , Zening Fu , Vince Calhoun

A major challenge in materials science is the determination of the structure of nanometer sized objects. Here we present a novel approach that uses a generative machine learning model based on diffusion processes that is trained on 45,229…

Computational Physics · Physics 2024-11-01 Gabe Guo , Tristan Saidi , Maxwell Terban , Michele Valsecchi , Simon JL Billinge , Hod Lipson

In this paper, we propose a new Temporal MDS-Vision Transformer (T-MDS-ViT) for multiclass target classification using millimeter-wave FMCW radar micro-Doppler spectrograms. Specifically, we design a transformer-based architecture that…

Signal Processing · Electrical Eng. & Systems 2025-11-18 Nghia Thinh Nguyen , Tri Nhu Do