English
Related papers

Related papers: Zero-shot Autonomous Microscopy for Scalable and I…

200 papers

Two-dimensional (2D) materials and heterostructures exhibit unique physical properties, necessitating efficient and accurate characterization methods. Leveraging advancements in artificial intelligence, we introduce a deep learning-based…

Machine Learning · Computer Science 2025-03-04 Junqi He , Yujie Zhang , Jialu Wang , Tao Wang , Pan Zhang , Chengjie Cai , Jinxing Yang , Xiao Lin , Xiaohui Yang

Defect engineering has been profoundly employed to confer desirable functionality to materials that pristine lattices inherently lack. Although single atomic-resolution scanning transmission electron microscopy (STEM) images are widely…

Lensless optical imaging eliminates the need for refractive optics, enabling compact and low-cost cameras with a large field-of-view, supporting point-of-care diagnostics and industrial monitoring. Practical deployments, however, remain…

The high-throughput screening of periodic inorganic solids using machine learning methods requires atomic positions to encode structural and compositional details into appropriate material descriptors. These atomic positions are not…

Materials Science · Physics 2018-12-26 Ankit Jain , Thomas Bligaard

In this work, we introduce MUSE (Model-based Uncertainty-aware Similarity Estimation), a training-free framework designed for model-based zero-shot 2D object detection and segmentation. MUSE leverages 2D multi-view templates rendered from…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 Sungmin Cho , Sungbum Park , Insoo Oh

Analyzing atomically resolved images is a time-consuming process requiring solid experience and substantial human intervention. In addition, the acquired images contain a large amount of information such as crystal structure, presence and…

We present helium atom micro-diffraction as an ideal technique for characterization of 2D materials due to its ultimate surface sensitivity combined with sub-micron spatial resolution. Thermal energy neutral helium scatters from the valence…

Real-world quantum applications, eg. on-chip quantum networks and quantum cryptography, necessitate large scale integrated single-photon sources with nanoscale footprint for modern information technology. While on-demand and high fidelity…

Noninvasive optical imaging modalities can probe patient's tissue in 3D and over time generate gigabytes of clinically relevant data per sample. There is a need for AI models to analyze this data and assist clinical workflow. The lack of…

Semantic Segmentation is one of the most challenging vision tasks, usually requiring large amounts of training data with expensive pixel level annotations. With the success of foundation models and especially vision-language models, recent…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Soroush Seifi , Daniel Olmeda Reino , Fabien Despinoy , Rahaf Aljundi

Quantitative analysis of microstructural features on the nanoscale, including precipitates, local chemical orderings (LCOs) or structural defects (e.g. stacking faults) plays a pivotal role in understanding the mechanical and physical…

Recent advances in scanning transmission electron and scanning tunneling microscopies allow researchers to measure materials structural and electronic properties, such as atomic displacements and charge density modulations, at an Angstrom…

Vision foundation models can perform generalized object classification in zero-shot mode, and face/person recognition when they are fine-tuned. However, fine-tuned models suffer from catastrophic forgetting. We create models that perform…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Thomas M Metz , Matthew Q Hill , Alice J O'Toole

Camouflaged Object Segmentation (COS) faces significant challenges due to the scarcity of annotated data, where meticulous pixel-level annotation is both labor-intensive and costly, primarily due to the intricate object-background…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Cheng Lei , Jie Fan , Xinran Li , Tianzhu Xiang , Ao Li , Ce Zhu , Le Zhang

High throughput characterization and processing techniques are becoming increasingly necessary to navigate multivariable, data-driven design challenges for sensors and electronic devices. For two-dimensional materials, device performance is…

Detecting unknown objects in semantic segmentation is crucial for safety-critical applications such as autonomous driving. Large vision foundation models, including DINOv2, InternImage, and CLIP, have advanced visual representation learning…

Computer Vision and Pattern Recognition · Computer Science 2025-10-06 Laith Nayal , Hadi Salloum , Ahmad Taha , Yaroslav Kholodov , Alexander Gasnikov

We explore the transformative potential of SAM 2, a vision foundation model, in advancing gaze estimation and eye tracking technologies. By significantly reducing annotation time, lowering technical barriers through its ease of deployment,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Virmarie Maquiling , Sean Anthony Byrne , Diederick C. Niehorster , Marco Carminati , Enkelejda Kasneci

Identifying quantum flakes is crucial for scalable quantum hardware; however, automated layer classification from optical microscopy remains challenging due to substantial appearance shifts across different materials. This paper proposes a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Sankalp Pandey , Xuan Bac Nguyen , Nicholas Borys , Hugh Churchill , Khoa Luu

We introduce pix2gestalt, a framework for zero-shot amodal segmentation, which learns to estimate the shape and appearance of whole objects that are only partially visible behind occlusions. By capitalizing on large-scale diffusion models…

Computer Vision and Pattern Recognition · Computer Science 2024-01-26 Ege Ozguroglu , Ruoshi Liu , Dídac Surís , Dian Chen , Achal Dave , Pavel Tokmakov , Carl Vondrick

Achieving deterministic control over the properties of low-dimensional materials with nanoscale precision is a long-sought goal. Mastering this capability has a transformative impact on the design of multifunctional electrical and optical…