English
Related papers

Related papers: Bridging Text and Crystal Structures: Literature-d…

200 papers

The use of machine learning methods for accelerating the design of crystalline materials usually requires manually constructed feature vectors or complex transformation of atom coordinates to input the crystal structure, which either…

Materials Science · Physics 2018-04-10 Tian Xie , Jeffrey C. Grossman

In this paper, we introduce a method for unifying language, action, and state information in a shared embedding space to facilitate a range of downstream tasks in robot learning. Our method, Contrastive Language, Action, and State…

Robotics · Computer Science 2023-04-24 Krishan Rana , Andrew Melnik , Niko Sünderhauf

Even though thermodynamic energy-based crystal structure prediction (CSP) has revolutionized materials discovery, the energy-driven CSP approaches often struggle to identify experimentally realizable metastable materials synthesized through…

Materials Science · Physics 2025-05-15 Yu Xin , Peng Liu , Zhuohang Xie , Wenhui Mi , Pengyue Gao , Hong Jian Zhao , Jian Lv , Yanchao Wang , Yanming Ma

High-pressure crystal structure prediction (CSP) underpins advances in condensed matter physics, planetary science, and materials discovery. Yet, most large atomistic models are trained on near-ambient, equilibrium data, leading to degraded…

Materials Science · Physics 2025-09-15 Yinan Wang , Xiaoyang Wang , Zhenyu Wang , Jing Wu , Jian Lv , Han Wang

Vision-Language Pretraining (VLP) has achieved remarkable success across various downstream tasks, but such gains are largely driven by scaling up on training data. Yet, literature methods treat image-text pairs as isolated training…

Computer Vision and Pattern Recognition · Computer Science 2025-11-06 Wenbo Lu

Contrastive learning allows us to flexibly define powerful losses by contrasting positive pairs from sets of negative samples. Recently, the principle has also been used to learn cross-modal embeddings for video and text, yet without…

Computer Vision and Pattern Recognition · Computer Science 2021-10-01 Mohammadreza Zolfaghari , Yi Zhu , Peter Gehler , Thomas Brox

Accessing the synthesizability of crystal structures is pivotal for advancing the practical application of theoretical material structures designed by machine learning or high-throughput screening. However, a significant gap exists between…

Materials Science · Physics 2024-07-10 Zhilong Song , Shuaihua Lu , Minggang Ju , Qionghua Zhou , Jinlan Wang

Computational methods that automatically extract knowledge from data are critical for enabling data-driven materials science. A reliable identification of lattice symmetry is a crucial first step for materials characterization and…

Materials Science · Physics 2018-07-19 A. Ziletti , D. Kumar , M. Scheffler , L. M. Ghiringhelli

The application of Contrastive Language-Image Pre-training (CLIP) in Weakly Supervised Semantic Segmentation (WSSS) research powerful cross-modal semantic understanding capabilities. Existing methods attempt to optimize input text prompts…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Zhongxing Xu , Feilong Tang , Zhe Chen , Yingxue Su , Zhiyi Zhao , Ge Zhang , Jionglong Su , Zongyuan Ge

Many applications require linking individuals, firms, or locations across datasets. Most widely used methods, especially in social science, do not employ deep learning, with record linkage commonly approached using string matching…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Abhishek Arora , Xinmei Yang , Shao-Yu Jheng , Melissa Dell

Crystal structure prediction (CSP) is now increasingly used in the discovery of novel materials with applications in diverse industries. However, despite decades of developments, the problem is far from being solved. With the progress of…

Materials Science · Physics 2023-07-13 Lai Wei , Qin Li , Sadman Sadeed Omee , Jianjun Hu

Contrastive Language-Image Pre-training (CLIP) has drawn increasing attention recently for its transferable visual representation learning. However, due to the semantic gap within datasets, CLIP's pre-trained image-text alignment becomes…

Computer Vision and Pattern Recognition · Computer Science 2023-08-11 Longtian Qiu , Renrui Zhang , Ziyu Guo , Ziyao Zeng , Zilu Guo , Yafeng Li , Guangnan Zhang

Contrastive Language-Image Pre-Training (CLIP) is a popular method for learning multimodal latent spaces with well-organized semantics. Despite its wide range of applications, CLIP's latent space is known to fail at handling complex…

Machine Learning · Computer Science 2026-03-17 Raphi Kang , Yue Song , Georgia Gkioxari , Pietro Perona

Accurate determination of crystal structures is central to materials science, underpinning the understanding of composition-structure-property relationships and the discovery of new materials. Powder X-ray diffraction is a key technique in…

Materials Science · Physics 2026-03-20 Chenlei Xu , Tianhao Su , Jie Xiong , Yue Wu , Shuya Dong , Tian Jiang , Mengwei He , Shuai Chen , Tong-Yi Zhang

Contrastive learning has emerged as a transformative method for learning effective visual representations through the alignment of image and text embeddings. However, pairwise similarity computation in contrastive loss between image and…

Computer Vision and Pattern Recognition · Computer Science 2024-04-25 Sachin Mehta , Maxwell Horton , Fartash Faghri , Mohammad Hossein Sekhavat , Mahyar Najibi , Mehrdad Farajtabar , Oncel Tuzel , Mohammad Rastegari

Creating a single unified interatomic potential capable of attaining ab initio accuracy across all chemistry remains a long-standing challenge in computational chemistry and materials science. This work introduces a training protocol for…

In long structured document retrieval, existing methods typically fine-tune pre-trained language models (PLMs) using contrastive learning on datasets lacking explicit structural information. This practice suffers from two critical issues:…

Information Retrieval · Computer Science 2025-09-03 Xinhao Huang , Zhibo Ren , Yipeng Yu , Ying Zhou , Zulong Chen , Zeyi Wen

Crystal structure prediction (CSP) stands as a powerful tool in materials science, driving the discovery and design of innovative materials. However, existing CSP methods heavily rely on formation enthalpies derived from density functional…

Materials Science · Physics 2025-07-16 Chenglong Qin , Jinde Liu , Shiyin Ma , Jiguang Du , Gang Jiang , Liang Zhao

Learning good image representations that are beneficial to downstream tasks is a challenging task in computer vision. As such, a wide variety of self-supervised learning approaches have been proposed. Among them, contrastive learning has…

Computer Vision and Pattern Recognition · Computer Science 2023-02-06 Yun Yue , Fangzhou Lin , Kazunori D Yamada , Ziming Zhang

Context-aware methods have achieved remarkable advancements in supervised scene text recognition by leveraging semantic priors from words. Considering the heterogeneity of text and background in STR, we propose that such contextual priors…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Tiancheng Lin , Jinglei Zhang , Yi Xu , Kai Chen , Rui Zhang , Chang-Wen Chen