English
Related papers

Related papers: Crystal Twins: Self-supervised Learning for Crysta…

200 papers

Self-supervised learning (SSL) is a scalable way to learn general visual representations since it learns without labels. However, large-scale unlabeled datasets in the wild often have long-tailed label distributions, where we know little…

Machine Learning · Computer Science 2022-05-24 Hong Liu , Jeff Z. HaoChen , Adrien Gaidon , Tengyu Ma

Application of artificial intelligence (AI) has been ubiquitous in the growth of research in the areas of basic sciences. Frequent use of machine learning (ML) and deep learning (DL) based methodologies by researchers has resulted in…

Materials Science · Physics 2024-09-10 Shrimon Mukherjee , Madhusudan Ghosh , Partha Basuchowdhuri

In the field of Earth Observation (EO), Continual Learning (CL) algorithms have been proposed to deal with large datasets by decomposing them into several subsets and processing them incrementally. The majority of these algorithms assume…

Computer Vision and Pattern Recognition · Computer Science 2023-01-10 Valerio Marsocci , Simone Scardapane

Machine learning (ML) is becoming increasingly popular for predicting material properties to accelerate materials discovery. Because material properties are strongly affected by its crystal structure, a key issue is converting the crystal…

Materials Science · Physics 2023-10-12 Hirofumi Tsuruta , Yukari Katsura , Masaya Kumagai

Machine learning (ML) models have emerged as powerful tools for accelerating materials discovery and design by enabling accurate predictions of properties from compositional and structural data. These capabilities are vital for developing…

Although supervised learning has been highly successful in improving the state-of-the-art in the domain of image-based computer vision in the past, the margin of improvement has diminished significantly in recent years, indicating that a…

Computer Vision and Pattern Recognition · Computer Science 2023-05-24 Utku Ozbulak , Hyun Jung Lee , Beril Boga , Esla Timothy Anzaku , Homin Park , Arnout Van Messem , Wesley De Neve , Joris Vankerschaver

The premise of semi-supervised learning (SSL) is that combining labeled and unlabeled data yields significantly more accurate models. Despite empirical successes, the theoretical understanding of SSL is still far from complete. In this…

Machine Learning · Statistics 2024-09-06 Eyar Azar , Boaz Nadler

Accurate anomaly detection is critical in vision-based infrastructure inspection, where it helps prevent costly failures and enhances safety. Self-Supervised Learning (SSL) offers a promising approach by learning robust representations from…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Daniel Otero , Rafael Mateus , Randall Balestriero

We investigate the utility of in-domain self-supervised pre-training of vision models in the analysis of remote sensing imagery. Self-supervised learning (SSL) has emerged as a promising approach for remote sensing image classification due…

Computer Vision and Pattern Recognition · Computer Science 2024-02-06 Ivica Dimitrovski , Ivan Kitanovski , Nikola Simidjievski , Dragi Kocev

The search for new high-performance organic semiconducting molecules is challenging due to the vastness of the chemical space, machine learning methods, particularly deep learning models like graph neural networks (GNNs), have shown…

Chemical Physics · Physics 2021-12-06 Zaixi Zhang , Qi Liu , Shengyu Zhang , Chang-Yu Hsieh , Liang Shi , Chee-Kong Lee

Self-supervised learning (SSL) is an emerging technique that has been successfully employed to train convolutional neural networks (CNNs) and graph neural networks (GNNs) for more transferable, generalizable, and robust representation…

Computer Vision and Pattern Recognition · Computer Science 2022-09-13 Prarthana Bhattacharyya , Chengjie Huang , Krzysztof Czarnecki

The success of deep learning notoriously requires larger amounts of costly annotated data. This has led to the development of self-supervised learning (SSL) that aims to alleviate this limitation by creating domain specific pretext tasks on…

Machine Learning · Computer Science 2020-06-19 Wei Jin , Tyler Derr , Haochen Liu , Yiqi Wang , Suhang Wang , Zitao Liu , Jiliang Tang

Self-supervised learning (SSL) has recently advanced through non-contrastive methods that couple an invariance term with variance, covariance, or redundancy-reduction penalties. While such objectives shape first- and second-order statistics…

Machine Learning · Computer Science 2026-05-18 Benyamin Ghojogh , M. Hadi Sepanj , Paul Fieguth

Self-Supervised Learning (SSL) has been shown to learn useful and information-preserving representations. Neural Networks (NNs) are widely applied, yet their weight space is still not fully understood. Therefore, we propose to use SSL to…

Machine Learning · Computer Science 2022-12-15 Konstantin Schürholt , Dimche Kostadinov , Damian Borth

The scarcity of property labels remains a key challenge in materials informatics, whereas materials data without property labels are abundant in comparison. By pretraining supervised property prediction models on self-supervised tasks that…

Machine Learning · Computer Science 2024-07-02 Michael Moran , Vladimir V. Gusev , Michael W. Gaultois , Dmytro Antypov , Matthew J. Rosseinsky

Materials discovery, especially for applications that require extreme operating conditions, requires extensive testing that naturally limits the ability to inquire the wealth of possible compositions. Machine Learning (ML) has nowadays a…

Materials Science · Physics 2023-06-21 Dario Massa , Daniel Cieśliński , Amirhossein Naghdi , Stefanos Papanikolaou

Deep learning has made revolutionary advances to diverse applications in the presence of large-scale labeled datasets. However, it is prohibitively time-costly and labor-expensive to collect sufficient labeled data in most realistic…

Machine Learning · Computer Science 2021-07-22 Ximei Wang , Jinghan Gao , Mingsheng Long , Jianmin Wang

This study explores the application of self-supervised learning (SSL) for improved target recognition in synthetic aperture sonar (SAS) imagery. The unique challenges of underwater environments make traditional computer vision techniques,…

Computer Vision and Pattern Recognition · Computer Science 2023-07-31 BW Sheffield

Semi-supervised learning (SSL) is a popular setting aiming to effectively utilize unlabelled data to improve model performance in downstream natural language processing (NLP) tasks. Currently, there are two popular approaches to make use of…

Computation and Language · Computer Science 2023-05-23 Zhengxiang Shi , Francesco Tonolini , Nikolaos Aletras , Emine Yilmaz , Gabriella Kazai , Yunlong Jiao

Fine-grained image classification involves identifying different subcategories of a class which possess very subtle discriminatory features. Fine-grained datasets usually provide bounding box annotations along with class labels to aid the…

Computer Vision and Pattern Recognition · Computer Science 2021-07-30 Farha Al Breiki , Muhammad Ridzuan , Rushali Grandhe