English
Related papers

Related papers: Semi-supervised teacher-student deep neural networ…

200 papers

Our proposed deeply-supervised nets (DSN) method simultaneously minimizes classification error while making the learning process of hidden layers direct and transparent. We make an attempt to boost the classification performance by studying…

Machine Learning · Statistics 2017-04-26 Chen-Yu Lee , Saining Xie , Patrick Gallagher , Zhengyou Zhang , Zhuowen Tu

Material discovery is a cornerstone of modern science, driving advancements in diverse disciplines from biomedical technology to climate solutions. Predicting synthesizability, a critical factor in realizing novel materials, remains a…

Materials Science · Physics 2024-11-20 Sasan Amariamir , Janine George , Philipp Benner

Active learning has been increasingly applied to screening functional materials from existing materials databases with desired properties. However, the number of known materials deposited in the popular materials databases such as ICSD and…

Semi-supervised object detection (SSOD) aims to boost detection performance by leveraging extra unlabeled data. The teacher-student framework has been shown to be promising for SSOD, in which a teacher network generates pseudo-labels for…

Computer Vision and Pattern Recognition · Computer Science 2022-12-07 Honggyu Choi , Zhixiang Chen , Xuepeng Shi , Tae-Kyun Kim

Superconductivity has been the focus of enormous research effort since its discovery more than a century ago. Yet, some features of this unique phenomenon remain poorly understood; prime among these is the connection between…

In the semi-supervised learning field, Graph Convolution Network (GCN), as a variant model of GNN, has achieved promising results for non-Euclidean data by introducing convolution into GNN. However, GCN and its variant models fail to safely…

Machine Learning · Computer Science 2022-07-06 Zhi Yang , Yadong Yan , Haitao Gan , Jing Zhao , Zhiwei Ye

There has been a recent surge of interest in using machine learning to approximate density functional theory (DFT) in materials science. However, many of the most performant models are evaluated on large databases of computed properties of,…

Materials Science · Physics 2021-07-02 Filip Ekström , Rickard Armiento , Fredrik Lindsten

In this paper, we propose another version of help-training approach by employing a Probabilistic Neural Network (PNN) that improves the performance of the main discriminative classifier in the semi-supervised strategy. We introduce the…

Machine Learning · Computer Science 2015-09-07 Hamidreza Farhidzadeh

Supervised learning from training data with imbalanced class sizes, a commonly encountered scenario in real applications such as anomaly/fraud detection, has long been considered a significant challenge in machine learning. Motivated by…

Machine Learning · Computer Science 2019-05-27 Yunru Liu , Tingran Gao , Haizhao Yang

Deep neural networks demonstrated their ability to provide remarkable performances on a wide range of supervised learning tasks (e.g., image classification) when trained on extensive collections of labeled data (e.g., ImageNet). However,…

Machine Learning · Computer Science 2020-07-07 Yassine Ouali , Céline Hudelot , Myriam Tami

The search for new high-performance organic semiconducting molecules is challenging due to the vastness of the chemical space, machine learning methods, particularly deep learning models like graph neural networks (GNNs), have shown…

Chemical Physics · Physics 2021-12-06 Zaixi Zhang , Qi Liu , Shengyu Zhang , Chang-Yu Hsieh , Liang Shi , Chee-Kong Lee

Spiking neural networks (SNNs) have attracted considerable attention for their event-driven, low-power characteristics and high biological interpretability. Inspired by knowledge distillation (KD), recent research has improved the…

Machine Learning · Computer Science 2024-06-13 Lin Zuo , Yongqi Ding , Mengmeng Jing , Kunshan Yang , Yunqian Yu

Glass composition screening is essential for advancing new glass materials, yet the inherent complexity of multicomponent systems presents significant challenges. Current supervised learning methods for this task rely heavily on large…

Computational Engineering, Finance, and Science · Computer Science 2026-01-23 Meijing Chen , Bin Liu , Ying Liu , Tianrui Li

Standard deep neural networks (DNNs) are commonly trained in an end-to-end fashion for specific tasks such as object recognition, face identification, or character recognition, among many examples. This specificity often leads to…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Raphaël Achddou , J. Matias di Martino , Guillermo Sapiro

Deep learning usually requires large amounts of labeled training data, but annotating data is costly and tedious. The framework of semi-supervised learning provides the means to use both labeled data and arbitrary amounts of unlabeled data…

Computer Vision and Pattern Recognition · Computer Science 2019-04-19 Christoph Baur , Shadi Albarqouni , Nassir Navab

Exploration of new superconductors still relies on the experience and intuition of experts and is largely a process of experimental trial and error. In one study, only 3% of the candidate materials showed superconductivity. Here, we report…

Machine Learning · Computer Science 2021-01-20 Tomohiko Konno , Hodaka Kurokawa , Fuyuki Nabeshima , Yuki Sakishita , Ryo Ogawa , Iwao Hosako , Atsutaka Maeda

Machine learning (ML) based materials discovery has emerged as one of the most promising approaches for breakthroughs in materials science. While heuristic knowledge based descriptors have been combined with ML algorithms to achieve good…

Materials Science · Physics 2021-09-28 Sadman Sadeed Omee , Steph-Yves Louis , Nihang Fu , Lai Wei , Sourin Dey , Rongzhi Dong , Qinyang Li , Jianjun Hu

Deep convolutional neural networks have shown outstanding performance in medical image segmentation tasks. The usual problem when training supervised deep learning methods is the lack of labeled data which is time-consuming and costly to…

Computer Vision and Pattern Recognition · Computer Science 2021-03-04 Suman Sedai , Bhavna Antony , Ravneet Rai , Katie Jones , Hiroshi Ishikawa , Joel Schuman , Wollstein Gadi , Rahil Garnavi

In this work, we develop a joint sample discovery and iterative model evolution method for semi-supervised learning on very small labeled training sets. We propose a master-teacher-student model framework to provide multi-layer guidance…

Computer Vision and Pattern Recognition · Computer Science 2019-09-05 Yang Li , Jianhe Yuan , Zhiqun Zhao , Hao Sun , Zhihai He

Deep generative models trained with large amounts of unlabelled data have proven to be powerful within the domain of unsupervised learning. Many real life data sets contain a small amount of labelled data points, that are typically…

Machine Learning · Statistics 2017-04-04 Lars Maaløe , Marco Fraccaro , Ole Winther