English
Related papers

Related papers: Self-Supervised Ensemble Learning: A Universal Met…

200 papers

There exist a variety of star-galaxy classification techniques, each with their own strengths and weaknesses. In this paper, we present a novel meta-classification framework that combines and fully exploits different techniques to produce a…

Instrumentation and Methods for Astrophysics · Physics 2015-08-20 Edward J. Kim , Robert J. Brunner , Matias Carrasco Kind

Machine learning has been successfully used to study phase transitions. One of the most popular approaches to identifying critical points from data without prior knowledge of the underlying phases is the learning-by-confusion scheme. As…

Machine Learning · Computer Science 2023-11-16 Julian Arnold , Frank Schäfer , Niels Lörch

Time series classification is of significant importance in monitoring structural systems. In this work, we investigate the use of supervised machine learning classification algorithms on simulated data based on a physical system with two…

Machine Learning · Computer Science 2024-03-14 Ergys Çokaj , Halvor Snersrud Gustad , Andrea Leone , Per Thomas Moe , Lasse Moldestad

Sequential sensor data is generated in a wide variety of practical applications. A fundamental challenge involves learning effective classifiers for such sequential data. While deep learning has led to impressive performance gains in recent…

Machine Learning · Computer Science 2020-10-07 Nauman Ahad , Mark A. Davenport

In order to train robust deep learning models, large amounts of labelled data is required. However, in the absence of such large repositories of labelled data, unlabeled data can be exploited for the same. Semi-Supervised learning aims to…

Machine Learning · Computer Science 2021-07-20 Soumyadeep Ghosh , Sanjay Kumar , Janu Verma , Awanish Kumar

State-of-the-art frameworks in self-supervised learning have recently shown that fully utilizing transformer-based models can lead to performance boost compared to conventional CNN models. Striving to maximize the mutual information of two…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Jiho Jang , Seonhoon Kim , Kiyoon Yoo , Chaerin Kong , Jangho Kim , Nojun Kwak

Ensemble learning has had many successes in supervised learning, but it has been rare in unsupervised learning and dimensionality reduction. This study explores dimensionality reduction ensembles, using principal component analysis and…

Machine Learning · Statistics 2017-10-13 Colleen M. Farrelly

Experimental progress in qubit manufacturing calls for the development of new theoretical tools to analyze quantum data. We show how an unsupervised machine-learning technique can be used to understand short-range entangled many-qubit…

Quantum Physics · Physics 2023-03-22 Nicolas Sadoune , Giuliano Giudici , Ke Liu , Lode Pollet

Self-supervised learning, which learns by constructing artificial labels given only the input signals, has recently gained considerable attention for learning representations with unlabeled datasets, i.e., learning without any…

Machine Learning · Computer Science 2020-06-30 Hankook Lee , Sung Ju Hwang , Jinwoo Shin

In many modern machine learning applications, the outcome is expensive or time-consuming to collect while the predictor information is easy to obtain. Semi-supervised learning (SSL) aims at utilizing large amounts of `unlabeled' data along…

Methodology · Statistics 2017-11-16 Jessica Gronsbell , Tianxi Cai

Emotion recognition models using audio input data can enable the development of interactive systems with applications in mental healthcare, marketing, gaming, and social media analysis. While the field of affective computing using audio…

Sound · Computer Science 2023-07-25 Peranut Nimitsurachat , Peter Washington

In transfer learning, a source domain often carries diverse knowledge, and different domains usually emphasize different types of knowledge. Different from handling only a single type of knowledge from all domains in traditional transfer…

Machine Learning · Statistics 2025-09-22 Chunna Li , Yiwei Song , Yuanhai Shao

Three-dimensional random electron systems undergo quantum phase transitions and show rich phase diagrams. Examples of the phases are the band gap insulator, Anderson insulator, strong and weak topological insulators, Weyl semimetal, and…

Disordered Systems and Neural Networks · Physics 2017-03-16 Tomi Ohtsuki , Tomoki Ohtsuki

Deep learning has emerged as a technique of choice for rapid feature extraction across imaging disciplines, allowing rapid conversion of the data streams to spatial or spatiotemporal arrays of features of interest. However, applications of…

Data Analysis, Statistics and Probability · Physics 2021-01-25 Ayana Ghosh , Bobby G. Sumpter , Ondrej Dyck , Sergei V. Kalinin , Maxim Ziatdinov

Ensembling BERT models often significantly improves accuracy, but at the cost of significantly more computation and memory footprint. In this work, we propose Multi-CLS BERT, a novel ensembling method for CLS-based prediction tasks that is…

Computation and Language · Computer Science 2023-05-23 Haw-Shiuan Chang , Ruei-Yao Sun , Kathryn Ricci , Andrew McCallum

Although classifying topological quantum phases have attracted great interests, the absence of local order parameter generically makes it challenging to detect a topological phase transition from experimental data. Recent advances in…

Quantum Gases · Physics 2022-10-12 Entong Zhao , Ting Hin Mak , Chengdong He , Zejian Ren , Ka Kwan Pak , Yu-Jun Liu , Gyu-Boong Jo

Ensembling is a universally useful approach to boost the performance of machine learning models. However, individual models in an ensemble were traditionally trained independently in separate stages without information access about the…

Computer Vision and Pattern Recognition · Computer Science 2019-09-27 Hanhan Li , Joe Yue-Hei Ng , Paul Natsev

The numerical simulation of strongly first-order phase transitions has remained a notoriously difficult problem even for classical systems due to the exponentially suppressed (thermal) equilibration in the vicinity of such a transition. In…

Statistical Mechanics · Physics 2010-04-14 Bela Bauer , Emanuel Gull , Simon Trebst , Matthias Troyer , David A. Huse

Using Monte Carlo simulations in the frame of stochastic series expansion (SSE), we study the three-state quantum Potts model. The cluster algorithm we used is a direct generalization of that for the quantum Ising model. The simulations…

Statistical Mechanics · Physics 2017-02-10 Chengxiang Ding , Yangcheng Wang , Youjin Deng , Hui Shao

The percolation study offers valuable insights into the characteristics of phase transition, shedding light on the underlying mechanisms that govern the formation of global connectivity within the system. We explore the percolation phase…

Nuclear Theory · Physics 2025-04-02 Ranran Guo , Xiaobing Li , Rui Wang , Shiyang Chen , Yuanfang Wu , Zhiming Li