English
Related papers

Related papers: Unsupervised learning of phase transitions: from p…

200 papers

Autoencoders have long been considered a nonlinear extension of Principal Component Analysis (PCA). Prior studies have demonstrated that linear autoencoders (LAEs) can recover the ordered, axis-aligned principal components of PCA by…

Machine Learning · Computer Science 2026-01-28 Qipeng Zhan , Zhuoping Zhou , Zexuan Wang , Li Shen

We introduce and analyze a method of learning-informed parameter identification for partial differential equations (PDEs) in an all-at-once framework. The underlying PDE model is formulated in a rather general setting with three unknowns:…

Optimization and Control · Mathematics 2023-08-25 Christian Aarset , Martin Holler , Tram Thi Ngoc Nguyen

We explore unsupervised representation learning of radio communication signals in raw sampled time series representation. We demonstrate that we can learn modulation basis functions using convolutional autoencoders and visually recognize…

Machine Learning · Computer Science 2016-04-26 Timothy J. O'Shea , Johnathan Corgan , T. Charles Clancy

We propose a method for learning dynamical systems from high-dimensional empirical data that combines variational autoencoders and (spatio-)temporal attention within a framework designed to enforce certain scientifically-motivated…

Machine Learning · Computer Science 2023-06-22 Kai Lagemann , Christian Lagemann , Sach Mukherjee

We study a novel large dimensional approximate factor model with regime changes in the loadings driven by a latent first order Markov process. By exploiting the equivalent linear representation of the model, we first recover the latent…

Econometrics · Economics 2024-12-04 Matteo Barigozzi , Daniele Massacci

Established methods for unsupervised representation learning such as variational autoencoders produce none or poorly calibrated uncertainty estimates making it difficult to evaluate if learned representations are stable and reliable. In…

Machine Learning · Computer Science 2022-08-24 Marco Miani , Frederik Warburg , Pablo Moreno-Muñoz , Nicke Skafte Detlefsen , Søren Hauberg

We develop a self-supervised ensemble learning (SSEL) method to accurately classify distinct types of phase transitions by analyzing the fluctuation properties of machine learning outputs. Employing the 2D Potts model and the 2D Clock model…

Statistical Mechanics · Physics 2023-10-27 Chi-Ting Ho , Daw-Wei Wang

Hierarchical learning models, such as mixture models and Bayesian networks, are widely employed for unsupervised learning tasks, such as clustering analysis. They consist of observable and hidden variables, which represent the given data…

Machine Learning · Statistics 2018-01-08 Keisuke Yamazaki

A key element in transfer learning is representation learning; if representations can be developed that expose the relevant factors underlying the data, then new tasks and domains can be learned readily based on mappings of these salient…

Machine Learning · Computer Science 2014-12-18 Yujia Li , Kevin Swersky , Richard Zemel

Multimodal Language Analysis is a demanding area of research, since it is associated with two requirements: combining different modalities and capturing temporal information. During the last years, several works have been proposed in the…

Computation and Language · Computer Science 2022-01-10 Panagiotis Koromilas , Theodoros Giannakopoulos

Quantum convolutional neural networks (QCNNs) have been introduced as classifiers for gapped quantum phases of matter. Here, we propose a model-independent protocol for training QCNNs to discover order parameters that are unchanged under…

Quantum Physics · Physics 2023-06-05 Yu-Jie Liu , Adam Smith , Michael Knap , Frank Pollmann

The computational complexity of calculating phase diagrams for multi-parameter models significantly limits the ability to select parameters that correspond to experimental data. This work presents a machine learning method for solving the…

Computational Physics · Physics 2026-05-01 V. A. Ulitko , D. N. Yasinskaya , S. A. Bezzubin , A. A. Koshelev , Y. D. Panov

Anomalies are samples that significantly deviate from the rest of the data and their detection plays a major role in building machine learning models that can be reliably used in applications such as data-driven design and novelty…

Machine Learning · Statistics 2023-06-19 Amin Yousefpour , Mehdi Shishehbor , Zahra Zanjani Foumani , Ramin Bostanabad

Traditional methods for determining critical parameters are often influenced by human factors. This research introduces a physics-inspired adaptive reinforcement learning framework that enables agents to autonomously interact with physical…

Statistical Mechanics · Physics 2026-01-12 Hai Man , Chaobo Wang , Jia-Rui Li , Yuping Tian , Shu-Gang Chen

We propose the use of Monte Carlo histogram reweighting to extrapolate predictions of machine learning methods. In our approach, we treat the output from a convolutional neural network as an observable in a statistical system, enabling its…

Statistical Mechanics · Physics 2020-11-25 Dimitrios Bachtis , Gert Aarts , Biagio Lucini

Models that employ latent variables to capture structure in observed data lie at the heart of many current unsupervised learning algorithms, but exact maximum-likelihood learning for powerful and flexible latent-variable models is almost…

Machine Learning · Statistics 2020-08-18 Li K. Wenliang , Theodore Moskovitz , Heishiro Kanagawa , Maneesh Sahani

Modelling multivariate spatio-temporal data with complex dependency structures is a challenging task but can be simplified by assuming that the original variables are generated from independent latent components. If these components are…

Methodology · Statistics 2024-11-04 Mika Sipilä , Claudia Cappello , Sandra De Iaco , Klaus Nordhausen , Sara Taskinen

We propose to learn model invariances as a means of interpreting a model. This is motivated by a reverse engineering principle. If we understand a problem, we may introduce inductive biases in our model in the form of invariances.…

Machine Learning · Computer Science 2020-07-16 An-phi Nguyen , María Rodríguez Martínez

We propose a recurrent neural network for a "model-free" simulation of a dynamical system with unknown parameters without prior knowledge. The deep learning model aims to jointly learn the nonlinear time marching operator and the effects of…

Machine Learning · Computer Science 2021-03-01 Kyongmin Yeo , Dylan E. C. Grullon , Fan-Keng Sun , Duane S. Boning , Jayant R. Kalagnanam

Accurately determining the underlying physical parameters of individual elements in integrated photonics is increasingly difficult as device architectures become more complex. Inferring these parameters directly from spectral measurements…