English
Related papers

Related papers: A computational phase transition for learning-to-s…

200 papers

Contemporary work implies generative machine learning models are capable of learning the phase behavior in condensed matter systems such as the Ising model. In this Letter, we utilize a score-based modeling procedure called Thermodynamic…

Statistical Mechanics · Physics 2024-10-29 Eric R. Beyerle , Pratyush Tiwary

There have been two separate lines of work on estimating Ising models: (1) estimating them from multiple independent samples under minimal assumptions about the model's interaction matrix; and (2) estimating them from one sample in…

Statistics Theory · Mathematics 2020-12-11 Yuval Dagan , Constantinos Daskalakis , Nishanth Dikkala , Anthimos Vardis Kandiros

Machine learning for phase transition has received intensive research interest in recent years. However, its application in percolation still remains challenging. We propose an auxiliary Ising mapping method for machine learning study of…

Statistical Mechanics · Physics 2022-03-08 Junyin Zhang , Bo Zhang , Junyi Xu , Wanzhou Zhang , Youjin Deng

In scientific machine learning, models are routinely deployed with parameter values or boundary conditions far from those used in training. This paper studies the learning-where-to-learn problem of designing a training data distribution…

Machine Learning · Computer Science 2025-12-09 Nicolas Guerra , Nicholas H. Nelsen , Yunan Yang

Models of physics beyond the Standard Model often contain a large number of parameters. These form a high-dimensional space that is computationally intractable to fully explore. Experimental constraints project onto a subspace of viable…

High Energy Physics - Theory · Physics 2022-01-05 Jacob Hollingsworth , Michael Ratz , Philip Tanedo , Daniel Whiteson

Optimized sensing is important for computational imaging in low-resource environments, when images must be recovered from severely limited measurements. In this paper, we propose a physics-constrained, fully differentiable, autoencoder that…

Image and Video Processing · Electrical Eng. & Systems 2020-03-24 He Sun , Adrian V. Dalca , Katherine L. Bouman

In this article, we explore the potential of artificial neural networks, which are trained using an exceptionally simplified catalog of ideal configurations encompassing both order and disorder. We explore the generalisation power of these…

Disordered Systems and Neural Networks · Physics 2024-06-19 G. L. Garcia Pavioni , M. Arlego , C. A. Lamas

We examine the problem of learning mappings from state to state, suitable for use in a model-based reinforcement-learning setting, that simultaneously generalize to novel states and can capture stochastic transitions. We show that currently…

Machine Learning · Computer Science 2017-10-27 Yuhang Song , Christopher Grimm , Xianming Wang , Michael L. Littman

We explore a data-driven approach for learning to optimize neural networks. We construct a dataset of neural network checkpoints and train a generative model on the parameters. In particular, our model is a conditional diffusion transformer…

Machine Learning · Computer Science 2022-09-27 William Peebles , Ilija Radosavovic , Tim Brooks , Alexei A. Efros , Jitendra Malik

Meta-learning algorithms for active learning are emerging as a promising paradigm for learning the ``best'' active learning strategy. However, current learning-based active learning approaches still require sufficient training data so as to…

Machine Learning · Computer Science 2019-09-10 Jingyu Shao , Qing Wang , Fangbing Liu

Simulation is a useful tool in situations where training data for machine learning models is costly to annotate or even hard to acquire. In this work, we propose a reinforcement learning-based method for automatically adjusting the…

Machine Learning · Computer Science 2019-05-15 Nataniel Ruiz , Samuel Schulter , Manmohan Chandraker

We study the problem of learning the structure and parameters of the Ising model, a fundamental model of high-dimensional data, when observing the evolution of an associated Markov chain. A recent line of work has studied the natural…

Machine Learning · Computer Science 2025-07-22 Jason Gaitonde , Ankur Moitra , Elchanan Mossel

In this paper we present an end-to-end meta-learned system for image compression. Traditional machine learning based approaches to image compression train one or more neural network for generalization performance. However, at inference…

Image and Video Processing · Electrical Eng. & Systems 2021-05-04 Nannan Zou , Honglei Zhang , Francesco Cricri , Hamed R. Tavakoli , Jani Lainema , Miska Hannuksela , Emre Aksu , Esa Rahtu

We propose a novel end-to-end neural network architecture that, once trained, directly outputs a probabilistic clustering of a batch of input examples in one pass. It estimates a distribution over the number of clusters $k$, and for each $1…

Machine Learning · Computer Science 2018-07-12 Benjamin Bruno Meier , Ismail Elezi , Mohammadreza Amirian , Oliver Durr , Thilo Stadelmann

The Hopfield model is a paradigmatic model of neural networks that has been analyzed for many decades in the statistical physics, neuroscience, and machine learning communities. Inspired by the manifold hypothesis in machine learning, we…

Disordered Systems and Neural Networks · Physics 2023-05-01 Matteo Negri , Clarissa Lauditi , Gabriele Perugini , Carlo Lucibello , Enrico Malatesta

Meta-learning, or learning-to-learn, seeks to design algorithms that can utilize previous experience to rapidly learn new skills or adapt to new environments. Representation learning -- a key tool for performing meta-learning -- learns a…

Machine Learning · Computer Science 2022-01-04 Nilesh Tripuraneni , Chi Jin , Michael I. Jordan

After learning a concept, humans are also able to continually generalize their learned concepts to new domains by observing only a few labeled instances without any interference with the past learned knowledge. In contrast, learning…

Machine Learning · Computer Science 2019-09-10 Mohammad Rostami , Soheil Kolouri , James McClelland , Praveen Pilly

We present a new "learning-to-learn"-type approach that enables rapid learning of concepts from small-to-medium sized training sets and is primarily designed for web-initialized image retrieval. At the core of our approach is a deep…

Computer Vision and Pattern Recognition · Computer Science 2017-10-30 A. Vakhitov , A. Kuzmin , V. Lempitsky

In many real-world scenarios, data to train machine learning models becomes available over time. Unfortunately, these models struggle to continually learn new concepts without forgetting what has been learnt in the past. This phenomenon is…

Computation and Language · Computer Science 2023-01-16 Beyza Ermis , Giovanni Zappella , Martin Wistuba , Aditya Rawal , Cedric Archambeau

Given a quantum circuit, a quantum computer can sample the output distribution exponentially faster in the number of bits than classical computers. A similar exponential separation has yet to be established in generative models through…