English
Related papers

Related papers: Renormalization Group-Motivated Learning

200 papers

Feed-forward neural networks can be understood as a combination of an intermediate representation and a linear hypothesis. While most previous works aim to diversify the representations, we explore the complementary direction by performing…

Machine Learning · Computer Science 2019-10-24 Han Zhao , Yao-Hung Hubert Tsai , Ruslan Salakhutdinov , Geoffrey J. Gordon

Renormalization group (RG) methods are emerging as tools in biology and computer science to support the search for simplifying structure in distributions over high-dimensional spaces. We show that mixture models can be thought of as having…

Statistical Mechanics · Physics 2024-02-09 Adam G. Kline , Stephanie E. Palmer

Coarse-graining (CG) accelerates molecular simulations of protein dynamics by simulating sets of atoms as singular beads. Backmapping is the opposite operation of bringing lost atomistic details back from the CG representation. While…

Machine Learning · Computer Science 2023-03-06 Soojung Yang , Rafael Gómez-Bombarelli

Efficient sampling of the Boltzmann distribution of molecular systems is a long-standing challenge. Recently, instead of generating long molecular dynamics simulations, generative machine learning methods such as normalizing flows have been…

Machine Learning · Computer Science 2024-08-06 Henrik Schopmans , Pascal Friederich

The goal in thinning is to summarize a dataset using a small set of representative points. Remarkably, sub-Gaussian thinning algorithms like Kernel Halving and Compress can match the quality of uniform subsampling while substantially…

Machine Learning · Statistics 2026-03-03 Annabelle Michael Carrell , Albert Gong , Abhishek Shetty , Raaz Dwivedi , Lester Mackey

We explore a systematic approach to studying the dynamics of evolving networks at a coarse-grained, system level. We emphasize the importance of finding good observables (network properties) in terms of which coarse grained models can be…

We propose to employ the hierarchical coarse-grained structure in the artificial neural networks explicitly to improve the interpretability without degrading performance. The idea has been applied in two situations. One is a neural network…

Machine Learning · Computer Science 2024-06-19 Xi-Ci Yang , Z. Y. Xie , Xiao-Tao Yang

We develop a machine-learning method for coarse-graining condensed-phase molecular systems using anisotropic particles. The method extends currently available high-dimensional neural network potentials by addressing molecular anisotropy. We…

Statistical Mechanics · Physics 2023-07-12 Marltan O. Wilson , David M. Huang

Incorporating prior information into inverse problems, e.g. via maximum-a-posteriori estimation, is an important technique for facilitating robust inverse problem solutions. In this paper, we devise two novel approaches for linear inverse…

Signal Processing · Electrical Eng. & Systems 2024-03-19 Carter Lyons , Raghu G. Raj , Margaret Cheney

We present a new method for learning Soft Random Geometric Graphs (SRGGs), drawn in probabilistic metric spaces, with the connection function of the graph defined as the marginal posterior probability of an edge random variable, given the…

Methodology · Statistics 2020-02-05 Kangrui Wang , Dalia Chakrabarty

In most practical applications such as recommendation systems, display advertising, and so forth, the collected data often contains missing values and those missing values are generally missing-not-at-random, which deteriorates the…

Machine Learning · Computer Science 2024-05-27 Mingming Ha , Xuewen Tao , Wenfang Lin , Qionxu Ma , Wujiang Xu , Linxun Chen

In geostatistics, traditional spatial models often rely on the Gaussian Process (GP) to fit stationary covariances to data. It is well known that this approach becomes computationally infeasible when dealing with large data volumes,…

Computation · Statistics 2024-09-17 Antony Sikorski , Daniel McKenzie , Douglas Nychka

The so-called renormalization group (RG) method is applied to derive kinetic and transport equations from the respective microscopic equations. The derived equations include Boltzmann equation in classical mechanics, Fokker-Planck equation,…

High Energy Physics - Theory · Physics 2009-11-07 Y. Hatta , T. Kunihiro

Statistical (machine learning) tools for equation discovery require large amounts of data that are typically computer generated rather than experimentally observed. Multiscale modeling and stochastic simulations are two areas where learning…

Machine Learning · Statistics 2021-03-17 Joseph Bakarji , Daniel M. Tartakovsky

We present a hybrid lattice Hamiltonian truncation method that integrates the numerical renormalization group (NRG) with a truncated lattice integrable spectrum. The technique is tailored for generic deformations of integrable lattice…

Strongly Correlated Electrons · Physics 2025-11-18 Xiaodong He , Xiao Wang , Jianda Wu

We develop a novel real-space renormalization group (RG) scheme which accurately estimates correlation length exponent $\nu$ near criticality of higher-dimensional quantum Ising and Potts models in a transverse field. Our method is…

Statistical Mechanics · Physics 2014-02-05 Aleksander Kubica , Beni Yoshida

In this paper we propose a novel method to study critical systems numerically by a combined collective-mode algorithm and Renormalization Group on the lattice. This method is an improved version of MCRG in the sense that it has all the…

Statistical Mechanics · Physics 2009-12-03 G. Palma , D. Zambrano

This paper tackles the problem of learning a finer representation than the one provided by training labels. This enables fine-grained category retrieval of images in a collection annotated with coarse labels only. Our network is learned…

Computer Vision and Pattern Recognition · Computer Science 2020-11-30 Hugo Touvron , Alexandre Sablayrolles , Matthijs Douze , Matthieu Cord , Hervé Jégou

Graphical Gaussian models are popular tools for the estimation of (undirected) gene association networks from microarray data. A key issue when the number of variables greatly exceeds the number of samples is the estimation of the matrix of…

Methodology · Statistics 2010-08-13 Nicole Kraemer , Juliane Schaefer , Anne-Laure Boulesteix

While the traditional formulation of machine learning tasks is in terms of performance on average, in practice we are often interested in how well a trained model performs on rare or difficult data points at test time. To achieve more…

Machine Learning · Computer Science 2025-12-29 Matthew J. Holland , Toma Hamada