English
Related papers

Related papers: Exploring the robust extrapolation of high-dimensi…

200 papers

Reproducibility of a deep-learning fully convolutional neural network is evaluated by training several times the same network on identical conditions (database, hyperparameters, hardware) with non-deterministic Graphics Processings Unit…

Machine Learning · Computer Science 2021-06-01 Wagner Gonçalves Pinto , Antonio Alguacil , Michaël Bauerheim

The input of almost every machine learning algorithm targeting the properties of matter at the atomic scale involves a transformation of the list of Cartesian atomic coordinates into a more symmetric representation. Many of the most popular…

Machine Learning · Statistics 2022-01-11 Alexander Goscinski , Félix Musil , Sergey Pozdnyakov , Michele Ceriotti

The prediction of nuclear observables beyond the finite model spaces that are accessible through modern ab initio methods, such as the no-core shell model, pose a challenging task in nuclear structure theory. It requires reliable tools for…

Nuclear Theory · Physics 2023-03-15 Marco Knöll , Tobias Wolfgruber , Marc L. Agel , Cedric Wenz , Robert Roth

A well-known drawback of state-of-the-art machine-learning interatomic potentials is their poor ability to extrapolate beyond the training domain. For small-scale problems with tens to hundreds of atoms this can be solved by using active…

Computational Physics · Physics 2020-09-22 Max Hodapp , Alexander Shapeev

Many approaches in the field of machine learning and data analysis rely on the assumption that the observed data lies on lower-dimensional manifolds. This assumption has been verified empirically for many real data sets. To make use of this…

Machine Learning · Computer Science 2022-09-27 Erik Thordsen , Erich Schubert

We introduce a novel class of sample-based explanations we term high-dimensional representers, that can be used to explain the predictions of a regularized high-dimensional model in terms of importance weights for each of the training…

Machine Learning · Computer Science 2023-07-04 Che-Ping Tsai , Jiong Zhang , Eli Chien , Hsiang-Fu Yu , Cho-Jui Hsieh , Pradeep Ravikumar

One of the fundamental problems in machine learning is the estimation of a probability distribution from data. Many techniques have been proposed to study the structure of data, most often building around the assumption that observations…

Machine Learning · Statistics 2013-02-22 Oren Rippel , Ryan Prescott Adams

Embedding of large but redundant data, such as images or text, in a hierarchy of lower-dimensional spaces is one of the key features of representation learning approaches, which nowadays provide state-of-the-art solutions to problems once…

Computer Vision and Pattern Recognition · Computer Science 2022-06-13 Gianluca Berardi , Luca De Luigi , Samuele Salti , Luigi Di Stefano

Machine learning of scalar molecular properties such as potential energy has enabled widespread applications. However, there are relatively few machine learning models targeting directional properties, including permanent and transition…

Chemical Physics · Physics 2021-11-10 Yaolong Zhang , Jun Jiang , Bin Jiang

Machine learning models have been progressively used for predicting materials properties. These models can be built using pre-existing data and are useful for rapidly screening the physicochemical space of a material, which is…

Soft Condensed Matter · Physics 2024-09-17 Israrul H. Hashmi , Himanshu , Rahul Karmakar , Tarak K Patra

This thesis reviews numerical optimization methods with machine learning problems in mind. Since machine learning models are highly parametrized, we focus on methods suited for high dimensional optimization. We build intuition on quadratic…

Optimization and Control · Mathematics 2022-01-03 Felix Benning

Analyzing large volumes of high-dimensional data requires dimensionality reduction: finding meaningful low-dimensional structures hidden in their high-dimensional observations. Such practice is needed in atomistic simulations of complex…

Computational Physics · Physics 2023-10-17 Jakub Rydzewski , Ming Chen , Omar Valsson

We present the viewpoint that optimization problems encountered in machine learning can often be interpreted as minimizing a convex functional over a function space, but with a non-convex constraint set introduced by model parameterization.…

Machine Learning · Computer Science 2020-04-21 Yongqiang Cai , Qianxiao Li , Zuowei Shen

Deep learning models frequently make incorrect predictions with high confidence when presented with test examples that are not well represented in their training dataset. We propose a novel and straightforward approach to estimate…

Machine Learning · Computer Science 2019-10-04 Tiago Ramalho , Miguel Miranda

Predictive learning has emerged as a central paradigm for training models across diverse data domains and is increasingly viewed as a foundation for modern artificial intelligence. A common intuition for this success is that accurate…

Machine Learning · Computer Science 2026-05-06 Aviv Ratzon , Omri Barak

Machine learning methods and uncertainty quantification have been gaining interest throughout the last several years in low-energy nuclear physics. In particular, Gaussian processes and Bayesian Neural Networks have increasingly been…

Nuclear Theory · Physics 2022-07-27 A. E. Lovell , A. T. Mohan , T. M. Sprouse , M. R. Mumpower

Intuitively, one would expect accuracy of a trained neural network's prediction on test samples to correlate with how densely the samples are surrounded by seen training samples in representation space. We find that a bound on empirical…

Machine Learning · Computer Science 2022-07-29 Xu Ji , Razvan Pascanu , Devon Hjelm , Balaji Lakshminarayanan , Andrea Vedaldi

Machine Learning is a powerful tool to reveal and exploit correlations in a multi-dimensional parameter space. Making predictions from such correlations is a highly non-trivial task, in particular when the details of the underlying dynamics…

High Energy Physics - Phenomenology · Physics 2019-01-30 Christoph Englert , Peter Galler , Philip Harris , Michael Spannowsky

Machine learning approaches to spatiotemporal physical systems have primarily focused on next-frame prediction, with the goal of learning an accurate emulator for the system's evolution in time. However, these emulators are computationally…

Machine Learning · Computer Science 2026-03-16 Helen Qu , Rudy Morel , Michael McCabe , Alberto Bietti , François Lanusse , Shirley Ho , Yann LeCun

Simulations at the atomic scale provide a direct and effective way to understand the mechanical properties of materials. In the regime of classical mechanics, simulations for the thermodynamic properties of metals and alloys can be done by…

Computational Physics · Physics 2019-11-05 Ka-Ming Tam , Nicholas Walker , Samuel Kellar , Mark Jarrell