English
Related papers

Related papers: Feature Selection for High-Dimensional Neural Netw…

200 papers

In recent years, significant progress has been made in the development of machine learning potentials (MLPs) for atomistic simulations with applications in many fields from chemistry to materials science. While most current MLPs are based…

Chemical Physics · Physics 2023-05-19 Tsz Wai Ko , Jonas A. Finkler , Stefan Goedecker , Jörg Behler

Generative Adversarial Networks (GANs) have achieved remarkable results in the task of generating realistic natural images. In most successful applications, GAN models share two common aspects: solving a challenging saddle point…

Machine Learning · Statistics 2019-05-21 Piotr Bojanowski , Armand Joulin , David Lopez-Paz , Arthur Szlam

We have designed a new method to fit the energy and atomic forces using a single artificial neural network (SANN) for any number of chemical species present in a molecular system. The traditional approach for fitting the potential energy…

Chemical Physics · Physics 2018-12-05 Shweta Jindal , Satya S. Bulusu

Effective features can improve the performance of a model, which can thus help us understand the characteristics and underlying structure of complex data. Previous feature selection methods usually cannot keep more local structure…

Machine Learning · Computer Science 2019-10-10 Xia Wu , Xueyuan Xu , Jianhong Liu , Hailing Wang , Bin Hu , Feiping Nie

Machine learning interatomic potentials (MLIPs) provide an effective approach for accurately and efficiently modeling atomic interactions, expanding the capabilities of atomistic simulations to complex systems. However, a priori feature…

Computational Physics · Physics 2026-04-22 Tina Torabi , Matthias Militzer , Michael P. Friedlander , Christoph Ortner

Geometric shape features have been widely used as strong predictors for image classification. Nevertheless, most existing classifiers such as deep neural networks (DNNs) directly leverage the statistical correlations between these shape…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Tonmoy Hossain , Jing Ma , Jundong Li , Miaomiao Zhang

Inexpensive machine learning potentials are increasingly being used to speed up structural optimization and molecular dynamics simulations of materials by iteratively predicting and applying interatomic forces. In these settings, it is…

Chemical Physics · Physics 2023-09-12 Jonas Busk , Mikkel N. Schmidt , Ole Winther , Tejs Vegge , Peter Bjørn Jørgensen

The goal of supervised feature selection is to find a subset of input features that are responsible for predicting output values. The least absolute shrinkage and selection operator (Lasso) allows computationally efficient feature selection…

Machine Learning · Statistics 2019-01-07 Makoto Yamada , Wittawat Jitkrittum , Leonid Sigal , Eric P. Xing , Masashi Sugiyama

Many approaches, which have been developed to express the potential energy of large systems, exploit the locality of the atomic interactions. A prominent example are fragmentation methods, in which quantum chemical calculations are carried…

Chemical Physics · Physics 2021-03-25 Michael Gastegger , Clemens Kauffmann , Jörg Behler , Philipp Marquetand

We consider the problem of model selection and estimation in situations where the number of parameters diverges with the sample size. When the dimension is high, an ideal method should have the oracle property [J. Amer. Statist. Assoc. 96…

Statistics Theory · Mathematics 2009-08-14 Hui Zou , Hao Helen Zhang

Optimising deep neural networks is a challenging task due to complex training dynamics, high computational requirements, and long training times. To address this difficulty, we propose the framework of Generalisable Agents for Neural…

Neural network interatomic potentials (NNPs) have recently proven to be powerful tools to accurately model complex molecular systems while bypassing the high numerical cost of ab-initio molecular dynamics simulations. In recent years,…

Chemical Physics · Physics 2024-07-29 Thomas Plé , Olivier Adjoua , Louis Lagardère , Jean-Philip Piquemal

Feature selection is crucial for pinpointing relevant features in high-dimensional datasets, mitigating the 'curse of dimensionality,' and enhancing machine learning performance. Traditional feature selection methods for classification use…

Machine Learning · Computer Science 2025-04-08 Rittwika Kansabanik , Adrian Barbu

In additive models with many nonparametric components, a number of regularized estimators have been proposed and proven to attain various error bounds under different combinations of sparsity and fixed smoothness conditions. Some of these…

Statistics Theory · Mathematics 2020-11-16 Yisha Yao , Cun-Hui Zhang

Attentional Neural Network is a new framework that integrates top-down cognitive bias and bottom-up feature extraction in one coherent architecture. The top-down influence is especially effective when dealing with high noise or difficult…

Computer Vision and Pattern Recognition · Computer Science 2014-11-20 Qian Wang , Jiaxing Zhang , Sen Song , Zheng Zhang

This paper presents the custom implementation, optimization, and performance evaluation of convolutional neural networks on field programmable gate arrays, for the purposes of accelerating deep neural network inference on large,…

Instrumentation and Detectors · Physics 2022-01-14 Yeon-Jae Jwa , Giuseppe Di Guglielmo , Luca P. Carloni , Georgia Karagiorgi

Accurate prediction of physical properties is critical for discovering and designing novel materials. Machine learning technologies have attracted significant attention in the materials science community for their potential for large-scale…

Materials Science · Physics 2021-11-24 Boyu Zhang , Mushen Zhou , Jianzhong Wu , Fuchang Gao

The length and time scales of atomistic simulations are limited by the computational cost of the methods used to predict material properties. In recent years there has been great progress in the use of machine learning algorithms to develop…

Computational Physics · Physics 2022-11-03 Alberto Hernandez , Adarsh Balasubramanian , Fenglin Yuan , Simon Mason , Tim Mueller

Machine learning techniques allow a direct mapping of atomic positions and nuclear charges to the potential energy surface with almost ab-initio accuracy and the computational efficiency of empirical potentials. In this work we propose a…

Computational Physics · Physics 2021-09-16 Viktor Zaverkin , Johannes Kästner

We propose a new active learning (AL) method for text classification with convolutional neural networks (CNNs). In AL, one selects the instances to be manually labeled with the aim of maximizing model performance with minimal effort. Neural…

Computation and Language · Computer Science 2016-12-02 Ye Zhang , Matthew Lease , Byron C. Wallace