English
Related papers

Related papers: Feature Selection for High-Dimensional Neural Netw…

200 papers

Existing adaptive bias techniques, which seek to estimate free energies and physical properties from molecular simulations, are limited by their reliance on fixed kernels or basis sets which hinder their ability to efficiently conform to…

Statistical Mechanics · Physics 2018-04-04 Hythem Sidky , Jonathan K. Whitmer

Sparse Neural Networks (SNNs) have emerged as powerful tools for efficient feature selection. Leveraging the dynamic sparse training (DST) algorithms within SNNs has demonstrated promising feature selection capabilities while drastically…

Data-driven, machine learning (ML) models of atomistic interactions are often based on flexible and non-physical functions that can relate nuanced aspects of atomic arrangements into predictions of energies and forces. As a result, these…

Materials Science · Physics 2024-05-15 Bartosz Barzdajn , Christopher P. Race

In modern computational materials science, deep learning has shown the capability to predict interatomic potentials, thereby supporting and accelerating conventional simulations. However, existing models typically sacrifice either accuracy…

Computational Engineering, Finance, and Science · Computer Science 2024-10-08 Ziduo Yang , Xian Wang , Yifan Li , Qiujie Lv , Calvin Yu-Chian Chen , Lei Shen

Machine learning (ML) tools such as encoder-decoder convolutional neural networks (CNN) can represent incredibly complex nonlinear functions which map between combinations of images and scalars. For example, CNNs can be used to map…

Machine Learning · Computer Science 2021-10-27 Alexander Scheinker

Accuracy of molecular dynamics simulations depends crucially on the interatomic potential used to generate forces. The gold standard would be first-principles quantum mechanics (QM) calculations, but these become prohibitively expensive at…

Neural additive models (NAMs) enhance the transparency of deep neural networks by handling input features in separate additive sub-networks. However, they lack inherent mechanisms that provide calibrated uncertainties and enable selection…

Machine Learning · Statistics 2024-10-29 Kouroche Bouchiat , Alexander Immer , Hugo Yèche , Gunnar Rätsch , Vincent Fortuin

Machine Learning (ML) potentials such as Gaussian Approximation Potential (GAP) have demonstrated impressive capabilities in mapping structure to properties across diverse systems. Here, we introduce a GAP model for low-dimensional Ni…

Materials Science · Physics 2024-11-01 Suvo Banik , Partha Sarathi Dutta , Sukriti Manna , Subramanian KRS Sankaranarayanan

Point defects play a central role in driving the properties of materials. First-principles methods are widely used to compute defect energetics and structures, including at scale for high-throughput defect databases. However, these methods…

Machine Learning · Computer Science 2025-09-30 Evan Dramko , Yihuang Xiong , Yizhi Zhu , Geoffroy Hautier , Thomas Reps , Christopher Jermaine , Anastasios Kyrillidis

Scene recognition, particularly for aerial and underwater images, often suffers from various types of degradation, such as blurring or overexposure. Previous works that focus on convolutional neural networks have been shown to be able to…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Jianqi Zhang , Mengxuan Wang , Jingyao Wang , Lingyu Si , Changwen Zheng , Fanjiang Xu

The performance of facial super-resolution methods relies on their ability to recover facial structures and salient features effectively. Even though the convolutional neural network and generative adversarial network-based methods deliver…

Computer Vision and Pattern Recognition · Computer Science 2021-11-23 Abhishek Srivastava , Sukalpa Chanda , Umapada Pal

Machine learning (ML) methods have gained increasing popularity in exploring and developing new materials. More specifically, graph neural network (GNN) has been applied in predicting material properties. In this work, we develop a novel…

Computational Physics · Physics 2020-08-18 Steph-Yves Louis , Yong Zhao , Alireza Nasiri , Xiran Wong , Yuqi Song , Fei Liu , Jianjun Hu

High-dimensional, low sample-size (HDLSS) data problems have been a topic of immense importance for the last couple of decades. There is a vast literature that proposed a wide variety of approaches to deal with this situation, among which…

Methodology · Statistics 2021-07-09 Kaixu Yang , Tapabrata Maiti

Shrinkage estimators that possess the ability to produce sparse solutions have become increasingly important to the analysis of today's complex datasets. Examples include the LASSO, the Elastic-Net and their adaptive counterparts.…

Methodology · Statistics 2017-02-09 Hongmei Liu , J. Sunil Rao

Face Attribute Recognition (FAR) plays a crucial role in applications such as person re-identification, face retrieval, and face editing. Conventional multi-task attribute recognition methods often process the entire feature map for feature…

Computer Vision and Pattern Recognition · Computer Science 2026-02-02 Gong Gao , Zekai Wang , Jian Zhao , Ziqi Xie , Xianhui Liu , Weidong Zhao

Feature selection removes redundant features to enhanc performance and computational efficiency in downstream tasks. Existing works often struggle to capture complex feature interactions and adapt to diverse scenarios. Recent advances in…

Machine Learning · Computer Science 2026-03-02 Rui Liu , Rui Xie , Zijun Yao , Yanjie Fu , Dongjie Wang

We consider a nonparametric additive model of a conditional mean function in which the number of variables and additive components may be larger than the sample size but the number of nonzero additive components is "small" relative to the…

Statistics Theory · Mathematics 2010-10-21 Jian Huang , Joel L. Horowitz , Fengrong Wei

Feature selection is a critical component in predictive analytics that significantly affects the prediction accuracy and interpretability of models. Intrinsic methods for feature selection are built directly into model learning, providing a…

Machine Learning · Computer Science 2024-03-19 Theodor Stoecker , Nico Hambauer , Patrick Zschech , Mathias Kraus

While molecular dynamics (MD) is a very useful computational method for atomistic simulations, modeling the interatomic interactions for reliable MD simulations of real materials has been a long-standing challenge. In 2007, Behler and…

Materials Science · Physics 2025-06-11 Ling Tang , Weiyi Xia , Gayatri Viswanathan , Ernesto Soto , Kirill Kovnir , Cai-Zhuang Wang

Accurate simulations of materials at long-time and large-length scales have increasingly been enabled by Machine-learned Interatomic Potentials (MLIPs). There have been increasing interest on improving the robustness of such models. To this…

Materials Science · Physics 2024-07-10 Ji Wei Yoon , Bangjian Zhou , J Senthilnath