English
Related papers

Related papers: Collective Kernel EFT for Pre-activation ResNets

200 papers

We derive the general counting rules for a quantum effective field theory (EFT) in $\mathsf{d}$ dimensions. The rules are valid for strongly and weakly coupled theories, and predict that all kinetic energy terms are canonically normalized.…

High Energy Physics - Phenomenology · Physics 2016-09-12 M. B. Gavela , E. E. Jenkins , A. V. Manohar , L. Merlo

We present DFT-FE 1.0, building on DFT-FE 0.6 [Comput. Phys. Commun. 246, 106853 (2020)], to conduct fast and accurate large-scale density functional theory (DFT) calculations (reaching ~ $100,000$ electrons) on both many-core CPU and…

Computational Physics · Physics 2022-08-31 Sambit Das , Phani Motamarri , Vishal Subramanian , David M. Rogers , Vikram Gavini

With the prevalence of pre-training-fine-tuning paradigm, how to efficiently adapt the pre-trained model to the downstream tasks has been an intriguing issue. Parameter-Efficient Fine-Tuning (PEFT) methods have been proposed for low-cost…

Machine Learning · Computer Science 2024-06-11 Weixi Song , Zuchao Li , Lefei Zhang , Hai Zhao , Bo Du

Graph neural networks (GNNs) have demonstrated great success in representation learning for graph-structured data. The layer-wise graph convolution in GNNs is shown to be powerful at capturing graph topology. During this process, GNNs are…

Machine Learning · Computer Science 2021-12-10 Mingxuan Ju , Shifu Hou , Yujie Fan , Jianan Zhao , Liang Zhao , Yanfang Ye

Knowledge Graph Embedding (KGE) techniques are crucial in learning compact representations of entities and relations within a knowledge graph, facilitating efficient reasoning and knowledge discovery. While existing methods typically focus…

Computation and Language · Computer Science 2024-10-29 Pengcheng Jiang , Lang Cao , Cao Xiao , Parminder Bhatia , Jimeng Sun , Jiawei Han

Bayesian procedures designed to quantify truncation errors in perturbative calculations of quantum chromodynamics observables are adapted to expansions in effective field theory (EFT). In the Bayesian approach, such truncation errors are…

Nuclear Theory · Physics 2016-05-12 R. J. Furnstahl , N. Klco , D. R. Phillips , S. Wesolowski

Historically, applications of RFT in fMRI have relied on assumptions of smoothness, stationarity and Gaussianity. The first two assumptions have been addressed in Part 1 of this article series. Here we address the severe non-Gaussianity of…

Applications · Statistics 2023-12-19 Samuel Davenport , Armin Schwartzman , Thomas E. Nichols , Fabian J. E. Telschow

We present an accurate local density-functional for electronic-structure calculations within the density functional theory (DFT). The functional is derived by analyzing the structure of the standard perturbative expansion of the correlation…

Materials Science · Physics 2024-11-28 Mario Benites , Angel Rosado , Efstratios Manousakis

In this note we extend kernel function approximation results for neural networks with Gaussian-distributed weights to single-layer networks initialized using Haar-distributed random orthogonal matrices (with possible rescaling). This is…

Machine Learning · Computer Science 2021-04-14 James Martens

We analyze the methodology and the performance of subsystem density functional theory (DFT) with meta-generalized gradient approximation (meta-GGA) exchange-correlation functionals for non-bonded systems. Meta-GGA functionals depend on the…

Other Condensed Matter · Physics 2015-05-05 S. Śmiga , E. Fabiano , S. Laricchia , L. A. Constantin , F. Della Sala

We present in detail an Effective Field Theory (EFT) formulation for the essential case of spinning objects as the components of inspiralling compact binaries. We review its implementation, carried out in a series of works in recent years,…

General Relativity and Quantum Cosmology · Physics 2018-09-27 Michele Levi

We prove that conditional diffusion models whose reverse kernels are finite Gaussian mixtures with ReLU-network logits can approximate suitably regular target distributions arbitrarily well in context-averaged conditional KL divergence, up…

Machine Learning · Computer Science 2026-04-16 Nafiz Ishtiaque , Syed Arefinul Haque , Kazi Ashraful Alam , Fatima Jahara

We study the convergence of gradient descent (GD) and stochastic gradient descent (SGD) for training $L$-hidden-layer linear residual networks (ResNets). We prove that for training deep residual networks with certain linear transformations…

Machine Learning · Computer Science 2020-03-03 Difan Zou , Philip M. Long , Quanquan Gu

State-of-the-art federated learning methods can perform far worse than their centralized counterparts when clients have dissimilar data distributions. For neural networks, even when centralized SGD easily finds a solution that is…

Machine Learning · Computer Science 2022-10-06 Yaodong Yu , Alexander Wei , Sai Praneeth Karimireddy , Yi Ma , Michael I. Jordan

We develop an effective field theory for the description of high energetic or hard photons, the on-shell effective theory (OSEFT). The OSEFT describes the so called eikonal or semi-classical optical limit, allowing for corrections organized…

High Energy Physics - Phenomenology · Physics 2024-07-26 Marc Comadran , Cristina Manuel

Entity alignment aims to use pre-aligned seed pairs to find other equivalent entities from different knowledge graphs (KGs) and is widely used in graph fusion-related fields. However, as the scale of KGs increases, manually annotating…

Computation and Language · Computer Science 2025-03-28 Tao Meng , Shuo Shan , Hongen Shao , Yuntao Shou , Wei Ai , Keqin Li

Gradient-domain machine learning (GDML) is an accurate and efficient approach to learn a molecular potential and associated force field based on the kernel ridge regression algorithm. Here, we demonstrate its application to learn an…

Computational Physics · Physics 2020-06-24 Jiang Wang , Stefan Chmiela , Klaus-Robert Müller , Frank Noè , Cecilia Clementi

We analyze feature learning in infinite-width neural networks trained with gradient flow through a self-consistent dynamical field theory. We construct a collection of deterministic dynamical order parameters which are inner-product kernels…

Machine Learning · Statistics 2022-10-05 Blake Bordelon , Cengiz Pehlevan

We explore the double copy of effective field theories (EFTs), in the recently proposed generalized color-kinematics and Kawai-Lewellen-Tye (KLT) approaches. In the former, we systematically construct scalar numerators satisfying the Jacobi…

High Energy Physics - Theory · Physics 2022-05-17 Quentin Bonnefoy , Gauthier Durieux , Christophe Grojean , Camila S. Machado , Jasper Roosmale Nepveu

We extract the leading effective range corrections to the equation of state of the unitary Fermi gas from ab initio fixed-node quantum Monte Carlo (FNQMC) calculations in a periodic box using a density functional theory (DFT), and show them…

Quantum Gases · Physics 2012-11-16 Michael McNeil Forbes , Stefano Gandolfi , Alexandros Gezerlis