English
Related papers

Related papers: Hessian Spectral Analysis at Foundation Model Scal…

200 papers

Neural networks (NNs) are central to modern machine learning and achieve state-of-the-art results in many applications. However, the relationship between loss geometry and generalization is still not well understood. The local geometry of…

Machine Learning · Computer Science 2026-04-15 Yuto Omae , Kazuki Sakai , Yohei Kakimoto , Makoto Sasaki , Yusuke Sakai , Hirotaka Takahashi

Feshbach resonances are commonly described by a single-resonance Feshbach model, and open-channel resonances are not taken into account explicitly. However, an open-channel resonance near threshold limits the range of validity of this…

Other Condensed Matter · Physics 2009-11-10 B. Marcelis , E. G. M. van Kempen , B. J. Verhaar , S. J. J. M. F. Kokkelmans

Understanding the evolution of the Milky Way calls for the precise abundance determination of many elements in many stars. A common perception is that deriving more than a few elemental abundances ([Fe/H], [$\alpha$/Fe], perhaps [C/H],…

Solar and Stellar Astrophysics · Physics 2017-07-05 Yuan-Sen Ting , Charlie Conroy , Hans-Walter Rix , Phillip Cargile

Recent advances in spectroscopic instrumentation and calibration methods dramatically improve the quality of quasar spectra. Supercomputer calculations show that, at high spectral resolution, procedures used in some previous analyses of…

Cosmology and Nongalactic Astrophysics · Physics 2022-03-15 John K. Webb , Chung-Chi Lee , Dinko Milaković

The General Spectral Modeling (GSM) code employs the quasi-static approximation, a standard, low-density methodology that assumes the ionization balance is separable from a determination of the excited-state populations that give rise to…

Atomic Physics · Physics 2008-11-26 Justin Oelgoetz , Christopher J. Fontes , Hong Lin Zhang , Anil K. Pradhan

Kernel spectral clustering corresponds to a weighted kernel principal component analysis problem in a constrained optimization framework. The primal formulation leads to an eigen-decomposition of a centered Laplacian matrix at the dual…

Social and Information Networks · Computer Science 2014-12-03 Raghvendra Mall , Rocco Langone , Johan A. K. Suykens

Spectroscopy has played the key role in revealing, and thereby understanding, the structure of atoms and molecules. A central drive in this field is the pursuit of higher precision and accuracy so that ever more subtle effects might be…

Novel view synthesis has recently been revolutionized by 3D Gaussian Splatting (3DGS), which enables real-time rendering through explicit primitive rasterization. However, existing methods tie visual fidelity strictly to the number of…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Mihnea-Bogdan Jurca , Bert Van hauwermeiren , Adrian Munteanu

As attention-based deep learning models scale in size and complexity, diagnosing their faults becomes increasingly challenging. In this work, we conduct an empirical study to evaluate the potential of Hessian-based analysis for diagnosing…

Machine Learning · Computer Science 2025-06-10 Sigma Jahan , Mohammad Masudur Rahman

Recently, it has been observed that when training a deep neural net with SGD, the majority of the loss landscape's curvature quickly concentrates in a tiny *top* eigenspace of the loss Hessian, which remains largely stable thereafter.…

Machine Learning · Computer Science 2025-04-22 Andres Fernandez , Frank Schneider , Maren Mahsereci , Philipp Hennig

Investigating the performance of different methods is a fundamental problem in graph partitioning. In this paper, we estimate the so-called detectability threshold for the spectral method with both unnormalized and normalized Laplacians in…

Social and Information Networks · Computer Science 2015-06-10 Tatsuro Kawamoto , Yoshiyuki Kabashima

Hybrid density functional (HDF) approximations usually deliver higher accuracy than local and semilocal approximations to the exchange-correlation functional, but this comes with drastically increased computational cost. Practical…

Materials Science · Physics 2022-10-12 Yuyang Ji , Peize Lin , Xinguo Ren , Lixin He

A systematic programme of calibration observations was carried out to monitor the performance of the SPIRE FTS instrument on board the Herschel Space Observatory. Observations of planets (including the prime point-source calibrator,…

Using the Fundamental-Measure Density Functional Theory, we have studied theoretically the phase behavior of extremely confined mixtures of parallel hard squares in slit geometry. The pore width is chosen such that configurations consisting…

Soft Condensed Matter · Physics 2020-01-09 Yuri Martinez-Raton , Enrique Velasco

Absorption-line systems detected in high resolution quasar spectra can be used to compare the value of dimensionless fundamental constants such as the fine-structure constant, alpha, and the proton-to-electron mass ratio, mu = m_p/m_e, as…

Spectral unmixing is an important and challenging problem in hyperspectral data processing. This topic has been extensively studied and a variety of unmixing algorithms have been proposed in the literature. However, the lack of publicly…

Computer Vision and Pattern Recognition · Computer Science 2019-02-25 Min Zhao , Jie Chen , Zhe He

We study linear spectral statistics of high dimensional sample covariance matrices in a regime where the empirical spectral distribution remains governed by the classical sample covariance law but the fluctuation theory is nonclassical. Our…

Statistics Theory · Mathematics 2026-05-13 Yanqing Yin , Wang Zhou

Mining large-scale high-throughput tandem mass spectrometry data sets is a very important problem in mass spectrometry based protein identification. One of the fundamental problems in large scale mining of spectra is to design appropriate…

Quantitative Methods · Quantitative Biology 2007-05-23 Debojyoti Dutta , Ting Chen

Classical approximation bases such as Chebyshev polynomials provide principled and interpretable representations, but their multivariate tensor-product constructions scale exponentially with dimension and impose axis-aligned structure that…

Machine Learning · Computer Science 2026-04-07 Milo Coombs

Starting from the observation that one of the most successful methods for solving the Kohn-Sham equations for periodic systems -- the plane-wave method -- is a spectral method based on eigenfunction expansion, we formulate a spectral method…

Computational Physics · Physics 2016-03-08 Amartya S. Banerjee , Ryan S. Elliott , Richard D. James