English
Related papers

Related papers: Window-Dependent Bases for Efficient Representatio…

200 papers

Scaling sequence modeling to extreme contexts requires balancing computational efficiency with representational expressivity. While Transformers provide precise retrieval via the attention mechanism, their quadratic $\mathcal{O}(T^2)$…

Machine Learning · Computer Science 2026-01-06 Vladimer Khasia

We present a variational principle for the extraction of a time-dependent orthonormal basis from random realizations of transient systems. The optimality condition of the variational principle leads to a closed-form evolution equation for…

Numerical Analysis · Mathematics 2020-07-01 Hessam Babaee

This paper presents a fast algorithm for projecting a given function to the set of shift orthogonal functions (i.e. set containing functions with unit $L^2$ norm that are orthogonal to their prescribed shifts). The algorithm can be…

Numerical Analysis · Mathematics 2014-02-24 Farzin Barekat , Rongjie Lai , Ke Yin , Stanley Osher , Russel Caflisch , Vidvuds Ozolins

The starting point of this paper is that a spectral method is essentially a combination of an orthonormal basis of the underlying Hilbert space with Galerkin conditions. The choice of an orthonormal basis depends on a number of desirable…

Numerical Analysis · Mathematics 2026-03-13 Arieh Iserles , Marcus Webb

Four different applications of spectral proper orthogonal decomposition (SPOD): low-rank reconstruction, denoising, frequency-time analysis, and prewhitening are demonstrated on large-eddy simulation data of a turbulent jet. SPOD-based…

Fluid Dynamics · Physics 2021-09-22 Akhil Nekkanti , Oliver T. Schmidt

Phase retrieval from phaseless short-time Fourier transform (STFT) measurements is known to be inherently unstable when measurements are taken with respect to a single window. While an explicit inversion formula exists, it is useless in…

Functional Analysis · Mathematics 2025-06-19 Rima Alaifari , Yunan Yang

The breakdown of the Stokes-Einstein (SE) law in fragile glassformers is examined by Molecular-Dynamics simulations of atomic liquids and polymers and consideration of the experimental data concerning the archetypical OTP glassformer. All…

Soft Condensed Matter · Physics 2018-05-09 F. Puosi , A. Pasturel , N. Jakse , D. Leporini

The $\alpha$-modulation transform is a time-frequency transform generated by square-integrable representations of the affine Weyl-Heisenberg group modulo suitable subgroups. In this paper we prove new conditions that guarantee the…

Functional Analysis · Mathematics 2016-03-02 Michael Speckbacher , Dominik Bayer , Stephan Dahlke , Peter Balazs

Spectral proper orthogonal decomposition (SPOD) is an increasingly popular modal analysis method in the field of fluid dynamics due to its specific properties: a linear system forced with white noise should have SPOD modes identical to…

Fluid Dynamics · Physics 2024-02-20 Diego C. P. Blanco , Eduardo Martini , Kenzo Sasaki , André V. G. Cavalieri

We present a new algorithm for the 2D Sliding Window Discrete Fourier Transform (SWDFT). Our algorithm avoids repeating calculations in overlapping windows by storing them in a tree data-structure based on the ideas of the Cooley- Tukey…

Data Structures and Algorithms · Computer Science 2019-03-01 Lee F. Richardson , William F. Eddy

In this paper, we revisit the use of spectrograms in neural networks, by making the window length a continuous parameter optimizable by gradient descent instead of an empirically tuned integer-valued hyperparameter. The contribution is…

Machine Learning · Computer Science 2022-08-26 Maxime Leiber , Axel Barrau , Yosra Marnissi , Dany Abboud

Transfer and Koopman operator methods offer a framework for representing complex, nonlinear dynamical systems via linear transformations, enabling a deeper understanding of the underlying dynamics. The spectra of these operators provide…

Dynamical Systems · Mathematics 2026-03-25 Gary Froyland , Kevin Kühl

Given a set of Kohn-Sham orbitals from an insulating system, we present a simple, robust, efficient and highly parallelizable method to construct a set of, optionally orthogonal, localized basis functions for the associated subspace. Our…

Computational Physics · Physics 2014-11-05 Anil Damle , Lin Lin , Lexing Ying

Optoacoustic imaging technologies require fast and accurate signal pre-processing algorithms to enable widespread deployment in clinical and home-care settings. However, they still rely on the Discrete Fourier Transform (DFT) as the default…

The synchrosqueezing transform, a kind of reassignment method, aims to sharpen the time-frequency representation and to separate the components of a multicomponent non-stationary signal. In this paper, we consider the short-time Fourier…

Signal Processing · Electrical Eng. & Systems 2019-09-27 Lin Li , Haiyan Cai , Hongxia Han , Qingtang Jiang , Hongbing Ji

We consider the general class of time-homogeneous stochastic dynamical systems, both discrete and continuous, and study the problem of learning a representation of the state that faithfully captures its dynamics. This is instrumental to…

Machine Learning · Computer Science 2024-03-15 Vladimir R. Kostic , Pietro Novelli , Riccardo Grazzi , Karim Lounici , Massimiliano Pontil

We introduce directional regularity, a new definition of anisotropy for multivariate functional data. Instead of taking the conventional view, which determines anisotropy as a notion of smoothness along a dimension, directional regularity…

Methodology · Statistics 2026-05-05 Omar Kassi , Sunny G. W. Wang

The East process is a 1D kinetically constrained interacting particle system, introduced in the physics literature in the early 90's to model liquid-glass transitions. Spectral gap estimates of Aldous and Diaconis in 2002 imply that its…

Probability · Mathematics 2014-12-22 Shirshendu Ganguly , Eyal Lubetzky , Fabio Martinelli

A generalisation of Takens' delay-coordinate embedding theorem to stochastic systems, the Stochastic Embedding Sufficiency Theorem, is an inverse methodology enabling non-parametric recovery of both drift and diffusion fields from scalar…

Statistical Mechanics · Physics 2026-05-12 Carolina Garcia , Lucía Perea Durán , Agnese Venezia , Alex Conradie

The distance transform (DT) and its many variations are ubiquitous tools for image processing and analysis. In many imaging scenarios, the images of interest are corrupted by noise. This has a strong negative impact on the accuracy of the…

Computer Vision and Pattern Recognition · Computer Science 2020-09-14 Johan Öfverstedt , Joakim Lindblad , Nataša Sladoje