English
Related papers

Related papers: Tight and Efficient Upper Bound on Spectral Norm o…

200 papers

Convolutional neural networks (CNNs) are important in a wide variety of machine learning tasks and applications, so optimizing their performance is essential. Moving words of data between levels of a memory hierarchy or between processors…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-07-14 Anthony Chen , James Demmel , Grace Dinh , Mason Haberle , Olga Holtz

The random Fourier method (RFM) is widely employed for synthetic turbulence due to its mathematical clarity and simplicity. However, deviations remain between prescribed inputs and synthetic results, and the origin of these errors has not…

Fluid Dynamics · Physics 2025-10-16 Hongyuan Lin , Yi Liu , Shizhao Wang , Chun-Hian Lee

The research on spectral inequalities for discrete Schrodinger Operators has proved fruitful in the last decade. Indeed, several authors analysed the operator's canonical relation to a tridiagonal Jacobi matrix operator. In this paper, we…

Functional Analysis · Mathematics 2013-12-09 Arman Sahovic

We investigate the radiative decay of the cosmic neutrino background, and its impact on the spectrum of the cosmic microwave background (CMB) that is known to be a nearly perfect black body. We derive exact formulae for the decay of a…

In modern artificial intelligence, convolutional neural networks (CNNs) have become a cornerstone for visual and perceptual tasks. However, their implementation on conventional electronic hardware faces fundamental bottlenecks in speed and…

In this note, we propose a framework for proving computational lower bounds in norm approximation by leveraging a reverse detection--estimation gap. The starting point is a testing problem together with an estimator whose error is…

Statistics Theory · Mathematics 2026-04-07 Runshi Tang , Yuefeng Han , Anru R. Zhang

Efficiently executing convolutional neural nets (CNNs) is important in many machine-learning tasks. Since the cost of moving a word of data, either between levels of a memory hierarchy or between processors over a network, is much higher…

Data Structures and Algorithms · Computer Science 2018-04-25 James Demmel , Grace Dinh

In this paper, we study the convergence of the spectral embeddings obtained from the leading eigenvectors of certain similarity matrices to their population counterparts. We opt to study this convergence in a uniform (instead of average)…

Statistics Theory · Mathematics 2023-04-26 Ruofei Zhao , Songkai Xue , Yuekai Sun

Atomic norm methods have recently been proposed for spectral super-resolution with flexibility in dealing with missing data and miscellaneous noises. A notorious drawback of these convex optimization methods however is their lower…

Signal Processing · Electrical Eng. & Systems 2022-11-29 Zai Yang , Yi-Lin Mo , Gongguo Tang , Zongben Xu

To compress deep convolutional neural networks (CNNs) with large memory footprint and long inference time, this paper proposes a novel pruning criterion using layer-wised Ln-norm of feature maps. Different from existing pruning criteria,…

Neural and Evolutionary Computing · Computer Science 2018-12-11 Wei Wang , Liqiang Zhu

CoVariance Neural Networks (VNNs) perform convolutions on the graph determined by the covariance matrix of the data, which enables expressive and stable covariance-based learning. However, covariance matrices are typically dense, fail to…

Machine Learning · Computer Science 2026-01-21 Andrea Cavallo , Samuel Rey , Antonio G. Marques , Elvin Isufi

Deep convolutional neural networks (CNNs) have been shown to be able to fit a random labeling over data while still being able to generalize well for normal labels. Describing CNN capacity through a posteriori measures of complexity has…

Machine Learning · Computer Science 2020-03-10 Konstantinos Pitas , Andreas Loukas , Mike Davies , Pierre Vandergheynst

Hyperspectral imaging sensors are becoming increasingly popular in robotics applications such as agriculture and mining, and allow per-pixel thematic classification of materials in a scene based on their unique spectral signatures.…

Computer Vision and Pattern Recognition · Computer Science 2016-11-29 Lloyd Windrim , Rishi Ramakrishnan , Arman Melkumyan , Richard Murphy

We study performance characteristics of convolutional neural networks (CNN) for mobile computer vision systems. CNNs have proven to be a powerful and efficient approach to implement such systems. However, the system performance depends…

Computer Vision and Pattern Recognition · Computer Science 2018-03-28 Jussi Hanhirova , Teemu Kämäräinen , Sipi Seppälä , Matti Siekkinen , Vesa Hirvisalo , Antti Ylä-Jääski

Previous work generally believes that improving the spatial invariance of convolutional networks is the key to object counting. However, after verifying several mainstream counting networks, we surprisingly found too strict pixel-level…

Computer Vision and Pattern Recognition · Computer Science 2022-08-19 Zhi-Qi Cheng , Qi Dai , Hong Li , JingKuan Song , Xiao Wu , Alexander G. Hauptmann

This work investigates use of equivariant neural networks as efficient and high-performance frameworks for image reconstruction and denoising in nuclear medicine. Our work aims to tackle limitations of conventional Convolutional Neural…

Image and Video Processing · Electrical Eng. & Systems 2025-02-03 Amirreza Hashemi , Yuemeng Feng , Arman Rahmim , Hamid Sabet

Existing Rademacher complexity bounds for neural networks rely only on norm control of the weight matrices and depend exponentially on depth via a product of the matrix norms. Lower bounds show that this exponential dependence on depth is…

Machine Learning · Computer Science 2020-04-13 Colin Wei , Tengyu Ma

While dark transitions made bright by molecular motions determine the optoelectronic properties of many materials, simulating such non-Condon effects in condensed-phase spectroscopy remains a fundamental challenge. We derive a Gaussian…

Chemical Physics · Physics 2023-10-09 Zachary Wiethorn , Kye Hunter , Tim Zuehlsdorff , Andrés Montoya-Castillo

The convolution potential arises in a wide variety of application areas, and its efficient and accurate evaluation encounters three challenges: singularity, nonlocality and anisotropy. We introduce a fast algorithm based on a far-field…

Numerical Analysis · Mathematics 2025-04-29 Xin Liu , Yong Zhang

Complex demodulation of evolutionary spectra is formulated as a two-dimensional kernel smoother in the time-frequency domain. In the first stage, a tapered Fourier transform, $y_{nu}(f,t)$, is calculated. Second, the log-spectral estimate,…

Methodology · Statistics 2019-12-03 Kurt S. Riedel