English
Related papers

Related papers: Sharp convergence rates for Spectral methods via t…

200 papers

In this paper, we study regression problems over a separable Hilbert space with the square loss, covering non-parametric regression over a reproducing kernel Hilbert space. We investigate a class of spectral/regularized algorithms,…

Machine Learning · Statistics 2022-07-18 Junhong Lin , Alessandro Rudi , Lorenzo Rosasco , Volkan Cevher

Low rank tensor representation (LRTR) methods are very useful for hyperspectral anomaly detection (HAD). To overcome the limitations that they often overlook spectral anomaly and rely on large-scale matrix singular value decomposition, we…

Computer Vision and Pattern Recognition · Computer Science 2025-03-10 Quan Yu , Yu-Hong Dai , Minru Bai

In remote sensing, hyperspectral (HS) and multispectral (MS) image fusion have emerged as a synthesis tool to improve the data set resolution. However, conventional image fusion methods typically degrade the performance of the land cover…

Image and Video Processing · Electrical Eng. & Systems 2022-04-05 Juan Ramírez , Héctor Vargas , José Ignacio Martínez , Henry Arguello

Large-scale surveys make huge amounts of photometric data available. Because of the sheer amount of objects, spectral data cannot be obtained for all of them. Therefore it is important to devise techniques for reliably estimating physical…

Instrumentation and Methods for Astrophysics · Physics 2017-03-22 Kristoffer Stensbo-Smidt , Fabian Gieseke , Christian Igel , Andrew Zirm , Kim Steenstrup Pedersen

Many high-dimensional data sets suffer from hidden confounding which affects both the predictors and the response of interest. In such situations, standard regression methods or algorithms lead to biased estimates. This paper substantially…

Methodology · Statistics 2024-12-17 Cyrill Scheidegger , Zijian Guo , Peter Bühlmann

The classical line search for learning rate (LR) tuning in the stochastic gradient descent (SGD) algorithm can tame the convergence slowdown due to data-sampling noise. In a federated setting, wherein the client heterogeneity introduces a…

Machine Learning · Computer Science 2025-10-28 Geetika , Somya Tyagi , Bapi Chatterjee

First, we extend the results of approximate matrix multiplication from the Frobenius norm to the spectral norm. Second, We develop a class of fast approximate generalized linear regression algorithms with respect to the spectral norm.…

Numerical Analysis · Computer Science 2015-11-11 Haishan Ye , Zhihua Zhang

Deep learning-based hyperspectral image super-resolution (SR) methods have achieved great success recently. However, most existing models can not effectively explore spatial information and spectral information between bands simultaneously,…

Computer Vision and Pattern Recognition · Computer Science 2020-01-15 Qi Wang , Qiang Li , Xuelong Li

Feature selection is important step in machine learning since it has shown to improve prediction accuracy while depressing the curse of dimensionality of high dimensional data. The neural networks have experienced tremendous success in…

Machine Learning · Computer Science 2021-07-13 Peter Bugata , Peter Drotar

We utilize the Feature Decoupling Distributed (FDD) method to enhance the capability of deep learning to fit the Nonlinear Schrodinger Equation (NLSE), significantly reducing the NLSE loss compared to non decoupling model.

Signal Processing · Electrical Eng. & Systems 2024-11-08 Yunfan Zhang , Zekun Niu , Minghui Shi , Weisheng Hu , Lilin Yi

In many mechanical, electrical, and general physical systems evolving over time or space, spectral analysis methods as Fast Fourier Transform (FFT), Short Term Fourier Transform (STFT), Power Spectrum Density (PSD) plays a very important…

Signal Processing · Electrical Eng. & Systems 2023-06-21 Andreas Tuor , Nico Canzani , Tobias Rüggeberg , Stefan Gorenflo , Gerd Simons , Bruno Bättig , Daniel Iseli

Federated Learning (FL) enables multiple resource-constrained edge devices with varying levels of heterogeneity to collaboratively train a global model. However, devices with limited capacity can create bottlenecks and slow down model…

Machine Learning · Computer Science 2025-04-08 Afsaneh Mahanipour , Hana Khamfroush

In this paper, we propose a novel approach to hyperspectral image super-resolution by modeling the global spatial-and-spectral correlation and local smoothness properties over hyperspectral images. Specifically, we utilize the tensor…

Computer Vision and Pattern Recognition · Computer Science 2016-01-26 Shiying He , Haiwei Zhou , Yao Wang , Wenfei Cao , Zhi Han

Hyperspectral cameras face harsh trade-offs between spatial, spectral, and temporal resolution in inherently low-photon conditions. Computational imaging systems break through these trade-offs with compressive sensing, but have required…

Computer Vision and Pattern Recognition · Computer Science 2026-02-12 M. Kerem Aydin , Yi-Chun Hung , Jaclyn Pytlarz , Qi Guo , Emma Alexander

We study a distributed consensus-based stochastic gradient descent (SGD) algorithm and show that the rate of convergence involves the spectral properties of two matrices: the standard spectral gap of a weight matrix from the network…

Optimization and Control · Mathematics 2016-09-02 Avleen S. Bijral , Anand D. Sarwate , Nathan Srebro

This paper presents an innovative approach to dimensionality reduction and feature extraction in high-dimensional datasets, with a specific application focus on wood surface defect detection. The proposed framework integrates sparse…

Machine Learning · Computer Science 2024-10-01 Harish Neelam , Koushik Sai Veerella , Souradip Biswas

In hyperspectral, high-quality spectral signals convey subtle spectral differences to distinguish similar materials, thereby providing unique advantage for anomaly detection. Hence fine spectra of anomalous pixels can be effectively…

Image and Video Processing · Electrical Eng. & Systems 2022-02-25 Zengfu Hou , Siyuan Cheng , Ting Hu

This paper proposes a sparse regression method that continuously interpolates between Forward Stepwise selection (FS) and the LASSO. When tuned appropriately, our solutions are much sparser than typical LASSO fits but, unlike FS fits,…

Methodology · Statistics 2024-11-20 Ivy Zhang , Robert Tibshirani

Light field imaging has recently known a regain of interest due to the availability of practical light field capturing systems that offer a wide range of applications in the field of computer vision. However, capturing high-resolution light…

Computer Vision and Pattern Recognition · Computer Science 2018-01-16 Reuben A. Farrugia , Christine Guillemot

In this work we present a new algorithm for data deconvolution that allows the retrieval of the target function with super-resolution with a simple approach that after a precis e measurement of the instrument response function (IRF), the…

Computer Vision and Pattern Recognition · Computer Science 2018-12-07 Sandra Martínez , Oscar E. Martínez