English
Related papers

Related papers: Sharp convergence rates for Spectral methods via t…

200 papers

In this paper, we propose a general framework for tensor singular value decomposition (tensor SVD), which focuses on the methodology and theory for extracting the hidden low-rank structure from high-dimensional tensor data. Comprehensive…

Statistics Theory · Mathematics 2020-01-09 Anru Zhang , Dong Xia

Contextual sparsity is one of the approaches used to reduce computational complexity in the inference process of large language models (LLMs). Existing techniques for efficient LLM inference acceleration based on contextual sparsity with…

Machine Learning · Computer Science 2026-03-17 Georgii Serbin , Kirill Koshkin , Zhongao Sun , Anastasiya Bistrigova , C. C. Korikov

Stochastic Gradient Descent (SGD) is a known stochastic iterative method popular for large-scale convex optimization problems due to its simple implementation and scalability. Some objectives, such as those found in complex-valued neural…

Machine Learning · Computer Science 2026-05-26 Natanael Alpay , Emeric Battaglia

Hyperspectral (HS) images contain detailed spectral information that has proven crucial in applications like remote sensing, surveillance, and astronomy. However, because of hardware limitations of HS cameras, the captured images have low…

Image and Video Processing · Electrical Eng. & Systems 2021-06-15 Marija Vella , Bowen Zhang , Wei Chen , João F. C. Mota

In this paper, we present a new adaptive feature scaling scheme for ultrahigh-dimensional feature selection on Big Data. To solve this problem effectively, we first reformulate it as a convex semi-infinite programming (SIP) problem and then…

Machine Learning · Computer Science 2019-12-17 Mingkui Tan , Ivor W. Tsang , Li Wang

Low-rank decomposition (LRD) is a state-of-the-art method for visual data reconstruction and modelling. However, it is a very challenging problem when the image data contains significant occlusion, noise, illumination variation, and…

Computer Vision and Pattern Recognition · Computer Science 2017-08-08 Chen Chen , Baochang Zhang , Alessio Del Bue , Vittorio Murino

The uncertainty quantification and error control of classifiers are crucial in many high-consequence decision-making scenarios. We propose a selective classification framework that provides an indecision option for any observations that…

Methodology · Statistics 2022-10-11 Bowen Gang , Yuantao Shi , Wenguang Sun

Aims. To develop a fully Bayesian least squares deconvolution (LSD) that can be applied to the reliable detection of magnetic signals in noise-limited stellar spectropolarimetric observations using multiline techniques. Methods. We consider…

Solar and Stellar Astrophysics · Physics 2015-11-04 A. Asensio Ramos , P. Petit

Aims : We describe MS-MFS, a multi-scale multi-frequency deconvolution algorithm for wide-band synthesis-imaging, and present imaging results that illustrate the capabilities of the algorithm and the conditions under which it is feasible…

Instrumentation and Methods for Astrophysics · Physics 2015-05-28 Urvashi Rau , Tim J. Cornwell

In the process of performing image super-resolution processing, the processing of complex localized information can have a significant impact on the quality of the image generated. Fractal features can capture the rich details of both micro…

Computer Vision and Pattern Recognition · Computer Science 2025-02-28 Lianping Yang , Peng Jiao , Jinshan Pan , Hegui Zhu , Su Guo

Truncated singular value decomposition (SVD), also known as the best low-rank matrix approximation, has been successfully applied to many domains such as biology, healthcare, and others, where high-dimensional datasets are prevalent. To…

Optimization and Control · Mathematics 2022-08-09 Yongchun Li , Weijun Xie

We demonstrate that accurate computation of the spectral proper orthogonal decomposition (SPOD) critically depends on the choice of frequency resolution. Using both artificially generated data and large-eddy simulation data of a turbulent…

Fluid Dynamics · Physics 2024-02-27 Liam Heidt , Tim Colonius

This article focuses on covariance estimation for multi-study data. Popular approaches employ factor-analytic terms with shared and study-specific loadings that decompose the variance into (i) a shared low-rank component, (ii)…

Methodology · Statistics 2026-01-26 Lorenzo Mauri , Niccolò Anceschi , David B. Dunson

Recent learning-based lossless image compression methods encode an image in the unit of subimages and achieve comparable performances to conventional non-learning algorithms. However, these methods do not consider the performance drop in…

Image and Video Processing · Electrical Eng. & Systems 2021-12-14 Hochang Rhee , Yeong Il Jang , Seyun Kim , Nam Ik Cho

This paper presents two approaches for filter design based on stochastic distances for intensity speckle reduction. A window is defined around each pixel, overlapping samples are compared and only those which pass a goodness-of-fit test are…

Information Theory · Computer Science 2013-08-21 Leonardo Torres , Alejandro C. Frery

Very deep convolutional neural networks (CNNs) have been firmly established as the primary methods for many computer vision tasks. However, most state-of-the-art CNNs are large, which results in high inference latency. Recently, depth-wise…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Yihui He , Jianing Qian , Jianren Wang , Cindy X. Le , Congrui Hetang , Qi Lyu , Wenping Wang , Tianwei Yue

Fully convolutional deep neural networks have been asserted to be fast and precise frameworks with great potential in image segmentation. One of the major challenges in training such networks raises when data is unbalanced, which is common…

Computer Vision and Pattern Recognition · Computer Science 2018-12-17 Seyed Raein Hashemi , Seyed Sadegh Mohseni Salehi , Deniz Erdogmus , Sanjay P. Prabhu , Simon K. Warfield , Ali Gholipour

We introduce data structures for solving robust regression through stochastic gradient descent (SGD) by sampling gradients with probability proportional to their norm, i.e., importance sampling. Although SGD is widely used for large scale…

Machine Learning · Computer Science 2022-07-19 Sepideh Mahabadi , David P. Woodruff , Samson Zhou

Penalized regression methods, most notably the lasso, are a popular approach to analyzing high-dimensional data. An attractive property of the lasso is that it naturally performs variable selection. An important area of concern, however, is…

Methodology · Statistics 2026-05-13 Ryan Miller , Patrick Breheny

We report a method for super-resolution of range images. Our approach leverages the interpretation of LR image as sparse samples on the HR grid. Based on this interpretation, we demonstrate that our recently reported approach, which…

Computer Vision and Pattern Recognition · Computer Science 2012-10-30 Arnav Bhavsar