English
Related papers

Related papers: Spectral Tempering for Embedding Compression in De…

200 papers

Differential privacy is a widely accepted measure of privacy in the context of deep learning algorithms, and achieving it relies on a noisy training approach known as differentially private stochastic gradient descent (DP-SGD). DP-SGD…

Machine Learning · Computer Science 2023-07-26 Ce Feng , Nuo Xu , Wujie Wen , Parv Venkitasubramaniam , Caiwen Ding

We present a novel spectral learning algorithm for simultaneous localization and mapping (SLAM) from range data with known correspondences. This algorithm is an instance of a general spectral system identification framework, from which it…

Machine Learning · Computer Science 2012-07-12 Byron Boots , Geoffrey J. Gordon

Optimal $k$-thresholding algorithms are a class of $k$-sparse signal recovery algorithms that overcome the shortcomings of traditional hard thresholding algorithms caused by the oscillation of the residual function. In this paper, a novel…

Information Theory · Computer Science 2022-06-22 Jialiang Xu , Xu Zhang

Neural vocoder using denoising diffusion probabilistic model (DDPM) has been improved by adaptation of the diffusion noise distribution to given acoustic features. In this study, we propose SpecGrad that adapts the diffusion noise so that…

Audio and Speech Processing · Electrical Eng. & Systems 2022-08-08 Yuma Koizumi , Heiga Zen , Kohei Yatabe , Nanxin Chen , Michiel Bacchiani

Several fundamental tasks in data science rely on computing an extremal eigenspace of size $r \ll n$, where $n$ is the underlying problem dimension. For example, spectral clustering and PCA both require the computation of the leading…

Numerical Analysis · Mathematics 2019-09-04 Vasileios Charisopoulos , Austin R. Benson , Anil Damle

Speckle reduction is a prerequisite for many image processing tasks in synthetic aperture radar (SAR) images, as well as all coherent images. In recent years, predominant state-of-the-art approaches for despeckling are usually based on…

Computer Vision and Pattern Recognition · Computer Science 2017-02-27 Wensen Feng , Yunjin Chen

Kernel method is a very powerful tool in machine learning. The trick of kernel has been effectively and extensively applied in many areas of machine learning, such as support vector machine (SVM) and kernel principal component analysis…

Networking and Internet Architecture · Computer Science 2011-05-17 Shujie Hou , Robert C. Qiu

Speckle noise is an inherent disturbance in coherent imaging systems such as digital holography, synthetic aperture radar, optical coherence tomography, or ultrasound systems. These systems usually produce only single observation per view…

Image and Video Processing · Electrical Eng. & Systems 2022-05-19 Tsung-Ming Tai , Yun-Jie Jhang , Wen-Jyi Hwang , Chau-Jern Cheng

Spectral methods which represent data points by eigenvectors of kernel matrices or graph Laplacian matrices have been a primary tool in unsupervised data analysis. In many application scenarios, parametrizing the spectral embedding by a…

Machine Learning · Statistics 2022-06-15 Ziyu Chen , Yingzhou Li , Xiuyuan Cheng

In this paper, we develop a new framework for sensing and recovering structured signals. In contrast to compressive sensing (CS) systems that employ linear measurements, sparse representations, and computationally complex convex/greedy…

Machine Learning · Computer Science 2016-09-01 Ali Mousavi , Ankit B. Patel , Richard G. Baraniuk

Learning probabilistic models over strings is an important issue for many applications. Spectral methods propose elegant solutions to the problem of inferring weighted automata from finite samples of variable-length strings drawn from an…

Machine Learning · Computer Science 2013-12-24 François Denis , Mattias Gybels , Amaury Habrard

While deep neural networks have facilitated significant advancements in the field of speech enhancement, most existing methods are developed following either empirical or relatively blind criteria, lacking adequate guidelines in pipeline…

Sound · Computer Science 2023-03-29 Andong Li , Guochen Yu , Chengshi Zheng , Wenzhe Liu , Xiaodong Li

Fine-tuning a language model for a target task routinely degrades capabilities the training data never explicitly threatened. We study this phenomenon, known as catastrophic forgetting, and propose a post-hoc repair solution that uses only…

Machine Learning · Computer Science 2026-05-21 Aarash Abro , Muhammad Tahir

Intelligent spectrum management is crucial for improving spectrum efficiency and achieving secure utilization of spectrum resources. However, existing intelligent spectrum management methods, typically based on small-scale models, suffer…

Signal Processing · Electrical Eng. & Systems 2025-12-16 Fuhui Zhou , Chunyu Liu , Hao Zhang , Wei Wu , Qihui Wu , Tony Q. S. Quek , Chan-Byoung Chae

Spectral Embedding (SE) is a popular method for dimensionality reduction, applicable across diverse domains. Nevertheless, its current implementations face three prominent drawbacks which curtail its broader applicability: generalizability…

Machine Learning · Computer Science 2025-08-21 Nir Ben-Ari , Amitai Yacobi , Uri Shaham

Voice spoofing attacks pose a significant threat to automated speaker verification systems. Existing anti-spoofing methods often simulate specific attack types, such as synthetic or replay attacks. However, in real-world scenarios, the…

Sound · Computer Science 2023-09-19 Awais Khan , Khalid Mahmood Malik , Shah Nawaz

Pseudospectral analysis is fundamental for quantifying the sensitivity and transient behavior of nonnormal matrices, yet its computational cost scales cubically with dimension, rendering it prohibitive for large-scale systems. While…

Numerical Analysis · Mathematics 2026-02-03 Vladimir R. Kostic , Dragana Lj. Cvetkovic , Ljiljana Cvetkovic

Tensor completion is a core machine learning algorithm used in recommender systems and other domains with missing data. While the matrix case is well-understood, theoretical results for tensor problems are limited, particularly when the…

Machine Learning · Statistics 2023-06-13 Kameron Decker Harris , Oscar López , Angus Read , Yizhe Zhu

Although existing neural retrieval models reveal promising results when training data is abundant and the performance keeps improving as training data increases, collecting high-quality annotated data is prohibitively costly. To this end,…

Computation and Language · Computer Science 2023-11-28 Fan Jiang , Tom Drummond , Trevor Cohn

We propose an end-to-end attribute compression method for dense point clouds. The proposed method combines a frequency sampling module, an adaptive scale feature extraction module with geometry assistance, and a global hyperprior entropy…

Image and Video Processing · Electrical Eng. & Systems 2024-09-17 Xiaolong Mao , Hui Yuan , Tian Guo , Shiqi Jiang , Raouf Hamzaoui , Sam Kwong