English
Related papers

Related papers: Nonuniform Sampling Rate Conversion: An Efficient …

200 papers

Motivated by electricity consumption metering, we extend existing nonnegative matrix factorization (NMF) algorithms to use linear measurements as observations, instead of matrix entries. The objective is to estimate multiple time series at…

Machine Learning · Statistics 2016-10-06 Jiali Mei , Yohann De Castro , Yannig Goude , Georges Hébrail

Federated learning involves a mixture of centralized and decentralized processing tasks, where a server regularly selects a sample of the agents and these in turn sample their local data to compute stochastic gradients for their learning…

Machine Learning · Computer Science 2020-10-27 Elsa Rizk , Stefan Vlaski , Ali H. Sayed

We consider the problem of discrete-time signal denoising, focusing on a specific family of non-linear convolution-type estimators. Each such estimator is associated with a time-invariant filter which is obtained adaptively, by solving a…

Statistics Theory · Mathematics 2018-06-13 Dmitrii Ostrovskii , Zaid Harchaoui

We present a matrix-factorization algorithm that scales to input matrices with both huge number of rows and columns. Learned factors may be sparse or dense and/or non-negative, which makes our algorithm suitable for dictionary learning,…

Machine Learning · Statistics 2017-11-15 Arthur Mensch , Julien Mairal , Bertrand Thirion , Gael Varoquaux

An adaptive finite difference scheme for variable-order fractional-time subdiffusion equations in the Caputo form is studied. The fractional time derivative is discretized by the L1 procedure but using nonhomogeneous timesteps. The size of…

Numerical Analysis · Mathematics 2024-09-20 Joaquín Quintana-Murillo , Santos Bravo Yuste

The convergence rates for convex and non-convex optimization methods depend on the choice of a host of constants, including step sizes, Lyapunov function constants and momentum constants. In this work we propose the use of factorial powers…

Machine Learning · Computer Science 2023-04-13 Aaron Defazio , Robert M. Gower

Discrete diffusion models have emerged as powerful tools for high-quality data generation. Despite their success in discrete spaces, such as text generation tasks, the acceleration of discrete diffusion models remains under-explored. In…

Machine Learning · Computer Science 2024-12-09 Zixiang Chen , Huizhuo Yuan , Yongqian Li , Yiwen Kou , Junkai Zhang , Quanquan Gu

In this paper, we propose a unified convergence analysis for a class of generic shuffling-type gradient methods for solving finite-sum optimization problems. Our analysis works with any sampling without replacement strategy and covers many…

Optimization and Control · Mathematics 2021-09-21 Lam M. Nguyen , Quoc Tran-Dinh , Dzung T. Phan , Phuong Ha Nguyen , Marten van Dijk

Optimization is an important module of modern machine learning applications. Tremendous efforts have been made to accelerate optimization algorithms. A common formulation is achieving a lower loss at a given time. This enables a…

Machine Learning · Computer Science 2025-05-29 Zhonglin Xie , Yiman Fong , Haoran Yuan , Zaiwen Wen

This paper addresses the problem of expressing a signal as a sum of frequency components (sinusoids) wherein each sinusoid may exhibit abrupt changes in its amplitude and/or phase. The Fourier transform of a narrow-band signal, with a…

Machine Learning · Computer Science 2013-02-27 Yin Ding , Ivan W. Selesnick

We present a new method, Non-Stationary Forward Flux Sampling, that allows efficient simulation of rare events in both stationary and non-stationary stochastic systems. The method uses stochastic branching and pruning to achieve uniform…

Molecular Networks · Quantitative Biology 2015-06-03 Nils B. Becker , Rosalind J. Allen , Pieter Rein ten Wolde

Given a time series vector, how can we efficiently compute a specified part of Fourier coefficients? Fast Fourier transform (FFT) is a widely used algorithm that computes the discrete Fourier transform in many machine learning applications.…

Machine Learning · Computer Science 2020-08-31 Yong-chan Park , Jun-Gi Jang , U Kang

By approximating posterior distributions with weighted samples, particle filters (PFs) provide an efficient mechanism for solving non-linear sequential state estimation problems. While the effectiveness of particle filters has been…

Machine Learning · Computer Science 2023-12-15 Xiongjie Chen , Yunpeng Li

Particle filtering is a numerical Bayesian technique that has great potential for solving sequential estimation problems involving non-linear and non-Gaussian models. Since the estimation accuracy achieved by particle filters improves as…

Computation · Statistics 2017-11-22 Jeyarajan Thiyagalingam , Lykourgos Kekempanos , Simon Maskell

Sampling from unnormalised discrete distributions is a fundamental problem across various domains. While Markov chain Monte Carlo offers a principled approach, it often suffers from slow mixing and poor convergence. In this paper, we…

Machine Learning · Computer Science 2025-10-23 Zijing Ou , Ruixiang Zhang , Yingzhen Li

Digital filters with variable bandwidth can be used for a variety of applications. Arbitrary change in the bandwidth of a digital Finite Impulse Response (FIR) filter can be acquired using sampling rate converters. In this paper, a sampling…

Signal Processing · Electrical Eng. & Systems 2021-09-27 Sushmitha Sajeevu , V. Sakthivel

Factorization machines (FMs) are a powerful tool for regression and classification in the context of sparse observations, that has been successfully applied to collaborative filtering, especially when side information over users or items is…

Machine Learning · Computer Science 2022-12-21 Jill-Jênn Vie , Tomas Rigaux , Hisashi Kashima

Many interesting and fundamentally practical optimization problems, ranging from optics, to signal processing, to radar and acoustics, involve constraints on the Fourier transform of a function. It is well-known that the {\em fast Fourier…

Optimization and Control · Mathematics 2012-09-05 Robert J. Vanderbei

With the advancements in computing technology and web-based applications, data is increasingly generated in multi-dimensional form. This data is usually sparse due to the presence of a large number of users and fewer user interactions. To…

Machine Learning · Computer Science 2020-03-10 Thirunavukarasu Balasubramaniam , Richi Nayak , Chau Yuen

To obtain the initial pressure from the collected data on a planar sensor arrangement in Photoacoustic tomography, there exists an exact analytic frequency domain reconstruction formula. An efficient realization of this formula needs to…

Numerical Analysis · Mathematics 2015-01-14 Julian Schmid , Thomas Glatz , Behrooz Zabihian , Mengyang Liu , Wolfgang Drexler , Otmar Scherzer