English
Related papers

Related papers: Adapted Decimation on Finite Frames for Arbitrary …

200 papers

Optimal modulation (OM) schemes for Gaussian channels with peak and average power constraints are known to require nonuniform probability distributions over signal points, which presents practical challenges. An established way to map…

Information Theory · Computer Science 2022-11-01 Basak Ozaydin , Muriel Médard , Ken Duffy

In dual decomposition, the dual to an optimization problem with a specific structure is solved in distributed fashion using (sub)gradient and recently also fast gradient methods. The traditional dual decomposition suffers from two main…

Optimization and Control · Mathematics 2014-04-08 Pontus Giselsson

In this addendum of our paper [D. Burgarth and V. Giovannetti, Phys. Rev. Lett. 99, 100501 (2007)] we prove that during the transformation that allows one to enforce control by relaxation on a quantum system, the ancillary memory can be…

Quantum Physics · Physics 2010-09-08 Daniel Burgarth , Vittorio Giovannetti

Adaptive gradient-based optimizers such as Adagrad and Adam are crucial for achieving state-of-the-art performance in machine translation and language modeling. However, these methods maintain second-order statistics for each parameter,…

Machine Learning · Computer Science 2019-09-13 Rohan Anil , Vineet Gupta , Tomer Koren , Yoram Singer

We introduce Adam, an algorithm for first-order gradient-based optimization of stochastic objective functions, based on adaptive estimates of lower-order moments. The method is straightforward to implement, is computationally efficient, has…

Machine Learning · Computer Science 2017-01-31 Diederik P. Kingma , Jimmy Ba

We present a new algorithm for 3D cone-beam tomography. The algorithm is based on decomposition of the cone-beam backprojection operation and angular decimation. It has computational complexity of $O(N^{3.5})$ and allows considerable…

Medical Physics · Physics 2017-08-28 Vladyslav Andriiashen , Danila Kozhevnikov

We study the problem of multi-compression and reconstructing a stochastic signal observed by several independent sensors (or compressors) that transmit compressed information to a fusion center. { The key aspect of this problem is to find…

Information Theory · Computer Science 2021-11-08 Pablo Soto-Quiros , Anatoli Torokhti , Stanley J. Miklavcic

Data augmentation methods have been shown to be a fundamental technique to improve generalization in tasks such as image, text and audio classification. Recently, automated augmentation methods have led to further improvements on image…

Machine Learning · Computer Science 2021-02-17 Elizabeth Fons , Paula Dawson , Xiao-jun Zeng , John Keane , Alexandros Iosifidis

Bilevel optimization is a central tool in machine learning for high-dimensional hyperparameter tuning. Its applications are vast; for instance, in imaging it can be used for learning data-adaptive regularizers and optimizing forward…

Optimization and Control · Mathematics 2025-11-11 Mohammad Sadegh Salehi , Subhadip Mukherjee , Lindon Roberts , Matthias J. Ehrhardt

The spatial Sigma-Delta ($\Sigma\Delta$) architecture can be leveraged to reduce the quantization noise and enhance the effective resolution of few-bit analog-to-digital converters (ADCs) at certain spatial frequencies of interest.…

Signal Processing · Electrical Eng. & Systems 2025-09-22 Toan-Van Nguyen , Sajjad Nassirpour , Italo Atzeni , Antti Tolli , A. Lee Swindlehurst , Duy H. N. Nguyen

The quantum rate-distortion function plays a fundamental role in quantum information theory, however there is currently no practical algorithm which can efficiently compute this function to high accuracy for moderate channel dimensions. In…

Quantum Physics · Physics 2024-04-10 Kerry He , James Saunderson , Hamza Fawzi

We propose an algorithm for the adaptation of the learning rate for stochastic gradient descent (SGD) that avoids the need for validation set use. The idea for the adaptiveness comes from the technique of extrapolation: to get an estimate…

Machine Learning · Statistics 2020-08-28 Antti Koskela , Antti Honkela

We introduce a general method for improving the convergence rate of gradient-based optimizers that is easy to implement and works well in practice. We demonstrate the effectiveness of the method in a range of optimization problems by…

Machine Learning · Computer Science 2018-08-23 Atilim Gunes Baydin , Robert Cornish , David Martinez Rubio , Mark Schmidt , Frank Wood

Two-dimensional (2D) Multiple Signal Classification algorithm is a powerful technique for high-resolution direction-of-arrival (DOA) estimation in array signal processing. However, the exhaustive search over the 2D an-gular domain leads to…

Signal Processing · Electrical Eng. & Systems 2025-07-29 Bo Zhou , Kaijie Xu , Yinghui Quan , Mengdao Xing

The (modern) arbitrary derivative (ADER) approach is a popular technique for the numerical solution of differential problems based on iteratively solving an implicit discretization of their weak formulation. In this work, focusing on an ODE…

Numerical Analysis · Mathematics 2024-01-15 Maria Han Veiga , Lorenzo Micalizzi , Davide Torlo

Digital/Analog converters based on sigma-delta modulation are simple and unexpensive circuits featuring a signal bandwidth limited by speed constraints. Multi-bit modulators allow balancing complexity and speed by reducing the clock…

Signal Processing · Electrical Eng. & Systems 2025-12-16 Marta Laguna , Juana M. Martínez-Heredia , Manuel G. Satué

This paper introduces an iterative algorithm for training nonparametric additive models that enjoys favorable memory storage and computational requirements. The algorithm can be viewed as the functional counterpart of stochastic gradient…

Machine Learning · Statistics 2026-01-01 Xin Chen , Jason M. Klusowski

Dual-energy computed tomography (DECT) has shown great potential and promising applications in advanced imaging fields for its capabilities of material decomposition. However, image reconstructions and decompositions under sparse views…

Medical Physics · Physics 2016-08-01 Lei Li , Ailong Cai , Linyuan Wang , Bin Yan , Hanming Zhang , Zhizhong Zheng , Wenkun Zhang , Wanli Lu , Guoen Hu

With today's increasing demand for digital devices in Substation Automation Systems (SAS) based on the IEC61850 standard, the measured data error due to the synchronization problem should be considered as a significant problem in…

Systems and Control · Electrical Eng. & Systems 2021-08-27 Mohammad Hashemi , Bijan Alizadeh

This paper focuses on channel estimation in single-user and multi-user MIMO systems with multi-antenna base stations equipped with 1-bit spatial sigma-delta analog-to-digital converters (ADCs). A careful selection of the quantization…

Signal Processing · Electrical Eng. & Systems 2021-09-21 R. S. Prasobh Sankar , Sundeep Prabhakar Chepuri