English
Related papers

Related papers: Orthonormal Matrix Codebook Design for Adaptive Tr…

200 papers

We present a reformulation of optimization problems over the Stiefel manifold by using a Cayley-type transform, named the generalized left-localized Cayley transform, for the Stiefel manifold. The reformulated optimization problem is…

Optimization and Control · Mathematics 2023-12-05 Kieta Kume , Isao Yamada

We propose a novel decoding approach for neural machine translation (NMT) based on continuous optimisation. We convert decoding - basically a discrete optimization problem - into a continuous optimization problem. The resulting constrained…

Computation and Language · Computer Science 2017-07-25 Cong Duy Vu Hoang , Gholamreza Haffari , Trevor Cohn

Fault tolerance is a prerequisite for scalable quantum computing. Architectures based on 2D topological codes are effective for near-term implementations of fault tolerance. To obtain high performance with these architectures, we require a…

Quantum Physics · Physics 2018-10-23 Ben Criger , Imran Ashraf

This paper proposes an adaptive neural-compilation framework to address the problem of efficient program learning. Traditional code optimisation strategies used in compilers are based on applying pre-specified set of transformations that…

Artificial Intelligence · Computer Science 2016-05-27 Rudy Bunel , Alban Desmaison , Pushmeet Kohli , Philip H. S. Torr , M. Pawan Kumar

Matrix trace estimation is ubiquitous in machine learning applications and has traditionally relied on Hutchinson's method, which requires $O(\log(1/\delta)/\epsilon^2)$ matrix-vector product queries to achieve a $(1 \pm…

Data Structures and Algorithms · Computer Science 2021-11-02 Shuli Jiang , Hai Pham , David P. Woodruff , Qiuyi , Zhang

The discrete cosine transform (DCT) is a relevant tool in signal processing applications, mainly known for its good decorrelation properties. Current image and video coding standards -- such as JPEG and HEVC -- adopt the DCT as a…

Image and Video Processing · Electrical Eng. & Systems 2022-12-09 T. L. T. da Silveira , D. R. Canterle , D. F. G. Coelho , V. A. Coutinho , F. M. Bayer , R. J. Cintra

We consider a channel-independent decoder which is for i.i.d. random codes what the maximum mutual-information decoder is for constant composition codes. We show that this decoder results in exactly the same i.i.d. random coding error…

Information Theory · Computer Science 2018-11-06 Sergey Tridenski , Ram Zamir

Due to the COVID-19 pandemic, there is an increasing demand for portable CT machines worldwide in order to diagnose patients in a variety of settings. This has led to a need for CT image reconstruction algorithms that can produce high…

Numerical Analysis · Mathematics 2025-12-10 Mai Phuong Pham Huynh , Manuel Santana , Ana Castillo

Nowadays, real-time video communication over the internet through video conferencing applications has become an invaluable tool in everyone's professional and personal life. This trend underlines the need for video coding algorithms that…

Multimedia · Computer Science 2015-10-05 Stamos Katsigiannis , Georgios Papaioannou , Dimitris Maroulis

Many classical and modern machine learning algorithms require solving optimization tasks under orthogonality constraints. Solving these tasks with feasible methods requires a gradient descent update followed by a retraction operation on the…

Optimization and Control · Mathematics 2024-12-10 Youbang Sun , Shixiang Chen , Alfredo Garcia , Shahin Shahrampour

The classical alternating minimization (or projection) algorithm has been successful in the context of solving optimization problems over two variables. The iterative nature and simplicity of the algorithm has led to its application to many…

Information Theory · Computer Science 2010-08-24 Urs Niesen , Devavrat Shah , Gregory Wornell

We develop new adaptive algorithms for variational inequalities with monotone operators, which capture many problems of interest, notably convex optimization and convex-concave saddle point problems. Our algorithms automatically adapt to…

Machine Learning · Computer Science 2021-08-30 Alina Ene , Huy L. Nguyen

Block coordinate descent is an optimization paradigm that iteratively updates one block of variables at a time, making it quite amenable to big data applications due to its scalability and performance. Its convergence behavior has been…

Optimization and Control · Mathematics 2023-10-13 Liangzu Peng , René Vidal

This paper introduces an algorithm designed to approximate quantum transformation matrix with a restricted number of gates by using the block decomposition technique. Addressing challenges posed by numerous gates in handling large qubit…

Quantum Physics · Physics 2025-10-16 Lai Kin Man , Xin Wang

We present techniques that improve the performance of asymmetric stabilizer codes in the presence of unital channels with unknown parameters. Our method estimates the channel parameters using information recovered from syndrome measurements…

Quantum Physics · Physics 2017-05-30 Jan Florjanczyk , Todd A. Brun

Error correction codes are a crucial part of the physical communication layer, ensuring the reliable transfer of data over noisy channels. The design of optimal linear block codes capable of being efficiently decoded is of major concern,…

Information Theory · Computer Science 2024-05-08 Yoni Choukroun , Lior Wolf

Strictly enforcing orthonormality constraints on parameter matrices has been shown advantageous in deep learning. This amounts to Riemannian optimization on the Stiefel manifold, which, however, is computationally expensive. To address this…

Machine Learning · Computer Science 2020-02-05 Jun Li , Li Fuxin , Sinisa Todorovic

Spin-torque transfer magnetic random access memory (STT-MRAM) is a promising emerging non-volatile memory (NVM) technology with wide applications. However, the data recovery of STT-MRAM is affected by the diversity of channel raw bit error…

Information Theory · Computer Science 2024-10-08 Xingwei Zhong , Kui Cai , Peng Kang , Guanghui Song , Bin Dai

In this paper, we propose an inexact block coordinate descent algorithm for large-scale nonsmooth nonconvex optimization problems. At each iteration, a particular block variable is selected and updated by inexactly solving the original…

Optimization and Control · Mathematics 2019-12-12 Yang Yang , Marius Pesavento , Zhi-Quan Luo , Björn Ottersten

In distributed optimization problems, a technique called gradient coding, which involves replicating data points, has been used to mitigate the effect of straggling machines. Recent work has studied approximate gradient coding, which…

Machine Learning · Statistics 2021-08-09 Margalit Glasgow , Mary Wootters