English
Related papers

Related papers: System-Aware Compression

200 papers

From a dual perspective of the sparse representation model, Nam et al. proposed the cosparse analysis model. In this paper, we aim to investigate the convergence of the alternating direction method of multipliers (ADMM) for the cosparse…

Optimization and Control · Mathematics 2023-11-23 Zisheng Liu , Ting Zhang

Sparse representation leads to an efficient way to approximately recover a signal by the linear composition of a few bases from a learnt dictionary, based on which various successful applications have been achieved. However, in the scenario…

Computer Vision and Pattern Recognition · Computer Science 2018-05-04 Xiang Zhang , Jiarui Sun , Siwei Ma , Zhouchen Lin , Jian Zhang , Shiqi Wang , Wen Gao

The alternating direction method of multipliers (ADMM) were extensively investigated in the past decades for solving separable convex optimization problems. Fewer researchers focused on exploring its convergence properties for the nonconvex…

Numerical Analysis · Mathematics 2019-07-02 Jianchao Bai , Junli Liang , Ke Guo , Yang Jing

We propose a distributed algorithm, named Distributed Alternating Direction Method of Multipliers (D-ADMM), for solving separable optimization problems in networks of interconnected nodes or agents. In a separable optimization problem there…

Optimization and Control · Mathematics 2013-04-26 João F. C. Mota , João M. F. Xavier , Pedro M. Q. Aguiar , Markus Püschel

Modern compression algorithms exploit complex structures that are present in signals to describe them very efficiently. On the other hand, the field of compressed sensing is built upon the observation that "structured" signals can be…

Information Theory · Computer Science 2016-01-08 Farideh Ebrahim Rezagah , Shirin Jalali , Elza Erkip , H. Vincent Poor

Multi-agent distributed consensus optimization problems arise in many signal processing applications. Recently, the alternating direction method of multipliers (ADMM) has been used for solving this family of problems. ADMM based distributed…

Systems and Control · Computer Science 2015-06-18 Tsung-Hui Chang , Mingyi Hong , Xiangfeng Wang

A new Lossy Causal Temporal Convolutional Neural Network Autoencoder for anomaly detection is proposed in this work. Our framework uses a rate-distortion loss and an entropy bottleneck to learn a compressed latent representation for the…

Machine Learning · Computer Science 2022-12-06 Christopher P. Ley , Jorge F. Silva

Aiming at solving large-scale learning problems, this paper studies distributed optimization methods based on the alternating direction method of multipliers (ADMM). By formulating the learning problem as a consensus problem, the ADMM can…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-05-04 Tsung-Hui Chang , Mingyi Hong , Wei-Cheng Liao , Xiangfeng Wang

We propose a convex distributed optimization algorithm for synthesizing robust controllers for large-scale continuous time systems subject to exogenous disturbances. Given a large scale system, instead of solving the larger centralized…

Optimization and Control · Mathematics 2018-03-02 Mohamadreza Ahmadi , Murat Cubuktepe , Ufuk Topcu , Takashi Tanaka

Multi-resolution methods such as Adaptive Mesh Refinement (AMR) can enhance storage efficiency for HPC applications generating vast volumes of data. However, their applicability is limited and cannot be universally deployed across all…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-10-02 Daoce Wang , Pascal Grosset , Jesus Pulido , Tushar M. Athawale , Jiannan Tian , Kai Zhao , Zarija Lukić , Axel Huebl , Zhe Wang , James Ahrens , Dingwen Tao

Transformers achieve superior performance on many tasks, but impose heavy compute and memory requirements during inference. This inference can be made more efficient by partitioning the process across multiple devices, which, in turn,…

Machine Learning · Computer Science 2026-04-21 Anderson de Andrade , Alon Harell , Ivan V. Bajić

We propose computationally efficient encoders and decoders for lossy compression using a Sparse Regression Code. The codebook is defined by a design matrix and codewords are structured linear combinations of columns of this matrix. The…

Information Theory · Computer Science 2014-05-20 Ramji Venkataramanan , Tuhin Sarkar , Sekhar Tatikonda

Alternating Direction Method of Multipliers (ADMM) is a popular convex optimization algorithm, which can be employed for solving distributed consensus optimization problems. In this setting agents locally estimate the optimal solution of an…

Signal Processing · Electrical Eng. & Systems 2019-03-27 Layla Majzoobi , Farshad Lahouti , Vahid Shah-Mansouri

In this paper, we present a novel adversarial lossy video compression model. At extremely low bit-rates, standard video coding schemes suffer from unpleasant reconstruction artifacts such as blocking, ringing etc. Existing learned neural…

Image and Video Processing · Electrical Eng. & Systems 2021-06-22 Vijay Veerabadran , Reza Pourreza , Amirhossein Habibian , Taco Cohen

Sparsity-based tensor recovery methods have shown great potential in suppressing seismic data noise. These methods exploit tensor sparsity measures capturing the low-dimensional structures inherent in seismic data tensors to remove noise by…

Computer Vision and Pattern Recognition · Computer Science 2025-02-21 Sirui Pan , Zhiyuan Zha , Shigang Wang , Yue Li , Zipei Fan , Gang Yan , Binh T. Nguyen , Bihan Wen , Ce Zhu

Storage systems often rely on multiple copies of the same compressed data, enabling recovery in case of binary data errors, of course, at the expense of a higher storage cost. In this paper we show that a wiser method of duplication entails…

Multimedia · Computer Science 2019-02-08 Yehuda Dar , Alfred M. Bruckstein

Dithering is a technique commonly used to improve the perceptual quality of lossy data compression. In this work, we analytically and experimentally justify the use of dithering for ASR input compression. We formalize an understanding of…

Audio and Speech Processing · Electrical Eng. & Systems 2025-12-12 Ellison Murray , Morriel Kasher , Predrag Spasojevic

As the modern world becomes increasingly digitized and interconnected, distributed signal processing has proven to be effective in processing its large volume of data. However, a main challenge limiting the broad use of distributed signal…

Signal Processing · Electrical Eng. & Systems 2020-10-23 Qiongxiu Li , Richard Heusdens , Mads Græsbøll Christensen

We propose a unified signal compression framework that uses a generative adversarial network (GAN) to compress heterogeneous signals. The compressed signal is represented as a latent vector and fed into a generator network that is trained…

Signal Processing · Electrical Eng. & Systems 2021-09-24 Bowen Liu , Changwoo Lee , Ang Cao , Hun-Seok Kim

Consider a lossy compression system with $\ell$ distributed encoders and a centralized decoder. Each encoder compresses its observed source and forwards the compressed data to the decoder for joint reconstruction of the target signals under…

Information Theory · Computer Science 2018-07-19 Yizhong Wang , Li Xie , Xuan Zhang , Jun Chen