English
Related papers

Related papers: Remote Multilinear Compressive Learning with Adapt…

200 papers

Deep learning accelerators efficiently train over vast and growing amounts of data, placing a newfound burden on commodity networks and storage devices. A common approach to conserve bandwidth involves resizing or compressing data prior to…

Machine Learning · Computer Science 2021-08-13 Michael Kuchnik , George Amvrosiadis , Virginia Smith

Autoencoder-based structures have dominated recent learned image compression methods. However, the inherent information loss associated with autoencoders limits their rate-distortion performance at high bit rates and restricts their…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Hanyue Tu , Siqi Wu , Li Li , Wengang Zhou , Houqiang Li

Compressive sensing (CS) is a mathematically elegant tool for reducing the sampling rate, potentially bringing context-awareness to a wider range of devices. Nevertheless, practical issues with the sampling and reconstruction algorithms…

Signal Processing · Electrical Eng. & Systems 2021-05-28 Alina L. Machidon , Veljko Pejovic

In frequency division duplexing (FDD) massive multiple-input multiple-output (MIMO) systems, downlink channel state information (CSI) plays a crucial role in achieving high spectrum and energy efficiency. However, the CSI feedback overhead…

Information Theory · Computer Science 2026-01-13 Zijiu Yang , Qianqian Yang , Shunpu Tang , Tingting Yang , Zhiguo Shi

On-device machine learning (ML) promises to improve the privacy, responsiveness, and proliferation of new, intelligent user experiences by moving ML computation onto everyday personal devices. However, today's large ML models must be…

Human-Computer Interaction · Computer Science 2024-04-05 Fred Hohman , Mary Beth Kery , Donghao Ren , Dominik Moritz

Compressive sensing (CS) has been studied and applied in structural health monitoring for wireless data acquisition and transmission, structural modal identification, and spare damage identification. The key issue in CS is finding the…

Signal Processing · Electrical Eng. & Systems 2019-03-25 Yuequan Bao , Zhiyi Tang , Hui Li

Agentic language model (LM) systems power modern applications like "Deep Research" and "Claude Code," and leverage multi-LM architectures to overcome context limitations. Beneath their apparent diversity lies a recurring pattern: smaller…

Machine Learning · Computer Science 2025-12-29 Shizhe He , Avanika Narayan , Ishan S. Khare , Scott W. Linderman , Christopher Ré , Dan Biderman

We develop a new approach to tackle communication constraints in a distributed learning problem with a central server. We propose and analyze a new algorithm that performs bidirectional compression and achieves the same convergence rate as…

Machine Learning · Computer Science 2022-06-17 Constantin Philippenko , Aymeric Dieuleveut

Compressed sensing is a paradigm within signal processing that provides the means for recovering structured signals from linear measurements in a highly efficient manner. Originally devised for the recovery of sparse signals, it has become…

Information Theory · Computer Science 2021-12-09 Jens Eisert , Axel Flinth , Benedikt Groß , Ingo Roth , Gerhard Wunder

Many machine learning frameworks have been proposed and used in wireless communications for realizing diverse goals. However, their incapability of adapting to the dynamic wireless environment and tasks and of self-learning limit their…

Artificial Intelligence · Computer Science 2021-06-02 Qihui Wu , Tianchen Ruan , Fuhui Zhou , Yang Huang , Fan Xu , Shijin Zhao , Ya Liu , Xuyang Huang

Federated learning is a rapidly-growing area of research which enables a large number of clients to jointly train a machine learning model on privately-held data. One of the largest barriers to wider adoption of federated learning is the…

Machine Learning · Computer Science 2021-12-07 Luke Melas-Kyriazi , Franklyn Wang

When dealing with real-world optimization problems, decision-makers usually face high levels of uncertainty associated with partial information, unknown parameters, or complex relationships between these and the problem decision variables.…

Optimization and Control · Mathematics 2023-05-01 Antonio Alcántara , Carlos Ruiz

The increasing prevalence of large language models (LLMs) such as GPT-4 in various applications has led to a surge in the size of prompts required for optimal performance, leading to challenges in computational efficiency. Prompt…

Computation and Language · Computer Science 2024-12-19 Shivam Shandilya , Menglin Xia , Supriyo Ghosh , Huiqiang Jiang , Jue Zhang , Qianhui Wu , Victor Rühle

The recent advances in machine learning and deep neural networks have made them attractive candidates for wireless communications functions such as channel estimation, decoding, and downlink channel state information (CSI) compression.…

Networking and Internet Architecture · Computer Science 2023-11-15 Omar Erak , Hatem Abou-Zeid

Tensors offer a natural representation for many kinds of data frequently encountered in machine learning. Images, for example, are naturally represented as third order tensors, where the modes correspond to height, width, and channels.…

Machine Learning · Computer Science 2017-06-05 Jean Kossaifi , Aran Khanna , Zachary C. Lipton , Tommaso Furlanello , Anima Anandkumar

The field of neural image compression has witnessed exciting progress as recently proposed architectures already surpass the established transform coding based approaches. While, so far, research has mainly focused on architecture and model…

Computer Vision and Pattern Recognition · Computer Science 2019-06-06 Joaquim Campos , Simon Meierhans , Abdelaziz Djelouah , Christopher Schroers

Communication efficiency is of importance for wireless federated learning systems. In this paper, we propose a communication-efficient strategy for federated learning over multiple-input multiple-output (MIMO) multiple access channels…

Information Theory · Computer Science 2022-06-14 Yo-Seb Jeon , Mohammad Mohammadi Amiri , Namyoon Lee

Overparameterized models have proven to be powerful tools for solving various machine learning tasks. However, overparameterization often leads to a substantial increase in computational and memory costs, which in turn requires extensive…

Machine Learning · Computer Science 2024-03-13 Soo Min Kwon , Zekai Zhang , Dogyoon Song , Laura Balzano , Qing Qu

In this paper, a novel framework is proposed to optimize the downlink multi-user communication of a millimeter wave base station, which is assisted by a reconfigurable intelligent reflector (IR). In particular, a channel estimation approach…

Information Theory · Computer Science 2021-08-03 Qianqian Zhang , Walid Saad , Mehdi Bennis

Exploiting channel sparsity at millimeter wave (mmWave) frequencies reduces the high training overhead associated with the channel estimation stage. Compressive sensing (CS) channel estimation techniques usually adopt the (overcomplete)…

Information Theory · Computer Science 2019-09-23 Hongxiang Xie , Javier Rodríguez-Fernández , Nuria González-Prelcic