English
Related papers

Related papers: Towards efficient feature sharing in MIMO architec…

200 papers

Hard parameter sharing in multi-domain learning (MDL) allows domains to share some of the model parameters to reduce storage cost while improving prediction accuracy. One common sharing practice is to share the bottom layers of a deep…

Machine Learning · Computer Science 2022-03-22 Lijun Zhang , Qizheng Yang , Xiao Liu , Hui Guan

The width of a neural network matters since increasing the width will necessarily increase the model capacity. However, the performance of a network does not improve linearly with the width and soon gets saturated. In this case, we argue…

Computer Vision and Pattern Recognition · Computer Science 2022-09-07 Shuai Zhao , Liguang Zhou , Wenxiao Wang , Deng Cai , Tin Lun Lam , Yangsheng Xu

Parameter sharing is a key strategy in multi-agent reinforcement learning (MARL) for improving scalability, yet conventional fully shared architectures often collapse into homogeneous behaviors. Recent methods introduce diversity through…

Multiagent Systems · Computer Science 2026-02-09 Kyungbeom Kim , Seungwon Oh , Kyung-Joong Kim

Transformers have shown improved performance when compared to previous architectures for sequence processing such as RNNs. Despite their sizeable performance gains, as recently suggested, the model is computationally expensive to train and…

Computation and Language · Computer Science 2021-09-09 Machel Reid , Edison Marrese-Taylor , Yutaka Matsuo

Deep convolutional neural networks (CNNs) have shown state-of-the-art performances in various computer vision tasks. Advances on CNN architectures have focused mainly on designing convolutional blocks of the feature extractors, but less on…

Computer Vision and Pattern Recognition · Computer Science 2022-07-20 Jaemin Lee , Minseok Seo , Jongchan Park , Dong-Geol Choi

This paper describes a radio architecture for distributed spectrum sharing of multiple channels among secondary users (SUs) in a wide band of frequencies and a localized area. A novel Multichannel Immediate Multiple Access (MIMA) physical…

Information Theory · Computer Science 2017-02-10 Mingming Cai , J. Nicholas Laneman

Complicated and deep neural network models can achieve high accuracy for image recognition. However, they require a huge amount of computations and model parameters, which are not suitable for mobile and embedded devices. Therefore,…

Computer Vision and Pattern Recognition · Computer Science 2019-06-14 Hong-Yen Chen , Chung-Yen Su

A novel dynamic hybrid beamforming architecture is proposed to achieve the spatial multiplexing-power consumption tradeoff for near-field multiple-input multiple-output (MIMO) networks, where each radio frequency (RF) chain is connected to…

Information Theory · Computer Science 2023-12-27 Zheng Zhang , Yuanwei Liu , Zhaolin Wang , Jian Chen , Tony Q. S. Quek

Parameter sharing has proven to be a parameter-efficient approach. Previous work on Transformers has focused on sharing parameters in different layers, which can improve the performance of models with limited parameters by increasing model…

Machine Learning · Computer Science 2023-06-19 Ye Lin , Mingxuan Wang , Zhexi Zhang , Xiaohui Wang , Tong Xiao , Jingbo Zhu

Availability of labelled data is the major obstacle to the deployment of deep learning algorithms for computer vision tasks in new domains. The fact that many frameworks adopted to solve different tasks share the same architecture suggests…

Computer Vision and Pattern Recognition · Computer Science 2023-01-27 Pierluigi Zama Ramirez , Adriano Cardace , Luca De Luigi , Alessio Tonioni , Samuele Salti , Luigi Di Stefano

This paper takes a new look at Cell-free Massive MIMO (multiple-input multiple-output) through the lens of the dynamic cooperation cluster framework from the Network MIMO literature. The purpose is to identify and address scalability issues…

Information Theory · Computer Science 2019-06-27 Emil Björnson , Luca Sanguinetti

Overparameterization, the condition where models have more parameters than necessary to fit their training loss, is a crucial factor for the success of deep learning. However, the characteristics of the features learned by overparameterized…

Machine Learning · Computer Science 2024-07-02 Ahmet Cagri Duzgun , Samy Jelassi , Yuanzhi Li

Industry and academia have been working towards the evolution from Centralized massive Multiple-Input Multiple-Output (CmMIMO) to Distributed mMIMO (DmMIMO) architectures. Instead of splitting a coverage area into many cells, each served by…

Information Theory · Computer Science 2023-09-12 Eduardo Noboro Tominaga , Hsuan-Jung Su , Jinfeng Du , Sivarama Venkatesan , Richard Demo Souza , Hirley Alves

A family of recent successful approaches to few-shot learning relies on learning an embedding space in which predictions are made by computing similarities between examples. This corresponds to combining information between support and…

Machine Learning · Computer Science 2018-12-04 Hugo Prol , Vincent Dumoulin , Luis Herranz

Multiple-input multiple-output (MIMO) radar is one of the leading depth sensing modalities. However, the usage of multiple receive channels lead to relative high costs and prevent the penetration of MIMOs in many areas such as the…

Signal Processing · Electrical Eng. & Systems 2021-10-08 Tomer Weiss , Nissim Peretz , Sanketh Vedula , Arie Feuer , Alex Bronstein

The performance of irregular phased array architectures is assessed in the context of multi-user multiple-input multiple-output (MU-MIMO) communications operating beyond 100 GHz. Realizing half-wavelength spaced planar phased arrays is…

Signal Processing · Electrical Eng. & Systems 2025-09-30 Yigit Ertugrul , Kamil Yavuz Kapusuz , Claude Desset , Sofie Pollin

This paper proposes a novel learning method for multi-task applications. Multi-task neural networks can learn to transfer knowledge across different tasks by using parameter sharing. However, sharing parameters between unrelated tasks can…

Machine Learning · Computer Science 2020-07-21 Krzysztof Maziarz , Efi Kokiopoulou , Andrea Gesmundo , Luciano Sbaiz , Gabor Bartok , Jesse Berent

Next-generation mobile networks are expected to facilitate fast AI model downloading to end users. By caching models on edge servers, mobile networks can deliver models to end users with low latency, resulting in a paradigm called edge…

Networking and Internet Architecture · Computer Science 2024-05-21 Guanqiao Qu , Zheng Lin , Fangming Liu , Xianhao Chen , Kaibin Huang

Hybrid beamforming is a promising technology to improve the energy efficiency of massive MIMO systems. In particular, subarray hybrid beamforming can further decrease power consumption by reducing the number of phase-shifters. However,…

Information Theory · Computer Science 2022-08-11 Hamed Hojatian , Jérémy Nadal , Jean-François Frigon , François Leduc-Primeau

This paper investigates the extent to which spectrum sharing in mmWave networks with multiple cellular operators is a viable alternative to traditional dedicated spectrum allocation. Specifically, we develop a general mathematical framework…

Information Theory · Computer Science 2016-10-04 Hossein Shokri-Ghadikolaei , Federico Boccardi , Carlo Fischione , Gabor Fodor , Michele Zorzi