English
Related papers

Related papers: Relative Phase Equivariant Deep Neural Systems for…

200 papers

We present the group equivariant conditional neural process (EquivCNP), a meta-learning method with permutation invariance in a data set as in conventional conditional neural processes (CNPs), and it also has transformation equivariance in…

Machine Learning · Computer Science 2021-02-18 Makoto Kawano , Wataru Kumagai , Akiyoshi Sannai , Yusuke Iwasawa , Yutaka Matsuo

Federated Learning offers a way to train deep neural networks in a distributed fashion. While this addresses limitations related to distributed data, it incurs a communication overhead as the model parameters or gradients need to be…

Machine Learning · Computer Science 2023-05-26 Morten From Elvebakken , Alexandros Iosifidis , Lukas Esterle

Deep learning has solved many problems that are out of reach of heuristic algorithms. It has also been successfully applied in wireless communications, even though the current radio systems are well-understood and optimal algorithms exist…

Signal Processing · Electrical Eng. & Systems 2021-01-13 Mikko Honkala , Dani Korpi , Janne M. J. Huttunen

Equivariant neural networks incorporate symmetries through group actions, embedding them as an inductive bias to improve performance. Existing methods learn an equivariant action on the latent space, or design architectures that are…

Machine Learning · Computer Science 2026-05-19 Riccardo Ali , Pietro Liò , Jamie Vicary

We propose a novel method for interpreting neural networks, focusing on convolutional neural network-based receiver model. The method identifies which unit or units of the model contain most (or least) information about the channel…

Machine Learning · Computer Science 2025-05-26 Marko Tuononen , Dani Korpi , Ville Hautamäki

Recently, deep learning has been proposed as a potential technique for improving the physical layer performance of radio receivers. Despite the large amount of encouraging results, most works have not considered spatial multiplexing in the…

Signal Processing · Electrical Eng. & Systems 2020-11-02 Dani Korpi , Mikko Honkala , Janne M. J. Huttunen , Vesa Starck

The translation equivariance of convolutional layers enables convolutional neural networks to generalize well on image problems. While translation equivariance provides a powerful inductive bias for images, we often additionally desire…

Machine Learning · Statistics 2020-09-25 Marc Finzi , Samuel Stanton , Pavel Izmailov , Andrew Gordon Wilson

Most current deep learning models equivariant to $O(n)$ or $SO(n)$ either consider mostly scalar information such as distances and angles or have a very high computational complexity. In this work, we test a few novel message passing graph…

Machine Learning · Computer Science 2024-07-11 Cong Liu , David Ruhe , Patrick Forré

Deep-learning recently show great success across disciplines yet conventionally require time-consuming computer processing or bulky-sized diffractive elements. Here we theoretically propose and experimentally demonstrate a purely-passive…

Neural and Evolutionary Computing · Computer Science 2021-01-27 Jingkai Weng , Yujiang Ding , Chengbo Hu , Xue-feng Zhu , Bin Liang , Jing Yang , Jianchun Cheng

Incorporating group symmetries via equivariance into neural networks has emerged as a robust approach for overcoming the efficiency and data demands of modern deep learning. While most existing approaches, such as group convolutions and…

Simulation-based inference with conditional neural density estimators is a powerful approach to solving inverse problems in science. However, these methods typically treat the underlying forward model as a black box, with no way to exploit…

Machine Learning · Computer Science 2023-05-31 Maximilian Dax , Stephen R. Green , Jonathan Gair , Michael Deistler , Bernhard Schölkopf , Jakob H. Macke

Based on the tree architecture, the objective of this paper is to design deep neural networks with two or more hidden layers (called deep nets) for realization of radial functions so as to enable rotational invariance for near-optimal…

Machine Learning · Computer Science 2019-04-04 Charles K. Chui , Shao-Bo Lin , Ding-Xuan Zhou

Equivariant machine learning is an approach for designing deep learning models that respect the symmetries of the problem, with the aim of reducing model complexity and improving generalization. In this paper, we focus on an extension of…

Machine Learning · Computer Science 2024-12-10 Ya-Wei Eileen Lin , Ronen Talmon , Ron Levie

Convolutions encode equivariance symmetries into neural networks leading to better generalisation performance. However, symmetries provide fixed hard constraints on the functions a network can represent, need to be specified in advance, and…

Machine Learning · Computer Science 2023-10-11 Tycho F. A. van der Ouderaa , Alexander Immer , Mark van der Wilk

Triangular meshes are widely used to represent three-dimensional objects. As a result, many recent works have address the need for geometric deep learning on 3D mesh. However, we observe that the complexities in many of these architectures…

Machine Learning · Computer Science 2024-02-20 Thuan Trang , Nhat Khang Ngo , Daniel Levy , Thieu N. Vo , Siamak Ravanbakhsh , Truong Son Hy

We propose a deep-learning approach for the joint MIMO detection and channel decoding problem. Conventional MIMO receivers adopt a model-based approach for MIMO detection and channel decoding in linear or iterative manners. However, due to…

Information Theory · Computer Science 2019-01-18 Taotao Wang , Lihao Zhang , Soung Chang Liew

Deep learning is driving a radical paradigm shift in wireless communications, all the way from the application layer down to the physical layer. Despite this, there is an ongoing debate as to what additional values artificial intelligence…

Signal Processing · Electrical Eng. & Systems 2019-09-18 S. Xue , A. Li , J. Wang , N. Yi , Y. Ma , R. Tafazolli , T. Dodgson

In this paper, we present a novel framework for enhancing the performance of Quanvolutional Neural Networks (QuNNs) by introducing trainable quanvolutional layers and addressing the critical challenges associated with them. Traditional…

Machine Learning · Computer Science 2025-07-18 Muhammad Kashif , Muhammad Shafique

Wireless communication systems exhibit structural and functional similarities to neural networks: signals propagate through cascaded elements, interact with the environment, and undergo transformations. Building upon this perspective, we…

Signal Processing · Electrical Eng. & Systems 2026-02-17 Meng Hua , Itsik Bergel , Tolga Girici , Marco Di Renzo , Deniz Gunduz

How can prior knowledge on the transformation invariances of a domain be incorporated into the architecture of a neural network? We propose Equivariant Transformers (ETs), a family of differentiable image-to-image mappings that improve the…

Computer Vision and Pattern Recognition · Computer Science 2019-05-28 Kai Sheng Tai , Peter Bailis , Gregory Valiant