English
Related papers

Related papers: Permutation-Invariant Transformer Neural Architect…

200 papers

In this paper, we present a Neural Network (NN) model based on Neural Architecture Search (NAS) and self-learning for received signal strength (RSS) map reconstruction out of sparse single-snapshot input measurements, in the case where…

Machine Learning · Computer Science 2021-05-18 Aleksandra Malkova , Loic Pauletto , Christophe Villien , Benoit Denis , Massih-Reza Amini

In this paper, we describe a conceptual design methodology to design distributed neural network architectures that can perform efficient inference within sensor networks with communication bandwidth constraints. The different sensor…

Machine Learning · Computer Science 2022-10-17 Thomas Strypsteen , Alexander Bertrand

With the rising prominence of WiFi in common spaces, efforts have been made in the robotics community to take advantage of this fact by incorporating WiFi signal measurements in indoor SLAM (Simultaneous Localization and Mapping) systems.…

Robotics · Computer Science 2024-03-05 Junseo Kim , Jill Aghyourli Zalat , Yeganeh Bahoo , Sajad Saeedi

Since self-attention layers in Transformers are permutation invariant by design, positional encodings must be explicitly incorporated to enable spatial understanding. However, fixed-size lookup tables used in traditional learnable position…

Machine Learning · Computer Science 2025-06-18 Huayang Li , Yahui Liu , Hongyu Sun , Deng Cai , Leyang Cui , Wei Bi , Peilin Zhao , Taro Watanabe

We present a neural network architecture designed to naturally learn a positional embedding and overcome the spectral bias towards lower frequencies faced by conventional activation functions. Our proposed architecture, SPDER, is a simple…

Computer Vision and Pattern Recognition · Computer Science 2026-01-15 Kathan Shah , Chawin Sitawarin

Transformer has shown promising results in many sequence to sequence transformation tasks recently. It utilizes a number of feed-forward self-attention layers to replace the recurrent neural networks (RNN) in attention-based encoder decoder…

Computation and Language · Computer Science 2020-12-01 Pan Zhou , Ruchao Fan , Wei Chen , Jia Jia

Many works have investigated radio map and path loss prediction in wireless networks using deep learning, in particular using convolutional neural networks. However, most assume perfect environment information, which is unrealistic in…

Signal Processing · Electrical Eng. & Systems 2026-02-13 Fabian Jaensch , Çağkan Yapar , Giuseppe Caire , Begüm Demir

When deploying neural networks in real-life situations, the size and computational effort are often the limiting factors. This is especially true in environments where big, expensive hardware is not affordable, like in embedded medical…

Image and Video Processing · Electrical Eng. & Systems 2024-03-11 Erik Ostrowski , Muhammad Shafique

We present a low complexity experimental RF-based indoor localization system based on the collection and processing of WiFi RSSI signals and processing using a RSS-based multi-lateration algorithm to determine a robotic mobile node's…

Networking and Internet Architecture · Computer Science 2016-10-25 Ahmed Abdelhadi , Felipe Rechia , Arvind Narayanan , Thiago Teixeira , Ricardo Lent , Driss Benhaddou , Hyunwoo Lee , T. Charles Clancy

Latent representations learned by neural networks often exhibit semantic structure, where concept similarity is reflected by geometric proximity in embedding space. However, comparing such spaces across models remains difficult: changes in…

An accurate room localization system is a powerful tool for providing location-based services. Considering that people spend most of their time indoors, indoor localization systems are becoming increasingly important in designing smart…

Networking and Internet Architecture · Computer Science 2018-04-25 Jose Luis Carrera V. , Zhongliang Zhao , Torsten Braun

Understanding how neural representations respond to geometric transformations is essential for evaluating whether learned features preserve meaningful spatial structure. Existing approaches primarily assess robustness primarily by comparing…

Machine Learning · Computer Science 2026-05-12 Huahua Lin , Katayoun Farrahi , Xiaohao Cai

Wireless indoor localization using predictive models with received signal strength information (RSSI) requires proper calibration for reliable position estimates. One remedy is to employ synthetic labels produced by a (generally different)…

Machine Learning · Computer Science 2026-05-22 Seonghoon Yoo , Houssem Sifaou , Sangwoo Park , Joonhyuk Kang , Osvaldo Simeone

Embedding of large but redundant data, such as images or text, in a hierarchy of lower-dimensional spaces is one of the key features of representation learning approaches, which nowadays provide state-of-the-art solutions to problems once…

Computer Vision and Pattern Recognition · Computer Science 2022-06-13 Gianluca Berardi , Luca De Luigi , Samuele Salti , Luigi Di Stefano

This letter investigates an uplink pilot-based wireless indoor localization problem in a multipath environment for a single-input single-output (SISO) narrowband communication system aided by reconfigurable intelligent surface (RIS). The…

Signal Processing · Electrical Eng. & Systems 2024-07-10 Yinghan Li , Wei Yu

Multiple-input multiple-output (MIMO) is an enabling technology to meet the growing demand for faster and more reliable communications in wireless networks with a large number of terminals, but it can also be applied for position estimation…

Signal Processing · Electrical Eng. & Systems 2021-08-06 Gregor Cerar , Aleš Švigelj , Mihael Mohorčič , Carolina Fortuna , Tomaž Javornik

In learning-to-rank for information retrieval, a ranking model is automatically learned from the data and then utilized to rank the sets of retrieved documents. Therefore, an ideal ranking model would be a mapping from a document set to a…

Information Retrieval · Computer Science 2020-05-08 Liang Pang , Jun Xu , Qingyao Ai , Yanyan Lan , Xueqi Cheng , Jirong Wen

Transformers have emerged as viable alternatives to convolutional neural networks owing to their ability to learn non-local region relationships in the spatial domain. The self-attention mechanism of the transformer enables transformers to…

Image and Video Processing · Electrical Eng. & Systems 2023-08-09 Rahul G. S. , Sriprabha Ramnarayanan , Mohammad Al Fahim , Keerthi Ram , Preejith S. P , Mohanasankar Sivaprakasam

We present a neural network architecture for jointly learning user locations and environment mapping up to isometry, in an unsupervised way, from channel state information (CSI) values with no location information. The model is based on an…

Information Theory · Computer Science 2022-03-17 Shreya Kadambi , Arash Behboodi , Joseph B. Soriaga , Max Welling , Roohollah Amiri , Srinivas Yerramalli , Taesang Yoo

A Machine Learning (ML) network based on transfer learning and transformer networks is applied to wave propagation models for complex indoor settings. This network is designed to predict signal propagation in environments with a variety of…

Signal Processing · Electrical Eng. & Systems 2025-01-28 Ziheng Fu , Swagato Mukherjee , Michael T. Lanagan , Prasenjit Mitra , Tarun Chawla , Ram M. Narayanan