English
Related papers

Related papers: LiQSS: Post-Transformer Linear Quantum-Inspired St…

200 papers

Time series data is ubiquitous in research as well as in a wide variety of industrial applications. Effectively analyzing the available historical data and providing insights into the far future allows us to make effective decisions. Recent…

Machine Learning · Computer Science 2022-10-24 Kiran Madhusudhanan , Johannes Burchert , Nghia Duong-Trung , Stefan Born , Lars Schmidt-Thieme

Structured state space sequence (S4) models have recently achieved state-of-the-art performance on long-range sequence modeling tasks. These models also have fast inference speeds and parallelisable training, making them potentially useful…

Machine Learning · Computer Science 2023-11-27 Chris Lu , Yannick Schroecker , Albert Gu , Emilio Parisotto , Jakob Foerster , Satinder Singh , Feryal Behbahani

Terahertz (THz) communications, ranging from 100 GHz to 10 THz, are envisioned as a promising technology for 6G and beyond wireless systems. As foundation of designing THz communications, channel modeling and characterization are crucial to…

Signal Processing · Electrical Eng. & Systems 2024-07-26 Zhengdong Hu , Yuanbo Li , Chong Han

The attention operator is arguably the key distinguishing factor of transformer architectures, which have demonstrated state-of-the-art performance on a variety of tasks. However, transformer attention operators often impose a significant…

Machine Learning · Computer Science 2024-12-24 Ziyang Wu , Tianjiao Ding , Yifu Lu , Druv Pai , Jingyuan Zhang , Weida Wang , Yaodong Yu , Yi Ma , Benjamin D. Haeffele

Reconfigurable intelligent surfaces (RISs) are considered as potential technologies for the upcoming sixth-generation (6G) wireless communication system. Various benefits brought by deploying one or multiple RISs include increased spectrum…

Signal Processing · Electrical Eng. & Systems 2021-04-16 Jiguang He , Nhan Thanh Nguyen , Rafaela Schroeder , Visa Tapio , Joonas Kokkoniemi , Markku Juntti

The evolution toward Level 4 (L4) Autonomous Networks (AN) represents a strategic inflection point in telecommunications, where networks must transcend reactive automation to achieve genuine cognitive capabilities--fulfilling TM Forum's…

Artificial Intelligence · Computer Science 2026-02-02 Binghan Wu , Shoufeng Wang , Yunxin Liu , Ya-Qin Zhang , Joseph Sifakis , Ye Ouyang

Visual generation quality has been greatly promoted with the rapid advances in diffusion transformers (DiTs), which is attributed to the scaling of model size and complexity. However, these attributions also hinder the practical deployment…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Kai Liu , Shaoqiu Zhang , Linghe Kong , Yulun Zhang

The high frequency communication bands (mmWave and sub-THz) promise tremendous data rates, however, they also have very high power consumption which is particularly significant for battery-power-limited user-equipment (UE). In this context,…

Signal Processing · Electrical Eng. & Systems 2023-08-22 Brijesh Soni , Siddhartan Govindasamy , Dhaval K. Patel

Reconfigurable intelligent surfaces (RISs) represent a promising candidate for sixth-generation (6G) wireless networks, as the RIS technology provides a new solution to control the propagation channel in order to improve the efficiency of a…

Information Theory · Computer Science 2022-08-15 Mohamad H. Dinan , Nemanja Stefan Perovic , Mark F. Flanagan

The march towards 6G is accelerating and future wireless network architectures require enhanced performance along with significant coverage especially, to combat impairments on account of the wireless channel. Reconfigurable intelligent…

Signal Processing · Electrical Eng. & Systems 2023-08-16 Emre Arslan , Fatih Kilinc , Ertugrul Basar , Huseyin Arslan

Reconfigurable Intelligent Surfaces (RIS) have received significant attention recently as an innovation for enhanced connectivity, capacity, and energy efficiency in future wireless networks. Recent works indicate that such RIS-augmented…

Signal Processing · Electrical Eng. & Systems 2021-10-11 Akbar Sayeed

A potential 6G technology known as intelligent reflecting surface (IRS) has recently gained much attention from academia and industry. However, acquiring the optimized quantized phase shift (QPS) presents challenges for the IRS due to the…

Signal Processing · Electrical Eng. & Systems 2023-05-12 Xianhua Yu , Dong Li

In wireless communications, efficient image transmission must balance reliability, throughput, and latency, especially under dynamic channel conditions. This paper presents an adaptive and progressive pipeline for learned image compression…

Signal Processing · Electrical Eng. & Systems 2024-11-19 Mostafa Naseri , Pooya Ashtari , Mohamed Seif , Eli De Poorter , H. Vincent Poor , Adnan Shahid

Transformers are state-of-the-art networks for most sequence processing tasks. However, the self-attention mechanism often used in Transformers requires large time windows for each computation step and thus makes them less suitable for…

Neural and Evolutionary Computing · Computer Science 2023-03-22 Nathan Leroux , Jan Finkbeiner , Emre Neftci

Tensor networks establish an adaptable framework for the emulation of quantum circuits. By partitioning exponentially large registers and gates into smaller tensors, this unlocks fast transformations through tensor algebra, and grants fine…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-13 Jakub Adamski , Oliver Thomson Brown

With the increasing complexity of generative AI models, post-training quantization (PTQ) has emerged as a promising solution for deploying hyper-scale models on edge devices such as mobile and TVs. Existing PTQ schemes, however, consume…

Machine Learning · Computer Science 2024-11-06 Junhan Kim , Chungman Lee , Eulrang Cho , Kyungphil Park , Ho-young Kim , Joonyoung Kim , Yongkweon Jeon

Accurate channel modeling is essential for realizing the potential of terahertz (THz) communications in 6G indoor networks, where existing models struggle with severe frequency selectivity and multipath effects. We propose a physically…

Signal Processing · Electrical Eng. & Systems 2025-10-07 Ziang Zhao , Weixi Liang , Kai Hu , Qun Zhang , Xiongbin Yu , Qiang Li

In pursuit of faster computation, Efficient Transformers demonstrate an impressive variety of approaches -- models attaining sub-quadratic attention complexity can utilize a notion of sparsity or a low-rank approximation of inputs to reduce…

Machine Learning · Computer Science 2022-11-09 Uladzislau Yorsh , Alexander Kovalenko

We study the performance of transformer architectures for multivariate time-series forecasting in low-data regimes consisting of only a few years of daily observations. Using synthetically generated processes with known temporal and…

Machine Learning · Computer Science 2026-02-11 Cyril Garcia , Guillaume Remy

Next-generation wireless networks require intelligent traffic prediction to enable autonomous resource management and handle diverse, dynamic service demands. The Open Radio Access Network (O-RAN) framework provides a promising foundation…

Signal Processing · Electrical Eng. & Systems 2025-10-02 Abdelaziz Salama , Mohammed M. H. Qazzaz , Zeinab Nezami , Maryam Hafeez , Syed Ali Raza Zaidi