English
Related papers

Related papers: Extending the Lora modulation to add further paral…

200 papers

Diffusion models, such as Stable Diffusion (SD), offer the ability to generate high-resolution images with diverse features, but they come at a significant computational and memory cost. In classifier-free guided diffusion models, prolonged…

Computer Vision and Pattern Recognition · Computer Science 2023-12-13 Pareesa Ameneh Golnari

Due to the demand for efficient fine-tuning of large language models, Low-Rank Adaptation (LoRA) has been widely adopted as one of the most effective parameter-efficient fine-tuning methods. Nevertheless, while LoRA improves efficiency,…

Computation and Language · Computer Science 2025-06-13 Naibin Gu , Zhenyu Zhang , Xiyu Liu , Peng Fu , Zheng Lin , Shuohuan Wang , Yu Sun , Hua Wu , Weiping Wang , Haifeng Wang

Low-Rank Adaptation (LoRA) fine-tunes large models by learning low-rank updates on top of frozen weights, dramatically reducing trainable parameters and memory. However, there is still a gap between full training with low-rank projections…

Multiplexing services as a key communication technique to effectively combine multiple signals into one signal and transmit over a shared medium. Multiplexing can increase the channel capacity by requiring more resources on the transmission…

Information Theory · Computer Science 2017-12-27 Chunlin Ji , Ruopeng Liu

LoRaWAN is a prominent communication standard to enable reliable low-power, long-range communications for the Internet of Things (IoT). The modulation technique used in LoRaWAN, commonly known as LoRa modulation, is based on the principle…

Signal Processing · Electrical Eng. & Systems 2021-05-07 Tung T. Nguyen , Ha H. Nguyen

Low-Rank Adaptation (LoRA) is a widely used parameter-efficient fine-tuning method for foundation models, but it suffers from parameter interference, resulting in suboptimal performance. Although Mixture-of-Experts (MoE)-based LoRA variants…

Machine Learning · Computer Science 2025-10-24 Heming Zou , Yunliang Zang , Wutong Xu , Yao Zhu , Xiangyang Ji

Long Range (LoRa) is a wireless communication technology for the Internet of Things (IoT), able to provide wide coverage networking to devices with low power consumption and low data-rate. This paper~proposes and describes a simulation…

Networking and Internet Architecture · Computer Science 2018-12-05 Yifan Du

A modular method was suggested before to recover a band limited signal from the sample and hold and linearly interpolated (or, in general, an nth-order-hold) version of the regular samples. In this paper a novel approach for compensating…

Computer Vision and Pattern Recognition · Computer Science 2012-05-15 Mohammad Tofighi , Ali Ayremlou , Farokh Marvasti

LoRa technology, crucial for low-power wide-area networks, faces significant performance degradation at extremely low signal-to-noise ratios (SNRs). We present LoRaFlow, a novel approach using rectified flow to reconstruct high-quality LoRa…

Signal Processing · Electrical Eng. & Systems 2025-01-03 Mohamed Osman , Tamer Nadeem

Low-Rank Adaptation~(LoRA), which updates the dense neural network layers with pluggable low-rank matrices, is one of the best performed parameter efficient fine-tuning paradigms. Furthermore, it has significant advantages in cross-task…

Machine Learning · Computer Science 2024-10-25 Yuren Mao , Yuhang Ge , Yijiang Fan , Wenyi Xu , Yu Mi , Zhonghao Hu , Yunjun Gao

Will Multi-Link Operation (MLO) be able to improve the latency of Wi-Fi networks? MLO is one of the most disruptive MAC-layer techniques included in the IEEE 802.11be amendment. It allows a device to use multiple radios simultaneously and…

Networking and Internet Architecture · Computer Science 2021-11-19 Marc Carrascosa , Giovanni Geraci , Edward Knightly , Boris Bellalta

The Internet of Things (IoT) revolution demands scalable, energy-efficient communication protocols supporting widespread device deployments. The LoRa technology, coupled with the LoRaWAN protocol, has emerged as a leading Low Power Wide…

Networking and Internet Architecture · Computer Science 2025-04-02 Riccardo Marini , Giampaolo Cuozzo

LoRA employs lightweight modules to customize large language models (LLMs) for each downstream task or domain, where different learned additional modules represent diverse skills. Combining existing LoRAs to address new tasks can enhance…

Computation and Language · Computer Science 2024-02-20 Hanqing Wang , Bowen Ping , Shuo Wang , Xu Han , Yun Chen , Zhiyuan Liu , Maosong Sun

This paper presents a novel methodology of fine-tuning for large language models-dynamic LoRA. Building from the standard Low-Rank Adaptation framework, this methodology further adds dynamic adaptation mechanisms to improve efficiency and…

Computation and Language · Computer Science 2025-01-28 Xiaoxuan Liao , Chihang Wang , Shicheng Zhou , Jiacheng Hu , Hongye Zheng , Jia Gao

An important modulation technique for Internet of Things (IoT) is the one proposed by the LoRa allianceTM. In this paper we analyze the M-ary LoRa modulation in the time and frequency domains. First, we provide the signal description in the…

Networking and Internet Architecture · Computer Science 2019-06-12 Marco Chiani , Ahmed Elzanaty

This paper addresses the challenges in short-time Fourier transform (STFT) domain subband adaptive filtering, in particular, subband system identification. Previous studies in this area have primarily focused on setups with subband…

Audio and Speech Processing · Electrical Eng. & Systems 2025-11-21 Mohit Sharma , Robbe Van Rompaey , Wouter Lanneer , Marc Moonen

Autonomous driving is reshaping the way humans travel, with millimeter wave (mmWave) radar playing a crucial role in this transformation to enabe vehicle-to-everything (V2X). Although chirp is widely used in mmWave radar systems for its…

Signal Processing · Electrical Eng. & Systems 2025-05-23 Zhuoran Li , Shufeng Tan , Zhen Gao , Yi Tao , Zhonghuai Wu , Zhongxiang Li , Chun Hu , Dezhi Zheng

There is significant recent interest in designing new modulation schemes for doubly-selective channels with large delay and Doppler spreads, where legacy modulation schemes based on time-frequency signal representations underperform.…

Signal Processing · Electrical Eng. & Systems 2026-02-10 Nishant Mehrotra , Sandesh Rao Mattu , Robert Calderbank

In this work, we examine the performance of the LoRa chirp spread spectrum modulation in the presence of both additive white Gaussian noise and interference from another LoRa user. To this end, we extend an existing interference model to…

Signal Processing · Electrical Eng. & Systems 2019-05-03 Orion Afisiadis , Matthieu Cotting , Andreas Burg , Alexios Balatsoukas-Stimming

We present two modulation and detection techniques that are designed to allow for efficient equalization for channels that exhibit an arbitrary Doppler spread but no delay spread. These techniques are based on principles similar to…

Signal Processing · Electrical Eng. & Systems 2020-01-08 Thomas Dean , Mainak Chowdhury , Nicole Grimwood , Andrea Goldsmith