中文
相关论文

相关论文: Extending the Lora modulation to add further paral…

200 篇论文

Diffusion models, such as Stable Diffusion (SD), offer the ability to generate high-resolution images with diverse features, but they come at a significant computational and memory cost. In classifier-free guided diffusion models, prolonged…

计算机视觉与模式识别 · 计算机科学 2023-12-13 Pareesa Ameneh Golnari

Due to the demand for efficient fine-tuning of large language models, Low-Rank Adaptation (LoRA) has been widely adopted as one of the most effective parameter-efficient fine-tuning methods. Nevertheless, while LoRA improves efficiency,…

计算与语言 · 计算机科学 2025-06-13 Naibin Gu , Zhenyu Zhang , Xiyu Liu , Peng Fu , Zheng Lin , Shuohuan Wang , Yu Sun , Hua Wu , Weiping Wang , Haifeng Wang

Low-Rank Adaptation (LoRA) fine-tunes large models by learning low-rank updates on top of frozen weights, dramatically reducing trainable parameters and memory. However, there is still a gap between full training with low-rank projections…

Multiplexing services as a key communication technique to effectively combine multiple signals into one signal and transmit over a shared medium. Multiplexing can increase the channel capacity by requiring more resources on the transmission…

信息论 · 计算机科学 2017-12-27 Chunlin Ji , Ruopeng Liu

LoRaWAN is a prominent communication standard to enable reliable low-power, long-range communications for the Internet of Things (IoT). The modulation technique used in LoRaWAN, commonly known as LoRa modulation, is based on the principle…

信号处理 · 电气工程与系统科学 2021-05-07 Tung T. Nguyen , Ha H. Nguyen

Low-Rank Adaptation (LoRA) is a widely used parameter-efficient fine-tuning method for foundation models, but it suffers from parameter interference, resulting in suboptimal performance. Although Mixture-of-Experts (MoE)-based LoRA variants…

机器学习 · 计算机科学 2025-10-24 Heming Zou , Yunliang Zang , Wutong Xu , Yao Zhu , Xiangyang Ji

Long Range (LoRa) is a wireless communication technology for the Internet of Things (IoT), able to provide wide coverage networking to devices with low power consumption and low data-rate. This paper~proposes and describes a simulation…

网络与互联网体系结构 · 计算机科学 2018-12-05 Yifan Du

A modular method was suggested before to recover a band limited signal from the sample and hold and linearly interpolated (or, in general, an nth-order-hold) version of the regular samples. In this paper a novel approach for compensating…

计算机视觉与模式识别 · 计算机科学 2012-05-15 Mohammad Tofighi , Ali Ayremlou , Farokh Marvasti

LoRa technology, crucial for low-power wide-area networks, faces significant performance degradation at extremely low signal-to-noise ratios (SNRs). We present LoRaFlow, a novel approach using rectified flow to reconstruct high-quality LoRa…

信号处理 · 电气工程与系统科学 2025-01-03 Mohamed Osman , Tamer Nadeem

Low-Rank Adaptation~(LoRA), which updates the dense neural network layers with pluggable low-rank matrices, is one of the best performed parameter efficient fine-tuning paradigms. Furthermore, it has significant advantages in cross-task…

机器学习 · 计算机科学 2024-10-25 Yuren Mao , Yuhang Ge , Yijiang Fan , Wenyi Xu , Yu Mi , Zhonghao Hu , Yunjun Gao

Will Multi-Link Operation (MLO) be able to improve the latency of Wi-Fi networks? MLO is one of the most disruptive MAC-layer techniques included in the IEEE 802.11be amendment. It allows a device to use multiple radios simultaneously and…

网络与互联网体系结构 · 计算机科学 2021-11-19 Marc Carrascosa , Giovanni Geraci , Edward Knightly , Boris Bellalta

The Internet of Things (IoT) revolution demands scalable, energy-efficient communication protocols supporting widespread device deployments. The LoRa technology, coupled with the LoRaWAN protocol, has emerged as a leading Low Power Wide…

网络与互联网体系结构 · 计算机科学 2025-04-02 Riccardo Marini , Giampaolo Cuozzo

LoRA employs lightweight modules to customize large language models (LLMs) for each downstream task or domain, where different learned additional modules represent diverse skills. Combining existing LoRAs to address new tasks can enhance…

计算与语言 · 计算机科学 2024-02-20 Hanqing Wang , Bowen Ping , Shuo Wang , Xu Han , Yun Chen , Zhiyuan Liu , Maosong Sun

This paper presents a novel methodology of fine-tuning for large language models-dynamic LoRA. Building from the standard Low-Rank Adaptation framework, this methodology further adds dynamic adaptation mechanisms to improve efficiency and…

计算与语言 · 计算机科学 2025-01-28 Xiaoxuan Liao , Chihang Wang , Shicheng Zhou , Jiacheng Hu , Hongye Zheng , Jia Gao

An important modulation technique for Internet of Things (IoT) is the one proposed by the LoRa allianceTM. In this paper we analyze the M-ary LoRa modulation in the time and frequency domains. First, we provide the signal description in the…

网络与互联网体系结构 · 计算机科学 2019-06-12 Marco Chiani , Ahmed Elzanaty

This paper addresses the challenges in short-time Fourier transform (STFT) domain subband adaptive filtering, in particular, subband system identification. Previous studies in this area have primarily focused on setups with subband…

音频与语音处理 · 电气工程与系统科学 2025-11-21 Mohit Sharma , Robbe Van Rompaey , Wouter Lanneer , Marc Moonen

Autonomous driving is reshaping the way humans travel, with millimeter wave (mmWave) radar playing a crucial role in this transformation to enabe vehicle-to-everything (V2X). Although chirp is widely used in mmWave radar systems for its…

信号处理 · 电气工程与系统科学 2025-05-23 Zhuoran Li , Shufeng Tan , Zhen Gao , Yi Tao , Zhonghuai Wu , Zhongxiang Li , Chun Hu , Dezhi Zheng

There is significant recent interest in designing new modulation schemes for doubly-selective channels with large delay and Doppler spreads, where legacy modulation schemes based on time-frequency signal representations underperform.…

信号处理 · 电气工程与系统科学 2026-02-10 Nishant Mehrotra , Sandesh Rao Mattu , Robert Calderbank

In this work, we examine the performance of the LoRa chirp spread spectrum modulation in the presence of both additive white Gaussian noise and interference from another LoRa user. To this end, we extend an existing interference model to…

信号处理 · 电气工程与系统科学 2019-05-03 Orion Afisiadis , Matthieu Cotting , Andreas Burg , Alexios Balatsoukas-Stimming

We present two modulation and detection techniques that are designed to allow for efficient equalization for channels that exhibit an arbitrary Doppler spread but no delay spread. These techniques are based on principles similar to…

信号处理 · 电气工程与系统科学 2020-01-08 Thomas Dean , Mainak Chowdhury , Nicole Grimwood , Andrea Goldsmith