中文
相关论文

相关论文: BitRL-Light: 1-bit LLM Agents with Deep Reinforcem…

200 篇论文

Non-intrusive load monitoring (NILM) aims at energy consumption and appliance state information retrieval from aggregated consumption measurements, with the help of signal processing and machine learning algorithms. Representation learning…

信号处理 · 电气工程与系统科学 2022-09-09 Matthias Kahl , Daniel Jorde , Hans-Arno Jacobsen

Post-training quantization (PTQ) is an effective technique for compressing large language models (LLMs). However, while uniform-precision quantization is computationally efficient, it often compromises model performance. To address this, we…

Traditional anti-jamming techniques like spread spectrum, adaptive power/rate control, and cognitive radio, have demonstrated effectiveness in mitigating jamming attacks. However, their robustness against the growing complexity of…

信号处理 · 电气工程与系统科学 2023-07-14 Abubakar Sani Ali , Shimaa Naser , Sami Muhaidat

Individual device loads and energy consumption feedback is one of the important approaches for pursuing users to save energy in residences. This can help in identifying faulty devices and wasted energy by devices when left On unused. The…

信号处理 · 电气工程与系统科学 2021-11-10 Ronak Aghera , Sahil Chilana , Vishal Garg , Raghunath Reddy

As power systems are undergoing a significant transformation with more uncertainties, less inertia and closer to operation limits, there is increasing risk of large outages. Thus, there is an imperative need to enhance grid emergency…

机器学习 · 计算机科学 2022-02-08 Renke Huang , Yujiao Chen , Tianzhixi Yin , Qiuhua Huang , Jie Tan , Wenhao Yu , Xinya Li , Ang Li , Yan Du

We propose a memory-efficient finetuning algorithm for large language models (LLMs) that supports finetuning LLMs with 65B parameters in 2/3/4-bit precision on as little as one 24GB GPU. Our method, modular low-rank adaptation (ModuLoRA),…

机器学习 · 计算机科学 2024-03-12 Junjie Yin , Jiahao Dong , Yingheng Wang , Christopher De Sa , Volodymyr Kuleshov

Large Language Models excel in textual tasks but often struggle with physical-world reasoning tasks. Inspired by human cognition, where perception is fundamental to reasoning, we explore augmenting LLMs with enhanced perception abilities…

人工智能 · 计算机科学 2025-12-02 Tuo An , Yunjiao Zhou , Han Zou , Jianfei Yang

Reinforcement learning (RL) has demonstrated potential in enhancing the reasoning capabilities of large language models (LLMs), but such training typically demands substantial efforts in creating and annotating data. In this work, we…

计算与语言 · 计算机科学 2025-10-06 Hangfan Zhang , Siyuan Xu , Zhimeng Guo , Huaisheng Zhu , Shicheng Liu , Xinrun Wang , Qiaosheng Zhang , Yang Chen , Peng Ye , Lei Bai , Shuyue Hu

This report investigates the application of deep reinforcement learning (DRL) algorithms for dynamic resource allocation in wireless communication systems. An environment that includes a base station, multiple antennas, and user equipment…

分布式、并行与集群计算 · 计算机科学 2025-03-14 Shubham Malhotra , Fnu Yashu , Muhammad Saqib , Dipkumar Mehta , Jagdish Jangid , Sachin Dixit

Large Language Models (LLMs) are becoming integral to daily life, showcasing their vast potential across various Natural Language Processing (NLP) tasks. Beyond NLP, LLMs are increasingly used in software development tasks, such as code…

分布式、并行与集群计算 · 计算机科学 2025-03-24 Shashikant Ilager , Lukas Florian Briem , Ivona Brandic

How can short-term energy consumption be accurately forecasted when sensor data is noisy, incomplete, and lacks contextual richness? This question guided our participation in the \textit{2025 Competition on Electric Energy Consumption…

机器学习 · 计算机科学 2025-10-21 Sarah Al-Shareeda , Gulcihan Ozdemir , Heung Seok Jeon , Khaleel Ahmad

The recent breakthroughs of deep reinforcement learning (DRL) technique in Alpha Go and playing Atari have set a good example in handling large state and actions spaces of complicated control problems. The DRL technique is comprised of (i)…

人工智能 · 计算机科学 2017-10-12 Hongjia Li , Tianshu Wei , Ao Ren , Qi Zhu , Yanzhi Wang

Recent research, such as BitNet, is paving the way for a new era of 1-bit Large Language Models (LLMs). In this work, we introduce a 1-bit LLM variant, namely BitNet b1.58, in which every single parameter (or weight) of the LLM is ternary…

计算与语言 · 计算机科学 2024-02-28 Shuming Ma , Hongyu Wang , Lingxiao Ma , Lei Wang , Wenhui Wang , Shaohan Huang , Li Dong , Ruiping Wang , Jilong Xue , Furu Wei

Large Language Models (LLMs) have become a key foundation for enabling personalized smart home experiences. While existing studies have explored how smart home assistants understand user queries to control devices in real time, their…

人工智能 · 计算机科学 2026-04-14 Kai-Yuan Guo , Jiang Wang , Renjie Zhao , Tianyi Wang , Wandong Mao , Yu Gao , Mou Xiao Feng , Yi Xu

In recent years, deep reinforcement learning (DRL) algorithms have gained traction in home energy management systems. However, their adoption by energy management companies remains limited due to the black-box nature of DRL, which fails to…

系统与控制 · 电气工程与系统科学 2025-06-03 Toon Van Puyvelde , Mehran Zareh , Chris Develder

Deploying Large Language Models (LLMs) on resource-constrained edge devices faces critical bottlenecks in memory bandwidth and power consumption. While ternary quantization (e.g., BitNet b1.58) significantly reduces model size, its direct…

硬件体系结构 · 计算机科学 2026-05-05 Zi-Wei Lin , Tian-Sheuan Chang

Large Language Models (LLMs) excel in NLP, but their demands hinder their widespread deployment. While Quantization-Aware Training (QAT) offers a solution, its extensive training costs make Post-Training Quantization (PTQ) a more practical…

计算与语言 · 计算机科学 2024-04-09 Jing Liu , Ruihao Gong , Xiuying Wei , Zhiwei Dong , Jianfei Cai , Bohan Zhuang

Smart services are an important element of the smart cities and the Internet of Things (IoT) ecosystems where the intelligence behind the services is obtained and improved through the sensory data. Providing a large amount of training data…

网络与互联网体系结构 · 计算机科学 2018-10-10 Mehdi Mohammadi , Ala Al-Fuqaha , Mohsen Guizani , Jun-Seok Oh

We propose a novel approach to enable Automated Machine Learning (AutoML) for Non-Intrusive Appliance Load Monitoring (NIALM), also known as Energy Disaggregation, through Bayesian Optimization. NIALM offers a cost-effective alternative to…

软件工程 · 计算机科学 2025-05-13 Armin Moin , Ukrit Wattanavaekin , Alexandra Lungu , Stephan Rössler , Stephan Günnemann

Large Language Models (LLMs) have been emerging as prominent AI models for solving many natural language tasks due to their high performance (e.g., accuracy) and capabilities in generating high-quality responses to the given inputs.…

神经与进化计算 · 计算机科学 2026-04-22 Rachmad Vidya Wicaksana Putra , Pasindu Wickramasinghe , Muhammad Shafique