中文
相关论文

相关论文: BitRL-Light: 1-bit LLM Agents with Deep Reinforcem…

200 篇论文

This paper proposes Edge-FIT (Federated Instruction Tuning on the Edge), a scalable framework for Federated Instruction Tuning (FIT) of Large Language Models (LLMs). Traditional Federated Learning (TFL) methods, like FedAvg, fail when…

机器学习 · 计算机科学 2025-10-07 Vinay Venkatesh , Vamsidhar R Kamanuru , Lav Kumar , Nikita Kothari

To train large models (like BERT and GPT-3) on hundreds of GPUs, communication has become a major bottleneck, especially on commodity systems with limited-bandwidth TCP network. On one side large batch-size optimization such as LAMB…

机器学习 · 计算机科学 2021-10-07 Conglong Li , Ammar Ahmad Awan , Hanlin Tang , Samyam Rajbhandari , Yuxiong He

Pervasive AI increasingly depends on on-device learning systems that deliver low-latency and energy-efficient computation under strict resource constraints. Liquid State Machines (LSMs) offer a promising approach for low-power temporal…

机器学习 · 计算机科学 2026-01-09 Zain Iqbal , Lorenzo Valerio

We propose a computationally efficient approach to safe reinforcement learning (RL) for frequency regulation in power systems with high levels of variable renewable energy resources. The approach draws on set-theoretic control techniques to…

系统与控制 · 电气工程与系统科学 2022-03-24 Daniel Tabas , Baosen Zhang

Internet of Things (IoT) devices have become increasingly ubiquitous with applications not only in urban areas but remote areas as well. These devices support industries such as agriculture, forestry, and resource extraction. Due to the…

The innovative services empowered by the Internet of Things (IoT) require a seamless and reliable wireless infrastructure that enables communications within heterogeneous and dynamic low-power and lossy networks (LLNs). The Routing Protocol…

网络与互联网体系结构 · 计算机科学 2021-05-21 Hossam Farag , Cedomir Stefanovic

Large Language Models (LLMs) have become essential in a variety of applications due to their advanced language understanding and generation capabilities. However, their computational and memory requirements pose significant challenges to…

硬件体系结构 · 计算机科学 2024-12-02 Cristobal Ortega , Yann Falevoz , Renaud Ayrignac

In this paper, we take a holistic approach to deal with the tradeoffs between energy use and comfort in commercial buildings. We developed a system called OCTOPUS, which employs a novel deep reinforcement learning (DRL) framework that uses…

机器学习 · 计算机科学 2023-01-30 Xianzhong Ding , Alberto Cerpa , Wan Du

The growing demand for optimal and low-power energy consumption paradigms for IOT devices has garnered significant attention due to their cost-effectiveness, simplicity, and intelligibility. In this article, an AI hardware energy-efficient…

信号处理 · 电气工程与系统科学 2024-12-03 Zheqi Yu , Chao Zhang , Pedro Machado , Adnan Zahid , Tim. Fernandez-Hart , Muhammad A. Imran , Qammer H. Abbasi

Smart home automation systems aim to improve the comfort and convenience of users in their living environment. However, adapting automation to user needs remains a challenge. Indeed, many systems still rely on hand-crafted routines for each…

Reinforcement Learning (RL) has outperformed other counterparts in sequential decision-making and dynamic environment control. However, FPGA deployment is significantly resource-expensive, as associated with large number of computations in…

硬件体系结构 · 计算机科学 2025-06-10 Anushka Jha , Tanushree Dewangan , Mukul Lokhande , Santosh Kumar Vishvakarma

Reinforcement Learning (RL), one of the core paradigms in machine learning, learns to make decisions based on real-world experiences. This approach has significantly advanced AI applications across various domains, notably in smart grid…

密码学与安全 · 计算机科学 2024-02-27 Zheyu Zhang

Large Language Models (LLMs) are typically trained in two phases: pre-training on large internet-scale datasets, and fine-tuning for downstream tasks. Given the higher computational demand of pre-training, it's intuitive to assume that…

机器学习 · 计算机科学 2024-10-15 James Liu , Guangxuan Xiao , Kai Li , Jason D. Lee , Song Han , Tri Dao , Tianle Cai

Non-intrusive load monitoring (NILM) focuses on disaggregating total household power consumption into appliance-specific usage. Many advanced NILM methods are based on neural networks that typically require substantial amounts of labeled…

机器学习 · 计算机科学 2024-11-26 Dhruv Patel , Ankita Kumari Jain , Haikoo Khandor , Xhitij Choudhary , Nipun Batra

This research presents a novel application of Evolutionary Computation to the domain of residential electric vehicle (EV) energy management. While reinforcement learning (RL) achieves high performance in vehicle-to-grid (V2G) optimization,…

神经与进化计算 · 计算机科学 2026-02-10 Vishesh Purnananda , Benjamin John Wruck , Mingyu Guo

Efficient deployment of large language models (LLMs) requires extreme quantization, forcing a critical trade-off between low-bit efficiency and performance. Residual binarization enables hardware-friendly, matmul-free inference by stacking…

人工智能 · 计算机科学 2026-05-19 Youngcheon You , Banseok Lee , Minseop Choi , Seonyoung Kim , Hyochan Chong , Changdong Kim , Youngmin Kim , Dongkyu Kim

Recently, the number of off-the-shelf Large Language Models (LLMs) has exploded with many open-source options. This creates a diverse landscape regarding both serving options (e.g., inference on local hardware vs remote LLM APIs) and model…

机器学习 · 计算机科学 2024-12-18 Dimitrios Sikeridis , Dennis Ramdass , Pranay Pareek

The deployment of large language models (LLMs) is frequently hindered by prohibitive memory and computational requirements. While quantization mitigates these bottlenecks, maintaining model fidelity in the sub-1-bit regime remains a…

机器学习 · 计算机科学 2026-02-06 Banseok Lee , Dongkyu Kim , Youngcheon You , Youngmin Kim

Large Language Models (LLMs) are increasingly deployed in production, contributing towards shifting the burden in terms of computational resources and energy demands from training to inference. While prior work has examined the energy cost…

机器学习 · 计算机科学 2026-02-02 Julien Delavande , Regis Pierrard , Sasha Luccioni

This letter presents a novel deep reinforcement learning (DRL) approach for joint time allocation and power control in a cognitive Internet of Things (CIoT) system with simultaneous wireless information and power transfer (SWIPT). The CIoT…

信号处理 · 电气工程与系统科学 2025-12-18 Nadia Abdolkhani , Nada Abdel Khalek , Walaa Hamouda , Iyad Dayoub