English
Related papers

Related papers: Low-Stack HAETAE for Memory-Constrained Microcontr…

200 papers

Hierarchical VAEs have emerged in recent years as a reliable option for maximum likelihood estimation. However, instability issues and demanding computational requirements have hindered research progress in the area. We present simple…

Machine Learning · Computer Science 2022-04-29 Louay Hazami , Rayhane Mama , Ragavan Thurairatnam

In recent times, the emergence of Large Language Models (LLMs) has resulted in increasingly larger model size, posing challenges for inference on low-resource devices. Prior approaches have explored offloading to facilitate low-memory…

Performance · Computer Science 2024-03-05 Xuanlei Zhao , Bin Jia , Haotian Zhou , Ziming Liu , Shenggan Cheng , Yang You

Hyperdimensional Computing (HDC) is a bio-inspired computing framework that has gained increasing attention, especially as a more efficient approach to machine learning (ML). This work introduces the \name{} compiler, the first open-source…

Machine Learning · Computer Science 2023-04-26 Pere Vergés , Mike Heddes , Igor Nunes , Tony Givargis , Alexandru Nicolau

Trusted Execution Environments (TEEs) are hardware-enforced memory isolation units, emerging as a pivotal security solution for security-critical applications. TEEs, like Intel SGX and ARM TrustZone, allow the isolation of confidential code…

Programming Languages · Computer Science 2023-07-26 Abhiroop Sarkar , Robert Krook , Alejandro Russo , Koen Claessen

In energy-constrained scenarios such as IoT applications, the primary requirement for System-on-Chips (SoCs) is to increase battery life. However, when performing sub/near-threshold operations, the relatively large leakage current hinders…

Hardware Architecture · Computer Science 2024-04-09 Shan Shen , Hao Xu , Yongliang Zhou , Ming Ling , Wenjian Yu

Reliability has emerged as a key topic of interest for researchers around the world to detect and/or mitigate the side effects of decreasing transistor sizes, such as soft errors. Traditional solutions, like DMR and TMR, incur significant…

Hardware Architecture · Computer Science 2019-10-22 Bharath Srinivas Prabakaran , Mihika Dave , Florian Kriebel , Semeen Rehman , Muhammad Shafique

The SRAM cell is made up of latch, which ensures that the cell data is preserved as long as power is turned on and refresh operation is not required for the SRAM cell. SRAM is widely used for on-chip cache memory in microprocessors, game…

Hardware Architecture · Computer Science 2019-05-22 Apollos Ezeogu

Minimum-Storage Regenerating (MSR) codes have emerged as a viable alternative to Reed-Solomon (RS) codes as they minimize the repair bandwidth while they are still optimal in terms of reliability and storage overhead. Although several MSR…

Information Theory · Computer Science 2020-02-14 Katina Kralevska , Danilo Gligoroski , Rune E. Jensen , Harald Øverby

As the Internet of Things (IoT) becomes an integral part of critical infrastructure and commercial services, runtime firmware attestation of constituent Micro-Controllers (MCUs) has become instrumental in maintaining security and trust.…

Cryptography and Security · Computer Science 2026-05-26 Varun Kohli , Biplab Sikdar

Large language models (LLMs) have demonstrated remarkable proficiency in a wide range of natural language processing applications. However, the high energy and latency overhead induced by the KV cache limits the edge deployment, especially…

Performance · Computer Science 2025-12-09 Zizhuo Fu , Xiaotian Guo , Wenxuan Zeng , Shuzhang Zhong , Yadong Zhang , Peiyu Chen , Runsheng Wang , Le Ye , Meng Li

Homomorphic Encryption (HE) prevails in securing Federated Learning (FL), but suffers from high overhead and adaptation cost. Selective HE methods, which partially encrypt model parameters by a global mask, are expected to protect privacy…

Cryptography and Security · Computer Science 2025-08-07 Borui Li , Li Yan , Junhao Han , Jianmin Liu , Lei Yu

Large language models (LLMs) power modern AI applications, but processing sensitive data on untrusted servers raises privacy concerns. Homomorphic encryption (HE) enables computation on encrypted data for secure inference. However, neural…

Machine Learning · Computer Science 2025-11-19 Matan Avitan , Moran Baruch , Nir Drucker , Itamar Zimerman , Yoav Goldberg

This paper investigates the transmission energy minimization problem for the two-user downlink with strictly heterogeneous latency constraints. To cope with the latency constraints and to explicitly specify the trade-off between blocklength…

Information Theory · Computer Science 2019-12-19 Yanqing Xu , Chao Shen , Tsung-Hui Chang , Shih-Chun Lin , Yajun Zhao , Gang Zhu

Large language model (LLM) serving is now limited by the key-value (KV) cache. During decode, each new token rereads prior KV state, so attention becomes a bandwidth- and capacity-heavy memory task. HBM-PIM helps by moving attention closer…

Hardware Architecture · Computer Science 2026-05-08 Zhuoran Li , Zhuohang Bian , Zihao Huang , Guangyu Sun , Yun Liang , Youwei Zhuo

In this paper, we consider a novel cache-enabled heterogeneous network (HetNet), where macro base stations (BSs) with traditional sub-6 GHz are overlaid by dense millimeter wave (mmWave) pico BSs. These two-tier BSs, which are modeled as…

Information Theory · Computer Science 2018-07-16 Wenqiang Yi , Yuanwei Liu , Arumugam Nallanathan

While homomorphic encryption (HE) provides strong privacy protection, its high computational cost has restricted its application to simple tasks. Recently, hyperdimensional computing (HDC) applied to HE has shown promising performance for…

Cryptography and Security · Computer Science 2025-11-04 Jaewoo Park , Chenghao Quan , Jongeun Lee

Homomorphic Encryption (HE) enables secure computation on encrypted data, addressing privacy concerns in cloud computing. However, the high computational cost of HE operations, particularly matrix multiplication (MM), remains a major…

Hardware Architecture · Computer Science 2025-12-18 Zhihan Xu , Rajgopal Kannan , Viktor K. Prasanna

This paper presents a novel end-to-end methodology for enabling the deployment of low-error deep networks on microcontrollers. To fit the memory and computational limitations of resource-constrained edge-devices, we exploit mixed…

Machine Learning · Computer Science 2019-05-31 Manuele Rusci , Alessandro Capotondi , Luca Benini

Disaggregated Large Language Model (LLM) inference has gained popularity as it separates the computation-intensive prefill stage from the memory-intensive decode stage, avoiding the prefill-decode interference and improving resource…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-02-07 Zeyu Zhang , Haiying Shen , Shay Vargaftik , Ran Ben Basat , Michael Mitzenmacher , Minlan Yu

Sparse autoencoders (SAEs) decompose neural activations into interpretable features. A widely adopted variant, the TopK SAE, reconstructs each token from its K most active latents. However, this approach is inefficient, as some tokens carry…

Machine Learning · Computer Science 2025-09-01 Narmeen Oozeer , Nirmalendu Prakash , Michael Lan , Alice Rigg , Amirali Abdullah