English
Related papers

Related papers: TinyM$^2$Net-V3: Memory-Aware Compressed Multimoda…

200 papers

Conventional large language models (LLMs) are equipped with dozens of GB to TB of model parameters, making inference highly energy-intensive and costly as all the weights need to be loaded to onboard processing elements during computation.…

Hardware Architecture · Computer Science 2025-07-28 Wei-Hsing Huang , Janak Sharda , Cheng-Jhih Shih , Yuyao Kong , Faaiq Waqar , Pin-Jun Chen , Yingyan , Lin , Shimeng Yu

The widespread adoption of Internet of Things (IoT) technologies has significantly advanced environmental monitoring (EM) by enabling cost-effective and scalable sensing solutions. Concurrently, machine learning (ML) and artificial…

Signal Processing · Electrical Eng. & Systems 2025-08-26 Philip Wiese , Victor Kartsch , Marco Guermandi , Luca Benini

This paper introduces CO3 -- an algorithm for communication-efficient federated Deep Neural Network (DNN) training. CO3 takes its name from three processing applied which reduce the communication load when transmitting the local DNN…

Machine Learning · Computer Science 2023-06-02 Zhong-Jing Chen , Eduin E. Hernandez , Yu-Chih Huang , Stefano Rini

Vision Large Language Models (VLMs) combine visual understanding with natural language processing, enabling tasks like image captioning, visual question answering, and video analysis. While VLMs show impressive capabilities across domains…

Computer Vision and Pattern Recognition · Computer Science 2025-06-18 Ahmed Sharshar , Latif U. Khan , Waseem Ullah , Mohsen Guizani

Large language models have become central to many AI applications, but their growing energy consumption raises serious sustainability concerns. A key limitation in current AI deployments is the reliance on a one-size-fits-all inference…

The field of Tiny Machine Learning (TinyML) has gained significant attention due to its potential to enable intelligent applications on resource-constrained devices. This review provides an in-depth analysis of the advancements in efficient…

Machine Learning · Statistics 2023-11-21 Minh Tri Lê , Pierre Wolinski , Julyan Arbel

Precise monitoring of respiratory rate in premature infants is essential to initiate medical interventions as required. Wired technologies can be invasive and obtrusive to the patients. We propose a Deep Learning enabled wearable monitoring…

Signal Processing · Electrical Eng. & Systems 2022-02-23 Ankita Paul , Md. Abu Saleh Tajin , Anup Das , William M. Mongan , Kapil R. Dandekar

The growing demand for intelligent applications beyond the network edge, coupled with the need for sustainable operation, are driving the seamless integration of deep learning (DL) algorithms into energy-limited, and even energy-harvesting…

Machine Learning · Computer Science 2024-11-08 Marcello Bullo , Seifallah Jardak , Pietro Carnelli , Deniz Gündüz

We propose a novel deep neural network architecture for speech recognition that explicitly employs knowledge of the background environmental noise within a deep neural network acoustic model. A deep neural network is used to predict the…

Computation and Language · Computer Science 2016-10-03 Suyoun Kim , Bhiksha Raj , Ian Lane

Oil spill incidents pose severe threats to marine ecosystems and coastal environments, necessitating rapid detection and monitoring capabilities to mitigate environmental damage. In this paper, we demonstrate how artificial intelligence,…

Signal Processing · Electrical Eng. & Systems 2025-05-05 Mohamed Moursi , Norbert Wehn , Bilal Hammoud

The recent advent of `Internet of Things' (IOT) has increased the demand for enabling AI-based edge computing. This has necessitated the search for efficient implementations of neural networks in terms of both computations and storage.…

Machine Learning · Computer Science 2019-02-04 Indranil Chakraborty , Deboleena Roy , Aayush Ankit , Kaushik Roy

Examples of embedded intelligence include a wide variety of tiny neural networks used on-board wireless sensors and actuators, which are expected to continuously perform inference on time-series of the data they sense. In order to fit…

Machine Learning · Computer Science 2026-05-28 Zhaolan Huang , Emmanuel Baccelli

Today's intelligent applications can achieve high performance accuracy using machine learning (ML) techniques, such as deep neural networks (DNNs). Traditionally, in a remote DNN inference problem, an edge device transmits raw data to a…

Machine Learning · Computer Science 2021-06-03 Mounssif Krouka , Anis Elgabli , Chaouki Ben Issaid , Mehdi Bennis

Climate change poses one of the most significant challenges to humanity. As a result of these climatic changes, the frequency of weather, climate, and water-related disasters has multiplied fivefold over the past 50 years, resulting in over…

Machine Learning · Computer Science 2023-12-04 Xiaolong Tu , Anik Mallik , Haoxin Wang , Jiang Xie

The Mixture of Experts (MoE) architecture is an important method for scaling Large Language Models (LLMs). It increases model capacity while keeping computation cost low. However, the ultra-large MoE models still have hundreds of billions…

Artificial Intelligence · Computer Science 2025-10-01 Yixiao Chen , Yanyue Xie , Ruining Yang , Wei Jiang , Wei Wang , Yong He , Yue Chen , Pu Zhao , Yanzhi Wang

While deep neural network (DNN)-based video denoising has demonstrated significant performance, deploying state-of-the-art models on edge devices remains challenging due to stringent real-time and energy efficiency requirements.…

Computer Vision and Pattern Recognition · Computer Science 2025-05-29 Shan Gao , Zhiqiang Wu , Yawen Niu , Xiaotao Li , Qingqing Xu

Distributed deep neural networks (DNNs) have become central to modern computer vision, yet their deployment on resource-constrained edge devices remains hindered by substantial parameter counts, computational demands, and the probability of…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-02-17 Mahadev Sunil Kumar , Arnab Raha , Debayan Das , Gopakumar G , Rounak Chatterjee , Amitava Mukherjee

Sound event detection (SED) is a hot topic in consumer and smart city applications. Existing approaches based on Deep Neural Networks are very effective, but highly demanding in terms of memory, power, and throughput when targeting…

Machine Learning · Computer Science 2021-01-13 Gianmarco Cerutti , Renzo Andri , Lukas Cavigelli , Michele Magno , Elisabetta Farella , Luca Benini

Edge computing is a promising solution for handling high-dimensional, multispectral analog data from sensors and IoT devices for applications such as autonomous drones. However, edge devices' limited storage and computing resources make it…

Machine Learning · Computer Science 2023-09-21 Nastaran Darabi , Amit R. Trivedi

Respiratory diseases remain major global health challenges, and traditional auscultation is often limited by subjectivity, environmental noise, and inter-clinician variability. This study presents an explainable multimodal deep learning…

Sound · Computer Science 2025-12-02 S M Asiful Islam Saky , Md Rashidul Islam , Md Saiful Arefin , Shahaba Alam