English
Related papers

Related papers: AMD Versal AI-Engines for fixed latency environmen…

200 papers

Generative modeling of 3D brain MRIs presents difficulties in achieving high visual fidelity while ensuring sufficient coverage of the data distribution. In this work, we propose to address this challenge with composable, multiscale…

Image and Video Processing · Electrical Eng. & Systems 2023-01-12 Jaivardhan Kapoor , Jakob H. Macke , Christian F. Baumgartner

Optimizing Large Language Model (LLM) inference in production systems is increasingly difficult due to dynamic workloads, stringent latency/throughput targets, and a rapidly expanding configuration space. This complexity spans not only…

Powerful foundation models, including large language models (LLMs), with Transformer architectures have ushered in a new era of Generative AI across various industries. Industry and research community have witnessed a large number of new…

The growing demand for large artificial intelligence model (LAIM) services is driving a paradigm shift from traditional cloud-based inference to edge-based inference for low-latency, privacy-preserving applications. In particular,…

Machine Learning · Computer Science 2025-05-15 Zhonghao Lyu , Ming Xiao , Jie Xu , Mikael Skoglund , Marco Di Renzo

6G's AI native vision of embedding advance intelligence in the network while bringing it closer to the user requires a systematic evaluation of Generative AI (GenAI) models on edge devices. Rapidly emerging solutions based on Open RAN…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-11-28 Zeinab Nezami , Maryam Hafeez , Karim Djemame , Syed Ali Raza Zaidi

Artificial intelligence (AI) systems have been increasingly adopted in the Manufacturing Industrial Internet (MII). Investigating and enabling the AI resilience is very important to alleviate profound impact of AI system failures in…

Artificial Intelligence · Computer Science 2025-03-04 Yingyan Zeng , Ismini Lourentzou , Xinwei Deng , Ran Jin

As wireless networks evolve toward AI-integrated intelligence, conventional energy-efficiency metrics fail to capture the value of AI tasks. In this paper, we propose a novel EE metric called Token-Responsive Energy Efficiency (TREE), which…

Systems and Control · Electrical Eng. & Systems 2025-09-03 Tao Yu , Kaixuan Huang , Tengsheng Wang , Jihong Li , Shunqing Zhang , Shuangfeng Han , Xiaoyun Wang , Qunsong Zeng , Kaibin Huang , Vincent K. N. Lau

AI agents are emerging as a dominant workload in a wide range of applications, promising to be the vehicle that delivers the promised benefits of AI to enterprises and consumers. Unlike conventional software or static inference, agentic…

Machine Learning · Computer Science 2025-07-29 Zain Asgar , Michelle Nguyen , Sachin Katti

Large Language Models (LLMs) have achieved remarkable success across diverse applications, yet their deployment remains challenging due to substantial computational costs, memory requirements, and energy consumption. Recent empirical…

Machine Learning · Computer Science 2026-03-24 Kaito Tanaka , Masato Ito , Yuji Nishimura , Keisuke Matsuda , Aya Nakayama

Sparse Mixture-of-Experts (MoE) models enable efficient scalability by activating only a small sub-set of experts per input, yet their massive parameter counts lead to substantial memory and energy inefficiency during inference. Analog…

Machine Learning · Computer Science 2026-03-04 Mohammed Nowaz Rabbani Chowdhury , Hsinyu Tsai , Geoffrey W. Burr , Kaoutar El Maghraoui , Liu Liu , Meng Wang

The support of artificial intelligence (AI) based decision-making is a key element in future 6G networks, where the concept of native AI will be introduced. Moreover, AI is widely employed in different critical applications such as…

Artificial Intelligence · Computer Science 2025-04-08 Abdul Karim Gizzini , Yahia Medjahdi , Ali J. Ghandour , Laurent Clavier

Edge AI is often framed as model compression and deployment under tight constraints. We argue a stronger operational thesis: Edge AI in realistic deployments is necessarily adaptive. In long-horizon operation, a fixed (non-adaptive)…

Hardware Architecture · Computer Science 2026-04-10 Fabrizio Pittorino , Manuel Roveri

The rapid growth of end-user AI applications, such as computer vision and generative AI, has led to immense data and processing demands often exceeding user devices' capabilities. Edge AI addresses this by offloading computation to the…

Machine Learning · Computer Science 2024-11-05 Juan Marcelo Parra-Ullauri , Oscar Dilley , Hari Madhukumar , Dimitra Simeonidou

The increasing demand for artificial intelligence (AI) workloads across diverse computing environments has driven the need for more efficient data management strategies. Traditional cloud-based architectures struggle to handle the sheer…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-12-03 Alex Barceló , Sebastián A. Cajas Ordoñez , Jaydeep Samanta , Andrés L. Suárez-Cetrulo , Romila Ghosh , Ricardo Simón Carbajo , Anna Queralt

Multimodal large language models (MLLMs) demonstrate exceptional capabilities in semantic understanding and visual reasoning, yet they still face challenges in precise object localization and resource-constrained edge-cloud deployment. To…

Computer Vision and Pattern Recognition · Computer Science 2026-01-09 Yunqing Hu , Zheming Yang , Chang Zhao , Qi Guo , Meng Gao , Pengcheng Li , Wen Ji

Explainable Artificial Intelligence (XAI) models have recently attracted a great deal of interest from a variety of application sectors. Despite significant developments in this area, there are still no standardized methods or approaches…

Machine Learning · Computer Science 2023-12-08 Sarit Maitra , Vivek Mishra , Pratima Verma , Manav Chopra , Priyanka Nath

Variational Autoencoders (VAE) are popular generative models used to sample from complex data distributions. Despite their empirical success in various machine learning tasks, significant gaps remain in understanding their theoretical…

Machine Learning · Statistics 2025-12-23 Sobihan Surendran , Antoine Godichon-Baggioni , Sylvain Le Corff

In order to fully harness the potential of machine learning, it is crucial to establish a system that renders the field more accessible and less daunting for individuals who may not possess a comprehensive understanding of its intricacies.…

Machine Learning · Computer Science 2024-08-31 Saikat Barua , Sifat Momen

Machine learning-based embedded systems employed in safety-critical applications such as aerospace and autonomous driving need to be robust against perturbations produced by soft errors. Soft errors are an increasing concern in modern…

Machine Learning · Computer Science 2024-12-06 Jon Gutiérrez-Zaballa , Koldo Basterretxea , Javier Echanobe

Deploying large language models (LLMs) on heterogeneous edge devices demands frameworks that jointly optimize energy efficiency, inference quality, and reliability. Our prior QEIL v1 (Kumar & Jha, 2026) achieved 4.82x IPW improvement but…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-07 Satyam Kumar , Saurabh Jha