中文
相关论文

相关论文: Impact of Inference Accelerators on hardware selec…

200 篇论文

Prognostic and diagnostic AI-based medical devices hold immense promise for advancing healthcare, yet their rapid development has outpaced the establishment of appropriate validation methods. Existing approaches often fall short in…

机器学习 · 计算机科学 2024-09-10 Florian Hellmeier , Kay Brosien , Carsten Eickhoff , Alexander Meyer

With the surging popularity of edge computing, the need to efficiently perform neural network inference on battery-constrained IoT devices has greatly increased. While algorithmic developments enable neural networks to solve increasingly…

硬件体系结构 · 计算机科学 2022-06-27 Maarten Molendijk , Floran de Putter , Henk Corporaal

With their widespread availability, FPGA-based accelerators cards have become an alternative to GPUs and CPUs to accelerate computing in applications with certain requirements (like energy efficiency) or properties (like fixed-point…

硬件体系结构 · 计算机科学 2022-10-20 Tom Vander Aa , Tom Haber , Thomas J. Ashby , Roel Wuyts , Wilfried Verachtert

Epidemiology models are central in understanding and controlling large scale pandemics. Several epidemiology models require simulation-based inference such as Approximate Bayesian Computation (ABC) to fit their parameters to observations.…

分布式、并行与集群计算 · 计算机科学 2022-02-16 Sourabh Kulkarni , Mario Michael Krell , Seth Nabarro , Csaba Andras Moritz

The increasing complexity of transformer models in artificial intelligence expands their computational costs, memory usage, and energy consumption. Hardware acceleration tackles the ensuing challenges by designing processors and…

硬件体系结构 · 计算机科学 2023-12-21 Alireza Amirshahi , Giovanni Ansaloni , David Atienza

AI-enabled decision-support systems aim to help medical providers rapidly make decisions with limited information during medical emergencies. A critical challenge in developing these systems is supporting providers in interpreting the…

Approximate computing is being considered as a promising design paradigm to overcome the energy and performance challenges in computationally demanding applications. If the case where the accuracy can be configured, the quality level versus…

机器学习 · 计算机科学 2019-01-07 Shayan Tabatabaei Nikkhah , Mehdi Kamal , Ali Afzali-Kusha , Massoud Pedram

Model efficiency is a critical aspect of developing and deploying machine learning models. Inference time and latency directly affect the user experience, and some applications have hard requirements. In addition to inference costs, model…

机器学习 · 计算机科学 2022-03-17 Mostafa Dehghani , Anurag Arnab , Lucas Beyer , Ashish Vaswani , Yi Tay

Accurately controlling a robotic system in real time is a challenging problem. To address this, the robotics community has adopted various algorithms, such as Model Predictive Control (MPC) and Model Predictive Path Integral (MPPI) control.…

硬件体系结构 · 计算机科学 2026-01-21 Erwan Tanguy-Legac , Tommaso Belvedere , Gianluca Corsini , Marco Tognon , Marcello Traiola

Image recognition tasks typically use deep learning and require enormous processing power, thus relying on hardware accelerators like GPUs and FPGAs for fast, timely processing. Failure in real-time image recognition tasks can occur due to…

机器学习 · 计算机科学 2023-02-22 Nikolaos Louloudakis , Perry Gibson , José Cano , Ajitha Rajan

The pervasive integration of Artificial Intelligence models into contemporary mobile computing is notable across numerous use cases, from virtual assistants to advanced image processing. Optimizing the mobile user experience involves…

机器学习 · 计算机科学 2025-11-18 Iulius Gherasim , Carlos García Sánchez

Deep learning has become widely used in complex AI applications. Yet, training a deep neural network (DNNs) model requires a considerable amount of calculations, long running time, and much energy. Nowadays, many-core AI accelerators (e.g.,…

分布式、并行与集群计算 · 计算机科学 2020-10-12 Yuxin Wang , Qiang Wang , Shaohuai Shi , Xin He , Zhenheng Tang , Kaiyong Zhao , Xiaowen Chu

Hardware acceleration of database query processing can be done with the help of FPGAs. In particular, they are partially reconfigurable during runtime, which allows for the runtime adaption of the hardware to a variety of queries.…

数据库 · 计算机科学 2020-01-30 Lekshmi B. G. , Andreas Becher , Klaus Meyer-Wegener

Generative artificial intelligence (AI) technology is revolutionizing the computing industry. Not only its applications have broadened to various sectors but also poses new system design and optimization opportunities. The technology is…

In recent years, artificial intelligence (AI) technologies have found industrial applications in various fields. AI systems typically possess complex software and heterogeneous CPU/GPU hardware architecture, making it difficult to answer…

软件工程 · 计算机科学 2022-04-08 Vyacheslav Zhdanovskiy , Lev Teplyakov , Anton Grigoryev

Neural Networks (NN) provide a solid and reliable way of executing different types of applications, ranging from speech recognition to medical diagnosis, speeding up onerous and long workloads. The challenges involved in their…

硬件体系结构 · 计算机科学 2023-09-26 Federico Manca , Francesco Ratto

The shift from scaling up the pre-training compute of AI systems to scaling up their inference compute may have profound effects on AI governance. The nature of these effects depends crucially on whether this new inference compute will…

计算机与社会 · 计算机科学 2025-03-11 Toby Ord

While GPUs are responsible for training the vast majority of state-of-the-art deep learning models, the implications of their architecture are often overlooked when designing new deep learning (DL) models. As a consequence, modifying a DL…

分布式、并行与集群计算 · 计算机科学 2024-02-01 Quentin Anthony , Jacob Hatef , Deepak Narayanan , Stella Biderman , Stas Bekman , Junqi Yin , Aamir Shafi , Hari Subramoni , Dhabaleswar Panda

The rapid evolution of embedded systems, along with the growing variety and complexity of AI algorithms, necessitates a powerful hardware/software co-design methodology based on virtual prototyping technologies. The market offers a diverse…

分布式、并行与集群计算 · 计算机科学 2025-10-20 Tim Kraus , Axel Sauer , Ingo Feldner

A robot can invoke heterogeneous computation resources such as CPUs, cloud GPU servers, or even human computation for achieving a high-level goal. The problem of invoking an appropriate computation model so that it will successfully…

机器人学 · 计算机科学 2021-08-04 Bineet Ghosh , Sandeep Chinchali , Parasara Sridhar Duggirala