English
Related papers

Related papers: Developing a Self-Explanatory Transformer

200 papers

The advent of Programmable Data Planes represents an outstanding evolution and complete revolution of the Software- Defined Networking paradigm. The capacity to define the entire behavior of forwarding devices by controlling the packet…

Networking and Internet Architecture · Computer Science 2021-06-02 Sergio Armando Gutiérrez , John Willian Branch , Luciano Paschoal Gaspary , Juan Felipe Botero

In the era of the Internet of Things (IoT), where smartphones, built-in systems, wireless sensors, and nearly every smart device connect through local networks or the internet, billions of smart things communicate with each other and…

Machine Learning · Computer Science 2024-10-28 Duygu Altunkaya , Feyza Yildirim Okay , Suat Ozdemir

This document aims to be a self-contained, mathematically precise overview of transformer architectures and algorithms (*not* results). It covers what transformers are, how they are trained, what they are used for, their key architectural…

Machine Learning · Computer Science 2022-07-26 Mary Phuong , Marcus Hutter

Developed by OpenAI, ChatGPT (Conditional Generative Pre-trained Transformer) is an artificial intelligence technology that is fine-tuned using supervised machine learning and reinforcement learning techniques, allowing a computer to…

Machine learning (ML) is successful in achieving human-level artificial intelligence in various fields. However, it lacks the ability to explain an outcome due to its black-box nature. While recent efforts on explainable AI (XAI) has…

Machine Learning · Computer Science 2023-05-09 Zhixin Pan , Prabhat Mishra

Time-series forecasts are essential for planning and decision-making in many domains. Explainability is key to building user trust and meeting transparency requirements. Shapley Additive Explanations (SHAP) is a popular explainable AI…

Machine Learning · Computer Science 2025-12-24 Matthias Hertel , Sebastian Pütz , Ralf Mikut , Veit Hagenmeyer , Benjamin Schäfer

The growing adoption of Deep Learning (DL) applications in the Internet of Things has increased the demand for energy-efficient accelerators. Field Programmable Gate Arrays (FPGAs) offer a promising platform for such acceleration due to…

Hardware Architecture · Computer Science 2025-04-15 Chao Qian

The Internet of Things (IoT) will be ripe for the deployment of novel machine learning algorithms for both network and application management. However, given the presence of massively distributed and private datasets, it is challenging to…

Networking and Internet Architecture · Computer Science 2021-06-21 Latif U. Khan , Walid Saad , Zhu Han , Ekram Hossain , Choong Seon Hong

The widespread use of the Internet of Things has led to the development of large amounts of perception data, making it necessary to develop effective and scalable data analysis tools. Federated Learning emerges as a promising paradigm to…

Cryptography and Security · Computer Science 2024-05-07 Ghazaleh Shirvani , Saeid Ghasemshirazi

This paper investigates the development and optimization of control algorithms for mobile robotics, with a keen focus on their implementation in Field-Programmable Gate Arrays (FPGAs). It delves into both classical control approaches such…

Robotics · Computer Science 2024-03-15 Andrés-David Suárez-Gómez , Andres A. Hernandez Ortega

Machine-type devices (MTDs) will lie at the heart of the Internet of Things (IoT) system. A key challenge in such a system is sharing network resources between small MTDs, which have limited memory and computational capabilities. In this…

Information Theory · Computer Science 2016-10-07 Taehyeun Park , Walid Saad

Autonomous surveillance missions in Internet of Things (IoT) networks often involve solving NP-hard combinatorial optimization problems to ensure efficient resource utilization. To address the limitations of conventional heuristics in…

Robotics · Computer Science 2026-05-07 Yazan Youssef , Paulo Ricardo Marques de Araujo , Aboelmagd Noureldin , Sidney Givigi

Topology optimization enables the design of highly efficient and complex structures, but conventional iterative methods, such as SIMP-based approaches, often suffer from high computational costs and sensitivity to initial conditions.…

Computational Engineering, Finance, and Science · Computer Science 2025-09-18 Aaron Lutheran , Srijan Das , Alireza Tabarraei

Personalization of natural language generation plays a vital role in a large spectrum of tasks, such as explainable recommendation, review summarization and dialog systems. In these tasks, user and item IDs are important identifiers for…

Information Retrieval · Computer Science 2021-06-09 Lei Li , Yongfeng Zhang , Li Chen

The integration of the Internet of Robotic Things (IoRT) in smart greenhouses has revolutionised precision agriculture by enabling efficient and autonomous environmental control. However, existing time series forecasting models in such…

Machine Learning · Computer Science 2025-12-16 Muhammad Jawad Bashir , Shagufta Henna , Eoghan Furey

Transformer networks have emerged as the state-of-the-art approach for natural language processing tasks and are gaining popularity in other domains such as computer vision and audio processing. However, the efficient hardware acceleration…

Hardware Architecture · Computer Science 2024-07-29 Gamze İslamoğlu , Moritz Scherer , Gianna Paulin , Tim Fischer , Victor J. B. Jung , Angelo Garofalo , Luca Benini

The rapid growth of Internet of Things (IoT) devices has introduced significant challenges to privacy, particularly as network traffic analysis techniques evolve. While encryption protects data content, traffic attributes such as packet…

Cryptography and Security · Computer Science 2025-01-28 Daniel Adu Worae , Spyridon Mastorakis

Topology optimization is used for the design of high-performance structures but remains fundamentally limited by its iterative nature, requiring repeated finite element analyses that prevent real-time deployment and large-scale design…

Computational Engineering, Finance, and Science · Computer Science 2026-04-07 Aaron Lutheran , Srijan Das , Alireza Tabarraei

The Internet of Things (IoT) refers to a pervasive presence of interconnected and uniquely identifiable physical devices. These devices' goal is to gather data and drive actions in order to improve productivity, and ultimately reduce or…

Other Computer Science · Computer Science 2018-02-22 Tosiron Adegbija , Anita Rogacs , Chandrakant Patel , Ann Gordon-Ross

In various scenarios, achieving security between IoT devices is challenging since the devices may have different dedicated communication standards, resource constraints as well as various applications. In this article, we first provide…

Cryptography and Security · Computer Science 2017-09-20 Ruei-Hau Hsu , Jemin Lee , Tony Q. S. Quek , Jyh-Cheng Chen