English
Related papers

Related papers: Measuring what Really Matters: Optimizing Neural N…

200 papers

Transformers have revolutionized the machine learning landscape, gradually making their way into everyday tasks and equipping our computers with "sparks of intelligence". However, their runtime requirements have prevented them from being…

Machine Learning · Computer Science 2024-07-29 Stefanos Laskaridis , Kleomenis Katevas , Lorenzo Minto , Hamed Haddadi

The rise of power-efficient embedded computers based on highly-parallel accelerators opens a number of opportunities and challenges for researchers and engineers, and paved the way to the era of edge computing. At the same time, advances in…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-10-13 Paolo Burgio , Gianluca Brilli

With more scientific fields relying on neural networks (NNs) to process data incoming at extreme throughputs and latencies, it is crucial to develop NNs with all their parameters stored on-chip. In many of these applications, there is not…

Machine Learning · Computer Science 2024-03-15 Olivia Weng , Alexander Redding , Nhan Tran , Javier Mauricio Duarte , Ryan Kastner

Over the past decade, the dominance of deep learning has prevailed across various domains of artificial intelligence, including natural language processing, computer vision, and biomedical signal processing. While there have been remarkable…

Computer Vision and Pattern Recognition · Computer Science 2024-04-15 Hou-I Liu , Marco Galindo , Hongxia Xie , Lai-Kuan Wong , Hong-Han Shuai , Yung-Hui Li , Wen-Huang Cheng

With the increase in data availability, it has been widely demonstrated that neural networks (NN) can capture complex system dynamics precisely in a data-driven manner. However, the architectural complexity and nonlinearity of the NNs make…

Systems and Control · Electrical Eng. & Systems 2023-08-29 Shaoru Chen , Kong Yao Chee , Nikolai Matni , M. Ani Hsieh , George J. Pappas

Machine learning (ML) entered the field of computational micromagnetics only recently. The main objective of these new approaches is the automatization of solutions of parameter-dependent problems in micromagnetism such as fast response…

Computational Physics · Physics 2021-07-15 Sebastian Schaffer , Norbert J. Mauser , Thomas Schrefl , Dieter Suess , Lukas Exl

Tiny machine learning (TinyML) is a fast-growing research area committed to democratizing deep learning for all-pervasive microcontrollers (MCUs). Challenged by the constraints on power, memory, and computation, TinyML has achieved…

Machine Learning · Computer Science 2021-04-13 Haoyu Ren , Darko Anicic , Thomas Runkler

Machine learning on tiny IoT devices based on microcontroller units (MCU) is appealing but challenging: the memory of microcontrollers is 2-3 orders of magnitude smaller even than mobile phones. We propose MCUNet, a framework that jointly…

Computer Vision and Pattern Recognition · Computer Science 2020-11-20 Ji Lin , Wei-Ming Chen , Yujun Lin , John Cohn , Chuang Gan , Song Han

Computational experiments are exploited in finding a well-designed processing path to optimize material structures for desired properties. This requires understanding the interplay between the processing-(micro)structure-property linkages…

Computational Engineering, Finance, and Science · Computer Science 2023-05-04 Junrong Lin , Mahmudul Hasan , Pinar Acar , Jose Blanchet , Vahid Tarokh

Edge computing's growing prominence, due to its ability to reduce communication latency and enable real-time processing, is promoting the rise of high-performance, heterogeneous System-on-Chip solutions. While current approaches often…

Artificial Intelligence · Computer Science 2024-09-24 Rakshith Jayanth , Neelesh Gupta , Viktor Prasanna

Machine learning models are being used extensively in many important areas, but there is no guarantee a model will always perform well or as its developers intended. Understanding the correctness of a model is crucial to prevent potential…

Machine Learning · Computer Science 2021-04-13 Huong Ha , Sunil Gupta , Santu Rana , Svetha Venkatesh

Deploying machine learning-based intrusion detection systems (IDSs) on hardware devices is challenging due to their limited computational resources, power consumption, and network connectivity. Hence, there is a significant need for robust,…

Cryptography and Security · Computer Science 2024-03-05 Rabin Yu Acharya , Laurens Le Jeune , Nele Mentens , Fatemeh Ganji , Domenic Forte

Neural Networks (NNs) are the method of choice for building learning algorithms. Their popularity stems from their empirical success on several challenging learning problems. However, most scholars agree that a convincing theoretical…

Numerical Analysis · Mathematics 2021-01-01 Ronald DeVore , Boris Hanin , Guergana Petrova

The widespread integration of embedded systems across various industries has facilitated seamless connectivity among devices and bolstered computational capabilities. Despite their extensive applications, embedded systems encounter…

Cryptography and Security · Computer Science 2024-04-16 Sreenitha Kasarapu , Sathwika Bavikadi , Sai Manoj Pudukotai Dinakarrao

This work presents an in-depth analysis of the majority of the deep neural networks (DNNs) proposed in the state of the art for image recognition. For each DNN multiple performance indices are observed, such as recognition accuracy, model…

Computer Vision and Pattern Recognition · Computer Science 2023-09-15 Simone Bianco , Remi Cadene , Luigi Celona , Paolo Napoletano

Tiny Machine Learning (TinyML) systems, which enable machine learning inference on highly resource-constrained devices, are transforming edge computing but encounter unique security challenges. These devices, restricted by RAM and CPU…

Cryptography and Security · Computer Science 2024-11-12 Jacob Huckelberry , Yuke Zhang , Allison Sansone , James Mickens , Peter A. Beerel , Vijay Janapa Reddi

For the past couple of decades, numerical optimization has played a central role in addressing wireless resource management problems such as power control and beamformer design. However, optimization algorithms often entail considerable…

Information Theory · Computer Science 2018-09-18 Haoran Sun , Xiangyi Chen , Qingjiang Shi , Mingyi Hong , Xiao Fu , Nicholas D. Sidiropoulos

The rapid proliferation of computing domains relying on Internet of Things (IoT) devices has created a pressing need for efficient and accurate deep-learning (DL) models that can run on low-power devices. However, traditional DL models tend…

Patients are often encouraged to make use of wearable devices for remote collection and monitoring of health data. This adoption of wearables results in a significant increase in the volume of data collected and transmitted. The battery…

Machine Learning · Computer Science 2022-01-19 Qi An , Patryk Szewczyk , Michael N Johnstone , James Jin Kang

Graph classification benchmarks, vital for assessing and developing graph neural networks (GNNs), have recently been scrutinized, as simple methods like MLPs have demonstrated comparable performance. This leads to an important question: Do…

Machine Learning · Computer Science 2024-08-14 Zhengdao Li , Yong Cao , Kefan Shuai , Yiming Miao , Kai Hwang