中文
相关论文

相关论文: Beyond Inference: Performance Analysis of DNN Serv…

200 篇论文

This research aims to explore the application of deep learning in autonomous driving computer vision technology and its impact on improving system performance. By using advanced technologies such as convolutional neural networks (CNN),…

计算机视觉与模式识别 · 计算机科学 2024-06-05 Jingyu Zhang , Jin Cao , Jinghao Chang , Xinjin Li , Houze Liu , Zhenglin Li

Deep Neural Networks (DNNs) are universal function approximators providing state-of- the-art solutions on wide range of applications. Common perceptual tasks such as speech recognition, image classification, and object tracking are now…

机器学习 · 统计学 2017-11-08 Randall Balestriero , Richard Baraniuk

We propose a new model for unsupervised document embedding. Leading existing approaches either require complex inference or use recurrent neural networks (RNN) that are difficult to parallelize. We take a different route and develop a…

计算与语言 · 计算机科学 2018-02-21 Chundi Liu , Shunan Zhao , Maksims Volkovs

With ever-increasing computational demand for deep learning, it is critical to investigate the implications of the numeric representation and precision of DNN model weights and activations on computational efficiency. In this work, we…

As one of most fascinating machine learning techniques, deep neural network (DNN) has demonstrated excellent performance in various intelligent tasks such as image classification. DNN achieves such performance, to a large extent, by…

计算机视觉与模式识别 · 计算机科学 2018-03-16 Zihao Liu , Tao Liu , Wujie Wen , Lei Jiang , Jie Xu , Yanzhi Wang , Gang Quan

In this work we address the task of observing the performance of a semantic segmentation deep neural network (DNN) during online operation, i.e., during inference, which is of high importance in safety-critical applications such as…

计算机视觉与模式识别 · 计算机科学 2021-04-13 Marvin Klingner , Andreas Bär , Marcel Mross , Tim Fingscheidt

In the past few years, convolutional neural nets (CNN) have shown incredible promise for learning visual representations. In this paper, we use CNNs for the task of predicting surface normals from a single image. But what is the right…

计算机视觉与模式识别 · 计算机科学 2014-11-19 Xiaolong Wang , David F. Fouhey , Abhinav Gupta

Deep neural networks (DNNs) have shown very promising results for various image restoration (IR) tasks. However, the design of network architectures remains a major challenging for achieving further improvements. While most existing…

计算机视觉与模式识别 · 计算机科学 2020-10-28 Weisheng Dong , Peiyao Wang , Wotao Yin , Guangming Shi , Fangfang Wu , Xiaotong Lu

Recently, deep neural networks (DNNs) have shown advantages in accelerating optimization algorithms. One approach is to unfold finite number of iterations of conventional optimization algorithms and to learn parameters in the algorithms.…

机器学习 · 计算机科学 2021-04-23 Byung Hyun Lee , Se Young Chun

Deep neural network (DNN) latency characterization is a time-consuming process and adds significant cost to Neural Architecture Search (NAS) processes when searching for efficient convolutional neural networks for embedded vision…

机器学习 · 计算机科学 2022-05-26 Saad Abbasi , Alexander Wong , Mohammad Javad Shafiee

Modern machine learning tools such as deep neural networks (DNNs) are playing a revolutionary role in many fields such as natural language processing, computer vision, and the internet of things. Once they are trained, deep learning models…

机器学习 · 计算机科学 2022-01-19 Arjun Parthasarathy , Bhaskar Krishnamachari

When executing a deep neural network (DNN), its model parameters are loaded into GPU memory before execution, incurring a significant GPU memory burden. There are studies that reduce GPU memory usage by exploiting CPU memory as a swap…

机器学习 · 计算机科学 2022-10-11 Mingoo Ji , Saehanseul Yi , Changjin Koo , Sol Ahn , Dongjoo Seo , Nikil Dutt , Jong-Chan Kim

As edge computing expands, serving multiple deep neural network (DNN) models on a single shared GPU has become a common yet challenging scenario, where each scheduling decision affects the tail latency of all concurrent queues. Existing…

分布式、并行与集群计算 · 计算机科学 2026-05-08 Jiahe Cao , Xiaomeng Li , Qiang Liu , Tao Han , Ning Zhang , Weisong Shi

Advancements in deep learning are revolutionizing science and engineering. The immense success of deep learning is largely due to its ability to extract essential high-dimensional (HD) features from input data and make inference decisions…

机器学习 · 计算机科学 2025-01-30 Md Tauhidul Islam , Lei Xing

The remarkable performance of modern deep neural networks (DNNs) is largely driven by their massive scale, often comprising tens to hundreds of millions-or even billions-of parameters. However, such a scale incurs substantial storage and…

机器学习 · 计算机科学 2026-05-01 Mingyuan Wang , Yangzi Guo , Sida Liu , Yuhang Liu

Recent advances in learning Deep Neural Network (DNN) architectures have received a great deal of attention due to their ability to outperform state-of-the-art classifiers across a wide range of applications, with little or no feature…

密码学与安全 · 计算机科学 2018-04-03 Se Eun Oh , Saikrishna Sunkam , Nicholas Hopper

Deep Neural Networks (DNNs) have gained immense success in cognitive applications and greatly pushed today's artificial intelligence forward. The biggest challenge in executing DNNs is their extremely data-extensive computations. The…

计算机视觉与模式识别 · 计算机科学 2019-09-10 Fuqiang Liu , C. Liu

The remarkable performance of deep neural networks (DNNs) currently makes them the method of choice for solving linear inverse problems. They have been applied to super-resolve and restore images, as well as to reconstruct MR and CT images.…

图像与视频处理 · 电气工程与系统科学 2021-06-01 Marija Vella , João F. C. Mota

Deep neural networks (DNNs) play a crucial role in the field of machine learning, demonstrating state-of-the-art performance across various application domains. However, despite their success, DNN-based models may occasionally exhibit…

机器学习 · 计算机科学 2024-07-02 Guy Amir , Osher Maayan , Tom Zelazny , Guy Katz , Michael Schapira

DNNs are ubiquitous on edge devices nowadays. With its increasing importance and use cases, it's not likely to pack all DNNs into device memory and expect that each inference has been warmed up. Therefore, cold inference, the process to…

机器学习 · 计算机科学 2023-08-29 Rongjie Yi , Ting Cao , Ao Zhou , Xiao Ma , Shangguang Wang , Mengwei Xu