中文
相关论文

相关论文: Reduced-Precision Strategies for Bounded Memory in…

200 篇论文

Deep Neural Networks (DNN) represent a performance-hungry application. Floating-Point (FP) and custom floating-point-like arithmetic satisfies this hunger. While there is need for speed, inference in DNNs does not seem to have any need for…

机器学习 · 计算机科学 2020-02-11 Christoph Lauter , Anastasia Volkova

The Convolutional Neural Network (CNN) model, often used for image classification, requires significant training time to obtain high accuracy. To this end, distributed training is performed with the parameter server (PS) architecture using…

分布式、并行与集群计算 · 计算机科学 2019-01-18 Jay H. Park , Sunghwan Kim , Jinwon Lee , Myeongjae Jeon , Sam H. Noh

While Convolutional Neural Networks (CNNs) excel at learning complex latent-space representations, their over-parameterization can lead to overfitting and reduced performance, particularly with limited data. This, alongside their high…

计算机视觉与模式识别 · 计算机科学 2024-01-17 Manish Sharma , Jamison Heard , Eli Saber , Panos P. Markopoulos

Depth prediction plays a key role in understanding a 3D scene. Several techniques have been developed throughout the years, among which Convolutional Neural Network has recently achieved state-of-the-art performance on estimating depth from…

计算机视觉与模式识别 · 计算机科学 2021-03-16 Binghan Li , Yindong Hua , Yifeng Liu , Mi Lu

Convolutional neural networks (CNNs) have been shown to achieve optimal approximation and estimation error rates (in minimax sense) in several function classes. However, previous analyzed optimal CNNs are unrealistically wide and difficult…

机器学习 · 统计学 2023-08-15 Kenta Oono , Taiji Suzuki

In recent years increasingly complex architectures for deep convolution networks (DCNs) have been proposed to boost the performance on image recognition tasks. However, the gains in performance have come at a cost of substantial increase in…

机器学习 · 计算机科学 2016-06-03 Darryl D. Lin , Sachin S. Talathi , V. Sreekanth Annapureddy

Deep neural networks (DNNs) have demonstrated their great potential in recent years, exceeding the per-formance of human experts in a wide range of applications. Due to their large sizes, however, compressiontechniques such as weight…

计算机视觉与模式识别 · 计算机科学 2021-10-15 Wentao Chen , Hailong Qiu , Jian Zhuang , Chutong Zhang , Yu Hu , Qing Lu , Tianchen Wang , Yiyu Shi , Meiping Huang , Xiaowe Xu

Neural Networks are currently one of the most widely deployed machine learning algorithms. In particular, Convolutional Neural Networks (CNNs), are gaining popularity and are evaluated for deployment in safety critical applications such as…

信号处理 · 电气工程与系统科学 2019-12-17 Giulio Gambardella , Johannes Kappauf , Michaela Blott , Christoph Doehring , Martin Kumm , Peter Zipf , Kees Vissers

This paper tackles the problem of training a deep convolutional neural network with both low-precision weights and low-bitwidth activations. Optimizing a low-precision network is very challenging since the training process can easily get…

计算机视觉与模式识别 · 计算机科学 2021-06-05 Bohan Zhuang , Chunhua Shen , Mingkui Tan , Lingqiao Liu , Ian Reid

DNNs have been quickly and broadly exploited to improve the data analysis quality in many complex science and engineering applications. Today's DNNs are becoming deeper and wider because of increasing demand on the analysis quality and more…

计算机视觉与模式识别 · 计算机科学 2019-04-24 Sian Jin , Sheng Di , Xin Liang , Jiannan Tian , Dingwen Tao , Franck Cappello

Low-dose CT denoising is a challenging task that has been studied by many researchers. Some studies have used deep neural networks to improve the quality of low-dose CT images and achieved fruitful results. In this paper, we propose a deep…

图像与视频处理 · 电气工程与系统科学 2019-02-28 Maryam Gholizadeh-Ansari , Javad Alirezaie , Paul Babyn

We present an approach to learn a dense pixel-wise labeling from image-level tags. Each image-level tag imposes constraints on the output labeling of a Convolutional Neural Network (CNN) classifier. We propose Constrained CNN (CCNN), a…

计算机视觉与模式识别 · 计算机科学 2015-10-20 Deepak Pathak , Philipp Krähenbühl , Trevor Darrell

Convolutional Neural Networks(CNN) has had a great success in the recent past, because of the advent of faster GPUs and memory access. CNNs are really powerful as they learn the features from data in layers such that they exhibit the…

计算机视觉与模式识别 · 计算机科学 2023-01-23 Atul Dhingra

A neural network architecture is presented that exploits the multilevel properties of high-dimensional parameter-dependent partial differential equations, enabling an efficient approximation of parameter-to-solution maps, rivaling…

机器学习 · 计算机科学 2024-08-21 Janina Enrica Schütte , Martin Eigel

Despite the remarkable performance, modern deep neural networks are inevitably accompanied by a significant amount of computational cost for learning and deployment, which may be incompatible with their usage on edge devices. Recent efforts…

计算机视觉与模式识别 · 计算机科学 2022-03-11 Seul-Ki Yeom , Kyung-Hwan Shim , Jee-Hyun Hwang

Recently, deep Convolutional Neural Networks (CNNs) have proven to be successful when employed in areas such as reduced order modeling of parametrized PDEs. Despite their accuracy and efficiency, the approaches available in the literature…

数值分析 · 数学 2023-01-26 Nicola Rares Franco , Stefania Fresca , Andrea Manzoni , Paolo Zunino

We report applications of Convolutional Neural Networks (CNN) to multi-classification classification of a large medical data set. We discuss in detail how changes in the CNN model and the data pre-processing impact the classification…

机器学习 · 计算机科学 2020-12-29 YuanZheng Hu , Marina Sokolova

Convolutional neural networks (CNNs) have shown great capability of solving various artificial intelligence tasks. However, the increasing model size has raised challenges in employing them in resource-limited applications. In this work, we…

计算机视觉与模式识别 · 计算机科学 2018-09-06 Hongyang Gao , Zhengyang Wang , Shuiwang Ji

Learn in-situ is a growing trend for Edge AI. Training deep neural network (DNN) on edge devices is challenging because both energy and memory are constrained. Low precision training helps to reduce the energy cost of a single training…

机器学习 · 计算机科学 2020-12-24 Tian Huang , Tao Luo , Joey Tianyi Zhou

Deep Neural Networks (DNNs) have shown unparalleled achievements in numerous applications, reflecting their proficiency in managing vast data sets. Yet, their static structure limits their adaptability in ever-changing environments. This…

计算机视觉与模式识别 · 计算机科学 2023-10-03 Yunjie Zhu , Yunhao Chen