English
Related papers

Related papers: DeLTA: GPU Performance Model for Deep Learning App…

200 papers

Natural Language Processing (NLP) is widely used in fields like machine translation and sentiment analysis. However, traditional NLP models struggle with accuracy and efficiency. This paper introduces Deep Convolutional Neural Networks…

Computation and Language · Computer Science 2024-12-23 Chang Weng , Scott Rood , Mehdi Ali Ramezani , Amir Aslani , Reza Zarrab , Wang Zwuo , Sanjeev Salimans , Tim Satheesh

Dataflow-based CNN accelerators on FPGAs achieve low latency and high throughput by mapping computations of each layer directly to corresponding hardware units. However, layers such as pooling and strided convolutions reduce the data at…

Hardware Architecture · Computer Science 2026-03-11 Tobias Habermann , Martin Kumm

Convolutional Neural Networks (CNNs) have achieved impressive performance on many computer vision related tasks, such as object detection, image recognition, image retrieval, etc. These achievements benefit from the CNNs' outstanding…

Machine Learning · Computer Science 2021-11-09 Dung Truong , Scott Makeig , Arnaud Delorme

The ability to train large-scale neural networks has resulted in state-of-the-art performance in many areas of computer vision. These results have largely come from computational break throughs of two forms: model parallelism, e.g. GPU…

Computer Vision and Pattern Recognition · Computer Science 2013-12-24 Thomas Paine , Hailin Jin , Jianchao Yang , Zhe Lin , Thomas Huang

Deep learning researchers and practitioners usually leverage GPUs to help train their deep neural networks (DNNs) faster. However, choosing which GPU to use is challenging both because (i) there are many options, and (ii) users grapple with…

Machine Learning · Computer Science 2021-06-09 Geoffrey X. Yu , Yubo Gao , Pavel Golikov , Gennady Pekhimenko

Convolutional Neural Networks (CNNs) have shown a great deal of success in diverse application domains including computer vision, speech recognition, and natural language processing. However, as the size of datasets and the depth of neural…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-12-07 Wonje Choi , Karthi Duraisamy , Ryan Gary Kim , Janardhan Rao Doppa , Partha Pratim Pande , Diana Marculescu , Radu Marculescu

Convolutional Neural Networks (CNNs) are successfully used for the important automotive visual perception tasks including object recognition, motion and depth estimation, visual SLAM, etc. However, these tasks are typically independently…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Ganesh Sistu , Isabelle Leang , Sumanth Chennupati , Senthil Yogamani , Ciaran Hughes , Stefan Milz , Samir Rawashdeh

We define a novel type of ensemble Graph Convolutional Network (GCN) model. Using optimized linear projection operators to map between spatial scales of graph, this ensemble model learns to aggregate information from each scale for its…

Machine Learning · Computer Science 2020-04-08 C. B. Scott , Eric Mjolsness

Deep convolutional neural networks (CNNs) have achieved remarkable success in various fields. However, training an excellent CNN is practically a trial-and-error process that consumes a tremendous amount of time and computer resources. To…

Computer Vision and Pattern Recognition · Computer Science 2018-08-28 Dongyu Liu , Weiwei Cui , Kai Jin , Yuxiao Guo , Huamin Qu

Deep neural networks can be obscenely wasteful. When processing video, a convolutional network expends a fixed amount of computation for each frame with no regard to the similarity between neighbouring frames. As a result, it ends up…

Neural and Evolutionary Computing · Computer Science 2016-11-11 Peter O'Connor , Max Welling

Convolutional neural networks (CNNs) have rapidly risen in popularity for many machine learning applications, particularly in the field of image recognition. Much of the benefit generated from these networks comes from their ability to…

Quantum Physics · Physics 2019-04-10 Maxwell Henderson , Samriddhi Shakya , Shashindra Pradhan , Tristan Cook

Large-scale graph training is a notoriously challenging problem for graph neural networks (GNNs). Due to the nature of evolving graph structures into the training process, vanilla GNNs usually fail to scale up, limited by the GPU memory…

Machine Learning · Computer Science 2023-03-02 Keyu Duan , Zirui Liu , Peihao Wang , Wenqing Zheng , Kaixiong Zhou , Tianlong Chen , Xia Hu , Zhangyang Wang

We introduce a model-based image reconstruction framework with a convolution neural network (CNN) based regularization prior. The proposed formulation provides a systematic approach for deriving deep architectures for inverse problems with…

Computer Vision and Pattern Recognition · Computer Science 2019-06-06 Hemant Kumar Aggarwal , Merry P. Mani , Mathews Jacob

Graph Neural Networks (GNNs) use a fully-connected layer to extract features from the nodes of a graph and aggregate these features using message passing between nodes, combining two distinct computational patterns: dense, regular…

Hardware Architecture · Computer Science 2021-03-22 Jacob R. Stevens , Dipankar Das , Sasikanth Avancha , Bharat Kaul , Anand Raghunathan

In the fusion community, the use of high performance computing (HPC) has been mostly dominated by heavy-duty plasma simulations, such as those based on particle-in-cell and gyrokinetic codes. However, there has been a growing interest in…

Computational Physics · Physics 2021-06-14 Diogo R. Ferreira

Deep Neural Networks (DNNs) have shown unparalleled achievements in numerous applications, reflecting their proficiency in managing vast data sets. Yet, their static structure limits their adaptability in ever-changing environments. This…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Yunjie Zhu , Yunhao Chen

Graph Convolutional Neural Network (GCNN) is a popular class of deep learning (DL) models in material science to predict material properties from the graph representation of molecular structures. Training an accurate and comprehensive GCNN…

Machine Learning · Computer Science 2022-07-26 Jong Youl Choi , Pei Zhang , Kshitij Mehta , Andrew Blanchard , Massimiliano Lupo Pasini

Scene parsing is an important and challenging prob- lem in computer vision. It requires labeling each pixel in an image with the category it belongs to. Tradition- ally, it has been approached with hand-engineered features from color…

Machine Learning · Statistics 2014-11-18 Rahul Mohan

In this work, we investigate the value of employing deep learning for the task of wireless signal modulation recognition. Recently in [1], a framework has been introduced by generating a dataset using GNU radio that mimics the imperfections…

Machine Learning · Computer Science 2018-01-08 Xiaoyu Liu , Diyu Yang , Aly El Gamal

Recently, methods that represent data as a graph, such as graph neural networks (GNNs) have been successfully used to learn data representations and structures to solve classification and link prediction problems. The applications of such…

Machine Learning · Computer Science 2022-10-04 Usman Mahmood , Zening Fu , Vince Calhoun , Sergey Plis