English
Related papers

Related papers: SparseMap: Loop Mapping for Sparse CNNs on Streami…

200 papers

Graph Convolutional Networks (GCNs) is the state-of-the-art method for learning graph-structured data, and training large-scale GCNs requires distributed training across multiple accelerators such that each accelerator is able to hold a…

Machine Learning · Computer Science 2022-03-22 Cheng Wan , Youjie Li , Cameron R. Wolfe , Anastasios Kyrillidis , Nam Sung Kim , Yingyan Lin

Convolutional Neural Networks (CNNs) have proven to be extremely accurate for image recognition, even outperforming human recognition capability. When deployed on battery-powered mobile devices, efficient computer architectures are required…

Hardware Architecture · Computer Science 2020-10-05 Mehdi Ahmadi , Shervin Vakili , J. M. Pierre Langlois

With the increasing development of neuromorphic platforms and their related software tools as well as the increasing scale of spiking neural network (SNN) models, there is a pressure for interoperable and scalable representations of network…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-04-13 Felix Wang

Sparse convolution plays a pivotal role in emerging workloads, including point cloud processing in AR/VR, autonomous driving, and graph understanding in recommendation systems. Since the computation pattern is sparse and irregular,…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-11-23 Haotian Tang , Shang Yang , Zhijian Liu , Ke Hong , Zhongming Yu , Xiuyu Li , Guohao Dai , Yu Wang , Song Han

Novel sparse reconstruction algorithms are proposed for beamspace channel estimation in massive multiple-input multiple-output systems. The proposed algorithms minimize a least-squares objective having a nonconvex regularizer. This…

Information Theory · Computer Science 2021-12-02 Pengxia Wu , Julian Cheng

Dynamic graph neural networks have been widely used in modeling and representation learning of graph structure data. Current dynamic representation learning focuses on either discrete learning which results in temporal information loss or…

Machine Learning · Computer Science 2022-02-11 Yan Pang , Chao Liu

Graph Convolutional Networks (GCNs) have proven to be successful tools for semi-supervised classification on graph-based datasets. We propose a new GCN variant whose three-part filter space is targeted at dense graphs. Examples include…

Machine Learning · Computer Science 2021-01-29 Dominik Alfke , Martin Stoll

The next generation HPC and data centers are likely to be reconfigurable and data-centric due to the trend of hardware specialization and the emergence of data-driven applications. In this paper, we propose ARENA -- an asynchronous…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-04-20 Cheng Tan , Chenhao Xie , Tong Geng , Andres Marquez , Antonino Tumeo , Kevin Barker , Ang Li

Recent advances in event-based research prioritize sparsity and temporal precision. Approaches using dense frame-based representations processed via well-pretrained CNNs are being replaced by the use of sparse point-based representations…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Yongjian Deng , Hao Chen , Bochen Xie , Hai Liu , Youfu Li

In the era of artificial intelligence, convolutional neural networks (CNNs) are emerging as a powerful technique for computational imaging. They have shown superior quality for reconstructing fine textures from badly-distorted images and…

Neural and Evolutionary Computing · Computer Science 2021-04-20 Chao-Tsung Huang

To address the challenge of increasing network size, researchers have developed sparse models through network pruning. However, maintaining model accuracy while achieving significant speedups on general computing devices remains an open…

Artificial Intelligence · Computer Science 2023-10-31 Haitao Xu , Songwei Liu , Yuyang Xu , Shuai Wang , Jiashi Li , Chenqian Yan , Liangqiang Li , Lean Fu , Xin Pan , Fangmin Chen

Inspired by recent advances in deep learning, we propose a framework for reconstructing dynamic sequences of 2D cardiac magnetic resonance (MR) images from undersampled data using a deep cascade of convolutional neural networks (CNNs) to…

Computer Vision and Pattern Recognition · Computer Science 2017-11-27 Jo Schlemper , Jose Caballero , Joseph V. Hajnal , Anthony Price , Daniel Rueckert

Machine intelligence, especially using convolutional neural networks (CNNs), has become a large area of research over the past years. Increasingly sophisticated hardware accelerators are proposed that exploit e.g. the sparsity in…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-06-23 Andreas Bytyn , René Ahlsdorf , Rainer Leupers , Gerd Ascheid

This study develops a unified Point Cloud Geometry (PCG) compression method through the processing of multiscale sparse tensor-based voxelized PCG. We call this compression method SparsePCGC. The proposed SparsePCGC is a low complexity…

Computer Vision and Pattern Recognition · Computer Science 2022-10-24 Jianqiang Wang , Dandan Ding , Zhu Li , Xiaoxing Feng , Chuntong Cao , Zhan Ma

Training convolutional neural networks (CNNs) requires intense computations and high memory bandwidth. We find that bandwidth today is over-provisioned because most memory accesses in CNN training can be eliminated by rearranging…

Machine Learning · Computer Science 2019-05-07 Sangkug Lym , Armand Behroozi , Wei Wen , Ge Li , Yongkee Kwon , Mattan Erez

Sparse knowledge graph (KG) scenarios pose a challenge for previous Knowledge Graph Completion (KGC) methods, that is, the completion performance decreases rapidly with the increase of graph sparsity. This problem is also exacerbated…

Artificial Intelligence · Computer Science 2023-06-30 Tao He , Ming Liu , Yixin Cao , Zekun Wang , Zihao Zheng , Zheng Chu , Bing Qin

The predictive power of Convolutional Neural Networks (CNNs) has been an integral factor for emerging latency-sensitive applications, such as autonomous drones and vehicles. Such systems employ multiple CNNs, each one trained for a…

Computer Vision and Pattern Recognition · Computer Science 2021-06-09 Stylianos I. Venieris , Christos-Savvas Bouganis

Convolutional neural networks (CNNs) perform well on problems such as handwriting recognition and image classification. However, the performance of the networks is often limited by budget and time constraints, particularly when trying to…

Computer Vision and Pattern Recognition · Computer Science 2014-09-23 Benjamin Graham

The Transformer has been an indispensable staple in deep learning. However, for real-life applications, it is very challenging to deploy efficient Transformers due to immense parameters and operations of models. To relieve this burden,…

Hardware Architecture · Computer Science 2022-11-01 Chao Fang , Aojun Zhou , Zhongfeng Wang

Machine learning algorithms are being used more frequently in the first-level triggers in collider experiments, with Graph Neural Networks pushing the hardware requirements of FPGA-based triggers beyond the current state of the art. To meet…

High Energy Physics - Experiment · Physics 2026-02-27 Marc Neu , Isabel Haide , Torben Ferber , Jürgen Becker