English
Related papers

Related papers: Design and accuracy trade-offs in Computational St…

200 papers

Today's graphs used in domains such as machine learning or social network analysis may contain hundreds of billions of edges. Yet, they are not necessarily stored efficiently, and standard graph representations such as adjacency lists waste…

Data Structures and Algorithms · Computer Science 2020-11-02 Maciej Besta , Dimitri Stanojevic , Tijana Zivic , Jagpreet Singh , Maurice Hoerold , Torsten Hoefler

This paper presents a mixed-computation neural network processing approach for edge applications that incorporates low-precision (low-width) Posit and low-precision fixed point (FixP) number systems. This mixed-computation approach employs…

Machine Learning · Computer Science 2023-12-06 Seyedarmin Azizi , Mahdi Nazemi , Mehdi Kamal , Massoud Pedram

Data files often consist of numbers having only a few significant decimal digits, whose information content would allow storage in only 32 bits. However, we may require that arithmetic operations involving these numbers be done with 64-bit…

Computation · Statistics 2015-04-14 Radford M. Neal

In this paper, we revisit the class of iterative shrinkage-thresholding algorithms (ISTA) for solving the linear inverse problem with sparse representation, which arises in signal and image processing. It is shown in the numerical…

Optimization and Control · Mathematics 2023-01-18 Bowen Li , Bin Shi , Ya-xiang Yuan

Energy and power consumption are major limitations to continued scaling of computing systems. Inexactness, where the quality of the solution can be traded for energy savings, has been proposed as an approach to overcoming those limitations.…

Other Computer Science · Computer Science 2016-10-13 Sven Leyffer , Stefan M. Wild , Mike Fagan , Marc Snir , Krishna Palem , Kazutomo Yoshii , Hal Finkel

This paper describes in detail the bitonic sort algorithm,and implements the bitonic sort algorithm based on cuda architecture.At the same time,we conduct two effective optimization of implementation details according to the characteristics…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-10-31 Qi Mu , Liqing Cui , Yufei Song

ROOT provides an flexible format used throughout the HEP community. The number of use cases - from an archival data format to end-stage analysis - has required a number of tradeoffs to be exposed to the user. For example, a high…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-12-06 Zhe Zhang , Brian Bockelman

Logarithmic number systems (LNS) are used to represent real numbers in many applications using a constant base raised to a fixed-point exponent making its distribution exponential. This greatly simplifies hardware multiply, divide and…

Numerical Analysis · Mathematics 2022-01-26 Syed Asad Alam , James Garland , David Gregg

The semiconductor and IC industry is facing the issue of high energy consumption. In modern days computers and processing systems are designed based on the Turing machine and Von Neumann's architecture. This architecture mainly focused on…

Emerging Technologies · Computer Science 2020-11-11 S. Rahimi Kari

Traditional Deep Neural Network (DNN) quantization methods using integer, fixed-point, or floating-point data types struggle to capture diverse DNN parameter distributions at low precision, and often require large silicon overhead and…

Hardware Architecture · Computer Science 2024-03-28 Akshat Ramachandran , Zishen Wan , Geonhwa Jeong , John Gustafson , Tushar Krishna

Modern data analytics requires a huge amount of computing power and processes a massive amount of data. At the same time, the underlying computing platform is becoming much more heterogeneous on both hardware and software. Even though…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-03-13 Zeke Wang , Jie Zhang , Hongjing Huang , Yingtao Li , Xueying Zhu , Mo Sun , Zihan Yang , De Ma , Huajing Tang , Gang Pan , Fei Wu , Bingsheng He , Gustavo Alonso

In the field of High Performance Computing, communications among processes represent a typical bottleneck for massively parallel scientific applications. Object of this research is the development of a network interface card with specific…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-09-07 Roberto Ammendola

As the demand for efficient, low-power computing in embedded and edge devices grows, traditional computing methods are becoming less effective for handling complex tasks. Stochastic computing (SC) offers a promising alternative by…

FPGA is appropriate for fix-point neural networks computing due to high power efficiency and configurability. However, its design must be intensively refined to achieve high performance using limited hardware resources. We present an…

Hardware Architecture · Computer Science 2022-01-03 Qingyang Yi , Heming Sun , Masahiro Fujita

In this paper, we discuss distributed optimization over directed graphs, where doubly-stochastic weights cannot be constructed. Most of the existing algorithms overcome this issue by applying push-sum consensus, which utilizes…

Optimization and Control · Mathematics 2019-01-30 Ran Xin , Chenguang Xi , Usman A. Khan

Cluster computing was introduced to replace the superiority of super computers. Cluster computing is able to overcome the problems that cannot be effectively dealt with supercomputers. In this paper, we are going to evaluate the performance…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-09-15 Cinantya Paramita , Fauzi Adi Rafrastara , Usman Sudibyo , R. I. W. Agung Wibowo

Posit has been a promising alternative to the IEEE-754 floating point format for deep learning applications due to its better trade-off between dynamic range and accuracy. However, hardware implementation of posit arithmetic requires…

Hardware Architecture · Computer Science 2023-07-27 Qiong Li , Chao Fang , Zhongfeng Wang

Given an input $x$, and a search problem $F$, local computation algorithms (LCAs) implement access to specified locations of $y$ in a legal output $y \in F(x)$, using polylogarithmic time and space. Mansour et al., (2012), had previously…

Data Structures and Algorithms · Computer Science 2014-04-23 Omer Reingold , Shai Vardi

Multipliers are widely-used arithmetic operators in digital signal processing and machine learning circuits. Due to their relatively high complexity, they can have high latency and be a significant source of power consumption. One strategy…

Hardware Architecture · Computer Science 2023-10-17 Shervin Vakili , Mobin Vaziri , Amirhossein Zarei , J. M. Pierre Langlois

Dealing with the shear size and complexity of today's massive data sets requires computational platforms that can analyze data in a parallelized and distributed fashion. A major bottleneck that arises in such modern distributed computing…

Information Theory · Computer Science 2019-04-03 A. Salman Avestimehr , Seyed Mohammadreza Mousavi Kalan , Mahdi Soltanolkotabi