中文
相关论文

相关论文: GPU Memory Requirement Prediction for Deep Learnin…

200 篇论文

Generative recommendation (GR) has emerged as a promising paradigm that replaces fragmented, scenario-specific architectures with unified Transformer-based models, exhibiting scaling-law behavior where recommendation quality improves…

分布式、并行与集群计算 · 计算机科学 2026-05-14 Huichao Chai , Zhixin Wu , Xuemiao Li , Shiqing Fan , Hengfeng Wang , Maojun Peng , Lu Xu , Yaoyuan Wang , Yibo Jin , Wei Guo , Yongxiang Feng

Gradient boosting decision trees (GBDTs) have seen widespread adoption in academia, industry and competitive data science due to their state-of-the-art performance in many machine learning tasks. One relative downside to these models is the…

机器学习 · 计算机科学 2019-01-18 Andreea Anghel , Nikolaos Papandreou , Thomas Parnell , Alessandro De Palma , Haralampos Pozidis

Going deeper and wider in neural architectures improves the accuracy, while the limited GPU DRAM places an undesired restriction on the network design domain. Deep Learning (DL) practitioners either need change to less desired network…

分布式、并行与集群计算 · 计算机科学 2018-01-17 Linnan Wang , Jinmian Ye , Yiyang Zhao , Wei Wu , Ang Li , Shuaiwen Leon Song , Zenglin Xu , Tim Kraska

We present a theoretical analysis of GPU memory consumption during the training of DeepSeek models such as DeepSeek-v2 and DeepSeek-v3. Our primary objective is to clarify the device-level memory requirements associated with various…

性能 · 计算机科学 2025-02-13 Ping Zhang , Lei Su

Host load prediction is essential for dynamic resource scaling and job scheduling in a cloud computing environment. In this context, workload prediction is challenging because of several issues. First, it must be accurate to enable precise…

分布式、并行与集群计算 · 计算机科学 2023-04-27 Amin Setayesh , Hamid Hadian , Radu Prodan

Training large-scale deep learning models has become a key challenge for the scientific community and industry. While the massive use of GPUs can significantly speed up training times, this approach has a negative impact on efficiency. In…

机器学习 · 计算机科学 2025-09-04 David Cortes , Carlos Juiz , Belen Bermejo

Deep learning has achieved impressive prediction performance in the field of sequence learning recently. Dissolved oxygen prediction, as a kind of time-series forecasting, is suitable for this technique. Although many researchers have…

信号处理 · 电气工程与系统科学 2019-11-22 Hongqian Qin

For this paper, a prediction study of cloud computing energy consumption was conducted by optimising the data regression algorithm based on the horned lizard optimisation algorithm for Convolutional Neural Networks-Bi-Directional Gated…

分布式、并行与集群计算 · 计算机科学 2024-07-29 Feiyang Li , Zinan Cao , Qixuan Yu , Xirui Tang

Convolution is the most time-consuming operation in deep neural network operations, so its performance is critical to the overall performance of the neural network. The commonly used methods for convolution on GPU include the general matrix…

神经与进化计算 · 计算机科学 2023-06-27 Shuai Lu , Jun Chu , Luanzheng Guo , Xu T. Liu

This paper presents a Gated Recurrent Unit (GRU) based recurrent neural network (RNN) accelerator called EdgeDRNN designed for portable edge computing. EdgeDRNN adopts the spiking neural network inspired delta network algorithm to exploit…

信号处理 · 电气工程与系统科学 2020-07-30 Chang Gao , Antonio Rios-Navarro , Xi Chen , Tobi Delbruck , Shih-Chii Liu

Accurate stock market prediction provides great opportunities for informed decision-making, yet existing methods struggle with financial data's non-linear, high-dimensional, and volatile characteristics. Advanced predictive models are…

统计金融 · 定量金融 2025-01-20 Yuxi Hong

To break the GPU memory wall for scaling deep learning workloads, a variety of architecture and system techniques have been proposed recently. Their typical approaches include memory extension with flash memory and direct storage access.…

硬件体系结构 · 计算机科学 2023-10-17 Haoyang Zhang , Yirui Eric Zhou , Yuqi Xue , Yiqi Liu , Jian Huang

Recent data-privacy laws have sparked interest in machine unlearning, which involves removing the effect of specific training samples from a learnt model as if they were never present in the original training dataset. The challenge of…

机器学习 · 计算机科学 2023-12-08 Tuan Hoang , Santu Rana , Sunil Gupta , Svetha Venkatesh

Modeling the full-range deformation behaviors of materials under complex loading and materials conditions is a significant challenge for constitutive relations (CRs) modeling. We propose a general encoder-decoder deep learning framework…

材料科学 · 物理学 2023-04-04 Qing-Jie Li , Mahmut Nedim Cinbiz , Yin Zhang , Qi He , Geoffrey Beausoleil , Ju Li

Community GPU platforms are emerging as a cost-effective and democratized alternative to centralized GPU clusters for AI workloads, aggregating idle consumer GPUs from globally distributed and heterogeneous environments. However, their…

网络与互联网体系结构 · 计算机科学 2025-08-19 Zhiwei Yu , Chengze Du , Heng Xu , Ying Zhou , Bo Liu , Jialong Li

Graph Neural Networks (GNNs) have achieved tremendous success in graph representation learning. Unfortunately, current GNNs usually rely on loading the entire attributed graph into network for processing. This implicit assumption may not be…

机器学习 · 计算机科学 2022-02-15 Junfu Wang , Yunhong Wang , Zhen Yang , Liang Yang , Yuanfang Guo

In this paper, we provide a fine-grain machine learning-based method, PerfNetV2, which improves the accuracy of our previous work for modeling the neural network performance on a variety of GPU accelerators. Given an application, the…

机器学习 · 计算机科学 2020-12-02 Chuan-Chi Wang , Ying-Chiao Liao , Ming-Chang Kao , Wen-Yew Liang , Shih-Hao Hung

Future video prediction is an ill-posed Computer Vision problem that recently received much attention. Its main challenges are the high variability in video content, the propagation of errors through time, and the non-specificity of the…

计算机视觉与模式识别 · 计算机科学 2018-03-19 Marc Oliu , Javier Selva , Sergio Escalera

We present a novel algorithm, \hdgc, that marries graph convolution with binding and bundling operations in hyperdimensional computing for transductive graph learning. For prediction accuracy \hdgc outperforms major and popular graph neural…

机器学习 · 计算机科学 2025-10-29 Guojing Cong , Tom Potok , Hamed Poursiami , Maryam Parsa

Multi-task learning is assumed as a powerful inference method, specifically, where there is a considerable correlation between multiple tasks, predicting them in an unique framework may enhance prediction results. This research challenges…

机器学习 · 计算机科学 2021-10-26 Ali Yazdizadeh , Arash Kalatian , Zachary Patterson , Bilal Farooq