English
Related papers

Related papers: Understanding Data Storage and Ingestion for Large…

200 papers

Extremely high data rates at modern synchrotron and X-ray free-electron laser light source beamlines motivate the use of machine learning methods for data reduction, feature detection, and other purposes. Regardless of the application, the…

Recently, deep learning-based compressive imaging (DCI) has surpassed the conventional compressive imaging in reconstruction quality and faster running time. While multi-scale has shown superior performance over single-scale, research in…

Image and Video Processing · Electrical Eng. & Systems 2020-08-04 Thuong Nguyen Canh , Byeungwoo Jeon

Deep learning technology has developed unprecedentedly in the last decade and has become the primary choice in many application domains. This progress is mainly attributed to a systematic collaboration in which rapidly growing computing…

Machine Learning · Computer Science 2023-12-27 Shiye Lei , Dacheng Tao

Training machine learning models requires feeding input data for models to ingest. Input pipelines for machine learning jobs are often challenging to implement efficiently as they require reading large volumes of data, applying complex…

Machine Learning · Computer Science 2021-02-25 Derek G. Murray , Jiri Simsa , Ana Klimovic , Ihor Indyk

Distributed deep learning systems (DDLS) train deep neural network models by utilizing the distributed resources of a cluster. Developers of DDLS are required to make many decisions to process their particular workloads in their chosen…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-07-09 Matthias Langer , Zhen He , Wenny Rahayu , Yanbo Xue

Artificial intelligence (AI) is driving unprecedented growth in data center (DC) scale and power demand. AI workloads impose highly dynamic, difficult-to-forecast power profiles on the utility grid, creating reliability and stability…

Systems and Control · Electrical Eng. & Systems 2026-05-06 Sina Mohammadi , Wayne Wang , Marcus Chen I Wada , Rouzbeh Haghighi , Ali Hassan , Hualong Liu , Archit Bhatnagar , Ang Chen , Wencong Su

With the rise of AI in recent years and the increase in complexity of the models, the growing demand in computational resources is starting to pose a significant challenge. The need for higher compute power is being met with increasingly…

Accurate and effective channel state information (CSI) feedback is a key technology for massive multiple-input and multiple-output (MIMO) systems. Recently, deep learning (DL) has been introduced to enhance CSI feedback in massive MIMO…

Signal Processing · Electrical Eng. & Systems 2023-02-01 Han Xiao , Wenqiang Tian , Wendong Liu , Zhi Zhang , Zhihua Shi , Li Guo , Jia Shen

The use of deep learning models for forecasting the resource consumption patterns of SQL queries have recently been a popular area of study. With many companies using cloud platforms to power their data lakes for large scale analytic…

Machine Learning · Computer Science 2021-03-24 Johan Kok Zhi Kang , Gaurav , Sien Yi Tan , Feng Cheng , Shixuan Sun , Bingsheng He

Training a deep neural network requires a large amount of single-task data and involves a long time-consuming optimization phase. This is not scalable to complex, realistic environments with new unexpected changes. Humans can perform fast…

Neural and Evolutionary Computing · Computer Science 2020-09-04 Tsendsuren Munkhdalai

A deep clustering model conceptually consists of a feature extractor that maps data points to a latent space, and a clustering head that groups data points into clusters in the latent space. Although the two components used to be trained…

Computer Vision and Pattern Recognition · Computer Science 2022-07-28 Xingzhi Zhou , Nevin L. Zhang

Artificial Intelligence (AI) and Deep Learning (DL) algorithms are currently applied to a wide range of products and solutions. DL training jobs are highly resource demanding and they experience great benefits when exploiting AI…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-05-12 Federica Filippini , Danilo Ardagna , Marco Lattuada , Edoardo Amaldi , Michele Ciavotta , Maciek Riedl , Katarzyna Materka , Paweł Skrzypek , Fabrizio Magugliani , Marco Cicala

In real-world machine learning (ML) pipelines, datasets are continuously growing. Models must incorporate this new training data to improve generalization and adapt to potential distribution shifts. The cost of model retraining is…

Machine Learning · Computer Science 2025-01-27 Maximilian Böther , Ties Robroek , Viktor Gsteiger , Robin Holzinger , Xianzhe Ma , Pınar Tözün , Ana Klimovic

Data collection is a major bottleneck in machine learning and an active research topic in multiple communities. There are largely two reasons data collection has recently become a critical issue. First, as machine learning is becoming more…

Machine Learning · Computer Science 2019-08-13 Yuji Roh , Geon Heo , Steven Euijong Whang

Recent success of deep learning is largely attributed to the sheer amount of data used for training deep neural networks.Despite the unprecedented success, the massive data, unfortunately, significantly increases the burden on storage and…

Machine Learning · Computer Science 2023-10-10 Ruonan Yu , Songhua Liu , Xinchao Wang

Scale of data and scale of computation infrastructures together enable the current deep learning renaissance. However, training large-scale deep architectures demands both algorithmic improvement and careful system configuration. In this…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-09-21 Shang-Xuan Zou , Chun-Yen Chen , Jui-Lin Wu , Chun-Nan Chou , Chia-Chin Tsao , Kuan-Chieh Tung , Ting-Wei Lin , Cheng-Lung Sung , Edward Y. Chang

Today, deep learning is an essential technology for our life. To solve more complex problems with deep learning, both sizes of training datasets and neural networks are increasing. To train a model with large datasets and networks,…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-01-05 Takaaki Fukai , Kento Sato , Takahiro Hirofuchi

Long-range and short-range temporal modeling are two complementary and crucial aspects of video recognition. Most of the state-of-the-arts focus on short-range spatio-temporal modeling and then average multiple snippet-level predictions to…

Computer Vision and Pattern Recognition · Computer Science 2021-08-18 Wenhao Wu , Yuxiang Zhao , Yanwu Xu , Xiao Tan , Dongliang He , Zhikang Zou , Jin Ye , Yingying Li , Mingde Yao , Zichao Dong , Yifeng Shi

In recent years, Dynamic Sparse Training (DST) has emerged as an alternative to post-training pruning for generating efficient models. In principle, DST allows for a more memory efficient training process, as it maintains sparsity…

Machine Learning · Computer Science 2025-02-11 Nasib Ullah , Erik Schultheis , Mike Lasby , Yani Ioannou , Rohit Babbar

Deep Learning has demonstrated a significant improvement against traditional machine learning approaches in different domains such as image and speech recognition. Their success on benchmark datasets is transferred to the real-world through…

Computer Vision and Pattern Recognition · Computer Science 2022-10-12 Ahmad Mustapha , Wael Khreich , Wasim Masr