English
Related papers

Related papers: Embedding Samples Dispatching for Recommendation M…

200 papers

The exponential growth of electric vehicles (EVs) presents novel challenges in preserving battery health and in addressing the persistent problem of vehicle range anxiety. To address these concerns, wireless charging, particularly, Mobile…

Robotics · Computer Science 2023-08-31 Jiaming Wang , Jiqian Dong , Sikai Chen , Shreyas Sundaram , Samuel Labi

Resource-constrained Edge Devices (EDs), e.g., IoT sensors and microcontroller units, are expected to make intelligent decisions using Deep Learning (DL) inference at the edge of the network. Toward this end, there is a significant research…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-04-25 Ghina Al-Atat , Andrea Fresa , Adarsh Prasad Behera , Vishnu Narayanan Moothedath , James Gross , Jaya Prakash Champati

Deep learning recommendation models (DLRM) rely on large embedding tables to manage categorical sparse features. Expanding such embedding tables can significantly enhance model performance, but at the cost of increased GPU/CPU/memory usage.…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-07-01 Qinlong Wang , Tingfeng Lan , Yinghao Tang , Ziling Huang , Yiheng Du , Haitao Zhang , Jian Sha , Hui Lu , Yuanchun Zhou , Ke Zhang , Mingjie Tang

Deep learning recommendation models (DLRMs) have been widely applied in Internet companies. The embedding tables of DLRMs are too large to fit on GPU memory entirely. We propose a GPU-based software cache approaches to dynamically manage…

Information Retrieval · Computer Science 2022-08-11 Jiarui Fang , Geng Zhang , Jiatong Han , Shenggui Li , Zhengda Bian , Yongbin Li , Jin Liu , Yang You

Intermediate task transfer learning can greatly improve model performance. If, for example, one has little training data for emotion detection, first fine-tuning a language model on a sentiment classification dataset may improve performance…

Computation and Language · Computer Science 2024-10-22 David Schulte , Felix Hamborg , Alan Akbik

Real-time applications of energy management strategies (EMSs) in hybrid electric vehicles (HEVs) are the harshest requirements for researchers and engineers. Inspired by the excellent problem-solving capabilities of deep reinforcement…

Signal Processing · Electrical Eng. & Systems 2022-12-14 Hao Chen , Gang Guo , Bangbei Tang , Guo Hu , Xiaolin Tang , Teng Liu

In modern relational machine learning it is common to encounter large graphs that arise via interactions or similarities between observations in many domains. Further, in many cases the target entities for analysis are actually signals on…

This paper studies the fast adaptive beamforming for the multiuser multiple-input single-output downlink. Existing deep learning-based approaches assume that training and testing channels follow the same distribution which causes task…

Information Theory · Computer Science 2021-09-21 Juping Zhang , Yi Yuan , Gan Zheng , Ioannis Krikidis , Kai-Kit Wong

To alleviate the problem of information explosion, recommender systems are widely deployed to provide personalized information filtering services. Usually, embedding tables are employed in recommender systems to transform high-dimensional…

Information Retrieval · Computer Science 2024-08-07 Shiwei Li , Huifeng Guo , Xing Tang , Ruiming Tang , Lu Hou , Ruixuan Li , Rui Zhang

Distributed multi-party learning provides an effective approach for training a joint model with scattered data under legal and practical constraints. However, due to the quagmire of a skewed distribution of data labels across participants…

Machine Learning · Computer Science 2021-11-01 Maoguo Gong , Yuan Gao , Yue Wu , A. K. Qin

Deep Learning (DL) model-based AI services are increasingly offered in a variety of predictive analytics services such as computer vision, natural language processing, speech recognition. However, the quality of the DL models can degrade…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-11-04 Anirban Bhattacharjee , Ajay Dev Chhokra , Hongyang Sun , Shashank Shekhar , Aniruddha Gokhale , Gabor Karsai , Abhishek Dubey

Transformer-based Diffusion Probabilistic Models (DPMs) have shown more potential than CNN-based DPMs, yet their extensive computational requirements hinder widespread practical applications. To reduce the computation budget of…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Xinwang Chen , Ning Liu , Yichen Zhu , Feifei Feng , Jian Tang

Distribution system state estimation (DSSE) plays a crucial role in the real-time monitoring, control, and operation of distribution networks. Besides intensive computational requirements, conventional DSSE methods need high-quality…

Systems and Control · Electrical Eng. & Systems 2024-08-05 Renyou Xie , Xin Yin , Chaojie Li , Guo Chen , Nian Liu , Bo Zhao , Zhaoyang Dong

Training task in classical machine learning models, such as deep neural networks, is generally implemented at a remote cloud center for centralized learning, which is typically time-consuming and resource-hungry. It also incurs serious…

Machine Learning · Computer Science 2020-10-27 Jinke Ren , Guanding Yu , Guangyao Ding

Recommender systems have become an essential component of many online platforms, providing personalized recommendations to users. A crucial aspect is embedding techniques that convert the high-dimensional discrete features, such as user and…

Information Retrieval · Computer Science 2025-10-23 Maolin Wang , Xinjian Zhao , Wanyu Wang , Sheng Zhang , Jiansheng Li , Bowen Yu , Binhao Wang , Shucheng Zhou , Dawei Yin , Qing Li , Ruocheng Guo , Xiangyu Zhao

With the rapid expansion of edge devices, such as IoT devices, where crucial data needed for machine learning applications is generated, it becomes essential to promote their participation in privacy-preserving Federated Learning (FL)…

Machine Learning · Computer Science 2025-01-03 Hongrui Shi , Valentin Radu , Po Yang

Training recommendation models pose significant challenges regarding resource utilization and performance. Prior research has proposed an approach that categorizes embeddings into popular and non-popular classes to reduce the training time…

Information Retrieval · Computer Science 2024-04-09 Yassaman Ebrahimzadeh Maboud , Muhammad Adnan , Divya Mahajan , Prashant J. Nair

To reduce uploading bandwidth and address privacy concerns, deep learning at the network edge has been an emerging topic. Typically, edge devices collaboratively train a shared model using real-time generated data through the Parameter…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-10-11 Shangming Cai , Dongsheng Wang , Haixia Wang , Yongqiang Lyu , Guangquan Xu , Xi Zheng , Athanasios V. Vasilakos

The focus in machine learning has branched beyond training classifiers on a single task to investigating how previously acquired knowledge in a source domain can be leveraged to facilitate learning in a related target domain, known as…

Machine Learning · Computer Science 2018-10-30 Tyler R. Scott , Karl Ridgeway , Michael C. Mozer

Deep Learning (DL) models have been widely deployed on IoT devices with the help of advancements in DL algorithms and chips. However, the limited resources of edge devices make these on-device DL models hard to be generalizable to diverse…

Machine Learning · Computer Science 2023-11-27 Bufang Yang , Lixing He , Neiwen Ling , Zhenyu Yan , Guoliang Xing , Xian Shuai , Xiaozhe Ren , Xin Jiang