English
Related papers

Related papers: ElasticRec: A Microservice-based Model Serving Arc…

200 papers

Microservice architecture has transformed the way developers are building and deploying applications in the nowadays cloud computing centers. This new approach provides increased scalability, flexibility, manageability, and performance…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-10-06 Hamzeh Khazaei , Nima Mahmoudi , Cornel Barna , Marin Litoiu

We study a multi-objective model on the allocation of reusable resources under model uncertainty. Heterogeneous customers arrive sequentially according to a latent stochastic process, request for certain amounts of resources, and occupy…

Optimization and Control · Mathematics 2023-08-02 Xilin Zhang , Wang Chi Cheung

The increasing demand for scalable, efficient resource management in hybrid cloud environments has led to the exploration of AI-driven approaches for dynamic resource allocation. This paper presents an AI-driven framework for resource…

Artificial Intelligence · Computer Science 2024-12-04 Biman Barua , M. Shamim Kaiser

As a representative information retrieval task, site recommendation, which aims at predicting the optimal sites for a brand or an institution to open new branches in an automatic data-driven way, is beneficial and crucial for brand…

Information Retrieval · Computer Science 2023-07-04 Xinhang Li , Xiangyu Zhao , Yejing Wang , Yu Liu , Yong Li , Cheng Long , Yong Zhang , Chunxiao Xing

In this paper, we jointly consider communication, caching and computation in a multi-user cache-assisted mobile edge computing (MEC) system, consisting of one base station (BS) of caching and computing capabilities and multiple users with…

Information Theory · Computer Science 2017-08-17 Ying Cui , Wen He , Chun Ni , Chengjun Guo , Zhi Liu

Modern applications increasingly rely on inference serving systems to provide low-latency insights with a diverse set of machine learning models. Existing systems often utilize resource elasticity to scale with demand. However, many…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-05-13 Joel Wolfrath , Daniel Frink , Abhishek Chandra

In this paper, we propose a novel algorithm for energy-efficient, low-latency dynamic mobile edge computing (MEC), in the context of beyond 5G networks endowed with Reconfigurable Intelligent Surfaces (RISs). In our setting, new computing…

Signal Processing · Electrical Eng. & Systems 2021-12-22 Paolo Di Lorenzo , Mattia Merluzzi , Emilio Calvanese Strinati , Sergio Barbarossa

In mobile edge computing (MEC), one of the important challenges is how much resources of which mobile edge server (MES) should be allocated to which user equipment (UE). The existing resource allocation schemes only consider CPU as the…

Networking and Internet Architecture · Computer Science 2020-12-22 Zaiwar Ali , Sadia Khaf , Ziaul Haq Abba , Ghulam Abbas , Lei Jiao , Amna Irshad , Kyung Sup Kwak , Muhammad Bilal

Distributed synchronized GPU training is commonly used for deep learning. The resource constraint of using a fixed number of GPUs makes large-scale training jobs suffer from long queuing time for resource allocation, and lowers the cluster…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-11-08 Mingzhen Li , Wencong Xiao , Biao Sun , Hanyu Zhao , Hailong Yang , Shiru Ren , Zhongzhi Luan , Xianyan Jia , Yi Liu , Yong Li , Wei Lin , Depei Qian

Nowadays, data-centers are largely under-utilized because resource allocation is based on reservation mechanisms which ignore actual resource utilization. Indeed, it is common to reserve resources for peak demand, which may occur only for a…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-07-03 Francesco Pace , Dimitrios Milios , Damiano Carra , Daniele Venzano , Pietro Michiardi

Realistic recommender systems are often required to adapt to ever-changing data and tasks or to explore different models systematically. To address the need, we present AutoRec, an open-source automated machine learning (AutoML) platform…

Information Retrieval · Computer Science 2020-07-15 Ting-Hsiang Wang , Qingquan Song , Xiaotian Han , Zirui Liu , Haifeng Jin , Xia Hu

Recommender systems often rely on large embedding tables that map users and items to dense vectors of uniform size, leading to substantial memory consumption and inefficiencies. This is particularly problematic in memory-constrained…

Information Retrieval · Computer Science 2024-11-20 Yunke Qu , Liang Qu , Tong Chen , Xiangyu Zhao , Jianxin Li , Hongzhi Yin

The proliferation of innovative mobile services such as augmented reality, networked gaming, and autonomous driving has spurred a growing need for low-latency access to computing resources that cannot be met solely by existing centralized…

Networking and Internet Architecture · Computer Science 2019-01-28 Konstantinos Poularakis , Jaime Llorca , Antonia M. Tulino , Ian Taylor , Leandros Tassiulas

Cloud-native architecture is becoming increasingly crucial for today's cloud computing environments due to the need for speed and flexibility in developing applications. It utilizes microservice technology to break down traditional…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-08-30 Minxian Xu , Lei Yang , Yang Wang , Chengxi Gao , Linfeng Wen , Guoyao Xu , Liping Zhang , Kejiang Ye , Chengzhong Xu

Microservices is an architectural style that structures an application as a collection of loosely coupled services, making it easy for developers to build and scale their applications. The microservices architecture approach differs from…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-04-27 Muhammad Ahsan , Sacheendra Talluri , Alexandru Iosup

Auto-scalability has become an evident feature for cloud software systems including but not limited to big data and IoT applications. Cloud application providers now are in full control over their applications' microservices and…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-11-10 Hamzeh Khazaei , Rajsimman Ravichandiran , Byungchul Park , Hadi Bannazadeh , Ali Tizghadam , Alberto Leon-Garcia

Cloud providers have recently introduced new offerings whereby spare computing resources are accessible at discounts compared to on-demand computing. Exploiting such opportunity is challenging inasmuch as such resources are accessed with…

Information Theory · Computer Science 2019-05-28 Yaoqing Yang , Matteo Interlandi , Pulkit Grover , Soummya Kar , Saeed Amizadeh , Markus Weimer

Sequential Recommender Systems (SRSs) have emerged as a highly efficient approach to recommendation systems. By leveraging sequential data, SRSs can identify temporal patterns in user behaviour, significantly improving recommendation…

Elasticity in resource allocation is still a relevant problem in cloud computing. There are many academic and white papers which have investigated the problem and offered solutions.\textbf{Unfortunately, there are scant evidence of…

Networking and Internet Architecture · Computer Science 2018-05-22 Bidisha Goswami , Jyotirmoy Sarkar , Snehanshu Saha , Saibal Kar , Poulami Sarkar

High capacity and scalable memory systems play a vital role in enabling our desktops, smartphones, and pervasive technologies like Internet of Things (IoT). Unfortunately, memory systems are becoming increasingly prone to faults. This is…

Hardware Architecture · Computer Science 2019-09-04 Prashant J. Nair