English
Related papers

Related papers: Evaluating Kubernetes Performance for GenAI Infere…

200 papers

We study the staggered introduction of a generative AI-based conversational assistant using data from 5,172 customer support agents. Access to AI assistance increases worker productivity, as measured by issues resolved per hour, by 15\% on…

General Economics · Economics 2024-11-07 Erik Brynjolfsson , Danielle Li , Lindsey Raymond

Due to rising demands for Artificial Inteligence (AI) inference, especially in higher education, novel solutions utilising existing infrastructure are emerging. The utilisation of High-Performance Computing (HPC) has become a prevalent…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-11-27 Tim Trappen , Robert Keßler , Roland Pabel , Viktor Achter , Stefan Wesner

Large Language Models have significantly advanced the field of code generation, demonstrating the ability to produce functionally correct code snippets. However, advancements in generative AI for code overlook foundational Software…

Software Engineering · Computer Science 2025-03-20 Mootez Saad , José Antonio Hernández López , Boqi Chen , Neil Ernst , Dániel Varró , Tushar Sharma

Withtherapid advancement of large language models (LLMs), the context length for inference has been continuously increasing, leading to an exponential growth in the demand for Key-Value (KV) caching. This has resulted in a significant…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-08-11 Yanyu Liu , Jingying Fu , Sixiang Liu , Yitian Zou , You Fu , Jiehan Zhou , Shouhua Zhang

Generative AI (GenAI) systems offer unprecedented opportunities for transforming professional and personal work, yet present challenges around prompting, evaluating and relying on outputs, and optimizing workflows. We argue that…

Human-Computer Interaction · Computer Science 2024-07-08 Lev Tankelevitch , Viktor Kewenig , Auste Simkute , Ava Elizabeth Scott , Advait Sarkar , Abigail Sellen , Sean Rintel

Accurately quantifying uncertainty in predictions and projections arising from irreducible internal climate variability is critical for informed decision making. Such uncertainty is typically assessed using ensembles produced with physics…

Machine Learning · Computer Science 2026-02-09 Parsa Gooya , Reinel Sospedra-Alfonso , Johannes Exenberger

Evidence-based medicine promises to improve the quality of healthcare by empowering medical decisions and practices with the best available evidence. The rapid growth of medical evidence, which can be obtained from various sources, poses a…

Recent advancements in generative artificial intelligence (AI) have demonstrated its substantial potential in various fields. However, its application in port logistics remains underexplored. Ports are complex operational environments where…

Computational Engineering, Finance, and Science · Computer Science 2026-02-25 Minseop Kim , Jaeeun Kwon , Hanbyeol Park , Kikun Park , Taekhyun Park , Hyerim Bae

Recognizing the tremendous improvements that the integration of generative AI can bring to intelligent transportation systems, this article explores the integration of generative AI technologies in vehicular networks, focusing on their…

Networking and Internet Architecture · Computer Science 2023-04-24 Ruichen Zhang , Ke Xiong , Hongyang Du , Dusit Niyato , Jiawen Kang , Xuemin Shen , H. Vincent Poor

This paper summarizes our approaches submitted to the case law retrieval task in the Competition on Legal Information Extraction/Entailment (COLIEE) 2022. Our methodology consists of four steps; in detail, given a legal case as a query, we…

Information Retrieval · Computer Science 2022-05-27 Arian Askari , Georgios Peikos , Gabriella Pasi , Suzan Verberne

With the advances of deep learning techniques, text generation is attracting increasing interest in the artificial intelligence (AI) community, because of its wide applications and because it is an essential component of AI. Traditional…

Computation and Language · Computer Science 2023-09-19 Lili Mou

Modern cluster management systems like Kubernetes and Openstack grapple with hard combinatorial optimization problems: load balancing, placement, scheduling, and configuration. Currently, developers tackle these problems by designing custom…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-09-10 Lalith Suresh , Joao Loff , Faria Kalim , Nina Narodytska , Leonid Ryzhyk , Sahan Gamage , Brian Oki , Zeeshan Lokhandwala , Mukesh Hira , Mooly Sagiv

The rapid advancement of Low-Altitude Economy Networks (LAENets) has enabled a variety of applications, including aerial surveillance, environmental sensing, and semantic data collection. To support these scenarios, unmanned aerial vehicles…

Machine Learning · Computer Science 2025-10-14 Yang Li , Ruichen Zhang , Yinqiu Liu , Guangyuan Liu , Dusit Niyato , Abbas Jamalipour , Xianbin Wang , Dong In Kim

With the rapid upsurge of deep learning tasks at the network edge, effective edge artificial intelligence (AI) inference becomes critical to provide low-latency intelligent services for mobile users via leveraging the edge computing…

Information Theory · Computer Science 2024-10-30 Xiangyu Yang , Sheng Hua , Yuanming Shi , Hao Wang , Jun Zhang , Khaled B. Letaief

Generative artificial intelligence (GenAI), based on large-language models (LLMs), such as ChatGPT, has taken organizations, academia, and the public by storm. In particular, impressive GenAI capabilities such as summarization of large text…

Digital Libraries · Computer Science 2026-05-19 Gerit Wagner , Julian Prester , Reza Mousavi , Roman Lukyanenko , Guy Pare

Educators have started to turn to Generative AI (GenAI) to help create new course content, but little is known about how they should do so. In this project, we investigated the first steps for optimizing content creation for advanced math.…

Artificial Intelligence · Computer Science 2025-05-20 Yongan Yu , Alexandre Krantz , Nikki G. Lobczowski

Generative AI (genAI) technologies -- specifically, large language models (LLMs) -- and search have evolving relations. We argue for a novel perspective: using genAI to enrich a document corpus so as to improve query-based retrieval…

Information Retrieval · Computer Science 2025-06-09 Gal Zur , Tommy Mordo , Moshe Tennenholtz , Oren Kurland

Predictive atomistic simulations have propelled materials discovery, yet routine setup and debugging still demand computer specialists. This know-how gap limits Integrated Computational Materials Engineering (ICME), where state-of-the-art…

Generative Artificial Intelligence (GenAI) is taking the world by storm. It promises transformative opportunities for advancing and disrupting existing practices, including healthcare. From large language models (LLMs) for clinical note…

Artificial Intelligence · Computer Science 2025-10-29 Gang Chen , Changshuo Liu , Gene Anne Ooi , Marcus Tan , Zhongle Xie , Jianwei Yin , James Wei Luen Yip , Wenqiao Zhang , Jiaqi Zhu , Beng Chin Ooi

Import container dwell time (ICDT) prediction is a key task for improving productivity in container terminals, as accurate predictions enable the reduction of container re-handling operations by yard cranes. Achieving this objective…

Computational Engineering, Finance, and Science · Computer Science 2026-02-25 Minseop Kim , Takhyeong Kim , Taekhyun Park , Hanbyeol Park , Hyerim Bae