English
Related papers

Related papers: Self-Evolving Distributed Memory Architecture for …

200 papers

Retrieval-Augmented Generation (RAG) and vector-based search have become foundational tools for memory in AI systems, yet they struggle with abstraction, scalability, and semantic precision - especially in decentralized environments. We…

Artificial Intelligence · Computer Science 2025-04-09 Tooraj Helmi

As the size of artificial intelligence and machine learning (AI/ML) models and datasets grows, the memory bandwidth becomes a critical bottleneck. The paper presents a novel extended memory hierarchy that addresses some major memory…

Hardware Architecture · Computer Science 2025-05-20 Jordi Altayo , Paul Delestrac , David Novo , Simey Yang , Debjyoti Bhattacharjee , Francky Catthoor

Distributed architectures have become ubiquitous in many complex technical and socio-technical systems because of their role in improving uncertainty management, accommodating multiple stakeholders, and increasing scalability and…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-08-03 Mohsen Mosleh , Kia Dalili , Babak Heydari

Traditional data centers are designed with a rigid architecture of fit-for-purpose servers that provision resources beyond the average workload in order to deal with occasional peaks of data. Heterogeneous data centers are pushing towards…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-09-20 Carlos Vega , Jose Fernando Zazo , Hugo Meyer , Ferad Zyulkyarov , Sergio Lopez Buedo , Javier Aracil

In domains such as health care and finance, shortage of labeled data and computational resources is a critical issue while developing machine learning algorithms. To address the issue of labeled data scarcity in training and deployment of…

Machine Learning · Computer Science 2018-10-16 Otkrist Gupta , Ramesh Raskar

Recent progress in artificial intelligence has been driven largely by the scaling of centralized large language models through increased parameters, datasets, and computational resources. While effective, this paradigm introduces structural…

Human-Computer Interaction · Computer Science 2026-03-11 Jacek Małecki , Alexander Mathiesen-Ohman , Katarzyna Tworek

Real-time generative game engines represent a paradigm shift in interactive simulation, promising to replace traditional graphics pipelines with neural world models. However, existing approaches are fundamentally constrained by the ``Memory…

Artificial Intelligence · Computer Science 2026-02-03 Wei Zeng , Xuchen Li , Ruili Feng , Zhen Liu , Fengwei An , Jian Zhao

We propose a distributed algorithm, named Distributed Alternating Direction Method of Multipliers (D-ADMM), for solving separable optimization problems in networks of interconnected nodes or agents. In a separable optimization problem there…

Optimization and Control · Mathematics 2013-04-26 João F. C. Mota , João M. F. Xavier , Pedro M. Q. Aguiar , Markus Püschel

In distributed optimization, the practical problem-solving performance is essentially sensitive to algorithm selection, parameter setting, problem type and data pattern. Thus, it is often laborious to acquire a highly efficient method for a…

Optimization and Control · Mathematics 2024-01-04 Daokuan Zhu , Tianqi Xu , Jie Lu

While general-purpose computing follows Von Neumann's architecture, the data movement between memory and processor elements dictates the processor's performance. The evolving compute-in-memory (CiM) paradigm tackles this issue by…

Hardware Architecture · Computer Science 2024-11-15 Dhandeep Challagundla , Ignatius Bezzam , Riadul Islam

The performance of computer networks relies on how bandwidth is shared among different flows. Fair resource allocation is a challenging problem particularly when the flows evolve over time.To address this issue, bandwidth sharing techniques…

Networking and Internet Architecture · Computer Science 2017-11-28 Zaid Allybokus , Konstantin Avrachenkov , Jérémie Leguay , Lorenzo Maggi

Distributed actor languages are an effective means of constructing scalable reliable systems, and the Erlang programming language has a well-established and influential model. While Erlang model conceptually provides reliable scalability,…

Agentic workflows in large language model systems integrate retrieval, reasoning, and memory, but existing frameworks suffer from scalability and reproducibility limitations due to fragmented data orchestration, serialization overhead, and…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-05 Arup Kumar Sarker , Mills Staylor , Aymen Alsaadi , Gregor von Laszewski , Shantenu Jha , Geoffrey Fox

Complex tasks are increasingly delegated to ensembles of specialized LLM-based agents that reason, communicate, and coordinate actions-both among themselves and through interactions with external tools, APIs, and databases. While persistent…

Multiagent Systems · Computer Science 2025-05-27 Alireza Rezazadeh , Zichao Li , Ange Lou , Yuying Zhao , Wei Wei , Yujia Bao

The emergence of large language models has catalyzed two distinct yet interconnected paradigms in artificial intelligence: standalone AI Agents and collaborative Agentic AI ecosystems. This comprehensive study establishes a definitive…

Artificial Intelligence · Computer Science 2025-06-17 Prashik Buddhaghosh Bansod

In this paper, we address distributed convergence to fair allocations of CPU resources for time-sensitive applications. We propose a novel resource management framework where a centralized objective for fair allocations is decomposed into a…

Optimization and Control · Mathematics 2015-08-20 Georgios C. Chasparis , Martina Maggio , Enrico Bini , Karl-Eric Årzén

Index structures are important for efficient data access, which have been widely used to improve the performance in many in-memory systems. Due to high in-memory overheads, traditional index structures become difficult to process the…

Databases · Computer Science 2019-05-16 Pengfei Li , Yu Hua , Pengfei Zuo , Jingnan Jia

Many emerging Artificial Intelligence (AI) applications require on-demand provisioning of large-scale computing, which can only be enabled by leveraging distributed computing services interconnected through networking. To address such…

Networking and Internet Architecture · Computer Science 2024-07-09 Ruikun Wang , Jiawei Zhang , Qiaolun Zhang , Bojun Zhang , Zhiqun Gu , Aryanaz Attarpour , Yuefeng Ji , Massimo Tornatore

Efficient deployment of neural networks on resource-constrained hardware demands optimal use of on-chip memory. In event-based processors, this is particularly critical for routing architectures, where substantial memory is dedicated to…

Emerging Technologies · Computer Science 2024-12-03 Jimmy Weber , Theo Ballet , Melika Payvand

Wireless access through a large distributed network of low-complexity infrastructure nodes empowered with cooperation and coordination capabilities, is an emerging radio architecture, candidate to deal with the mobile data capacity crunch.…

Information Theory · Computer Science 2013-04-04 Antonis G. Gotsis , Angeliki Alexiou