English
Related papers

Related papers: A Decentralized Frontier AI Architecture Based on …

200 papers

Federated Learning (FL) presents a paradigm shift towards distributed model training across isolated data repositories or edge devices without explicit data sharing. Despite of its advantages, FL is inherently less efficient than…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-11-26 M S Chaitanya Kumar , Sai Satya Narayana J , Yunkai Bao , Xin Wang , Steve Drew

This article surveys Cognitive Edge Computing as a practical and methodical pathway for deploying reasoning-capable Large Language Models (LLMs) and autonomous AI agents on resource-constrained devices at the network edge. We present a…

Machine Learning · Computer Science 2025-11-10 Xubin Wang , Qing Li , Weijia Jia

This paper explores the integration of two AI subdisciplines employed in the development of artificial agents that exhibit intelligent behavior: Large Language Models (LLMs) and Cognitive Architectures (CAs). We present three integration…

Artificial Intelligence · Computer Science 2023-09-29 Oscar J. Romero , John Zimmerman , Aaron Steinfeld , Anthony Tomasic

Contemporary artificial intelligence systems achieve strong performance through large-scale parameterization, retrieval augmentation, and training on extensive static corpora. Despite these advances, they continue to face limitations in…

Artificial Intelligence · Computer Science 2026-05-05 Terry Dorsey , Kevin Huggins

As artificial intelligence advances toward artificial general intelligence (AGI), the need for robust and human-like memory systems has become increasingly evident. Current memory architectures often suffer from limited adaptability,…

Artificial Intelligence · Computer Science 2025-09-17 Linyue Cai , Yuyang Cheng , Xiaoding Shao , Huiming Wang , Yong Zhao , Wei Zhang , Kang Li

Despite extensive investment in artificial intelligence, 95% of enterprises report no measurable profit impact from AI deployments (MIT, 2025). In this theoretical paper, we argue that this gap reflects paradigmatic lock-in that channels AI…

Computers and Society · Computer Science 2025-09-15 Diana A. Wolfe , Alice Choe , Fergus Kidd

This paper presents a scalable Bayesian technique for decentralized state estimation from multiple platforms in dynamic environments. As has long been recognized, centralized architectures impose severe scaling limitations for distributed…

Artificial Intelligence · Computer Science 2012-12-12 Matthew Rosencrantz , Geoffrey Gordon , Sebastian Thrun

In this paper, the extension of the framework of Learning from Constraints (LfC) to a distributed setting where multiple parties, connected over the network, contribute to the learning process is studied. LfC relies on the generic notion of…

Machine Learning · Computer Science 2019-11-14 Francesco Farina , Stefano Melacci , Andrea Garulli , Antonio Giannitrapani

Artificial intelligence-generated traffic is changing the shape of wireless networks. Specifically, as the amount of data generated to train machine learning models is massive, network resources must be carefully allocated to continue…

Networking and Internet Architecture · Computer Science 2026-02-03 Giovanni Perin , Eunjeong Jeong , Nikolaos Pappas

Current Artificial Intelligence (AI) systems are frequently built around monolithic models that entangle perception, reasoning, and decision-making, a design that often conflicts with established software architecture principles. Large…

Software Engineering · Computer Science 2026-03-17 Nicolas Schuler , Vincenzo Scotti , Raffaela Mirandola

Decentralized federated learning (DFL), a serverless variant of federated learning, poses unique challenges for parameter-efficient fine-tuning due to the factorized structure of low-rank adaptation (LoRA). Unlike linear parameters,…

Machine Learning · Computer Science 2026-02-03 Xiaoyu Wang , Xiaotian Li , Zhixiang Zhou , Chen Li , Yong Liu

Large language models (LLMs) are transforming society, powering applications from smartphone assistants to autonomous driving. Yet cloud-based LLM services alone cannot serve a growing class of applications, including those operating under…

Signal Processing · Electrical Eng. & Systems 2026-05-12 Liangqi Yuan , Wenzhi Fang , Shiqiang Wang , H. Vincent Poor , Christopher G. Brinton

The rise of large language models (LLMs), such as ChatGPT, Gemini, and Grok, has reshaped the AI landscape. As prominent instances of foundational models (FMs), they exhibit remarkable capabilities in generating human-like content, pushing…

Artificial Intelligence · Computer Science 2026-05-19 Yu Qiao , Huy Q. Le , Avi Deb Raha , Phuong-Nam Tran , Apurba Adhikary , Mengchun Zhang , Loc X. Nguyen , Eui-Nam Huh , Dusit Niyato , Choong Seon Hong

Edge Intelligence (EI) allows Artificial Intelligence (AI) applications to run at the edge, where data analysis and decision-making can be performed in real-time and close to data sources. To protect data privacy and unify data silos among…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-02-02 Zhiyuan Wu , Sheng Sun , Yuwei Wang , Min Liu , Ke Xu , Wen Wang , Xuefeng Jiang , Bo Gao , Jinda Lu

Federated fine-tuning enables Large Language Models (LLMs) to adapt to downstream tasks while preserving data privacy, but its resource-intensive nature limits deployment on edge devices. In this paper, we introduce Developmental Federated…

Machine Learning · Computer Science 2025-08-04 Yebo Wu , Jingguang Li , Zhijiang Guo , Li Li

In decentralized federated learning (FL), multiple clients collaboratively learn a shared machine learning (ML) model by leveraging their privately held datasets distributed across the network, through interactive exchange of the…

Information Theory · Computer Science 2026-03-24 Xiang Zhang , Zhou Li , Shuangyang Li , Kai Wan , Derrick Wing Kwan Ng , Giuseppe Caire

Frontier AI systems perform best in settings with clear, stable, and verifiable objectives, such as code generation, mathematical reasoning, games, and unit-test-driven tasks. They remain less reliable in open-ended settings, including…

Artificial Intelligence · Computer Science 2026-05-06 Jie Zhou , Qin Chen , Liang He

The ever-growing volume and decentralized nature of data, coupled with the need to harness it and extract knowledge, have led to the extensive use of distributed deep learning (DDL) techniques for training. These techniques rely on local…

Machine Learning · Computer Science 2024-11-22 Michail Theologitis , Georgios Frangias , Georgios Anestis , Vasilis Samoladas , Antonios Deligiannakis

As the demand grows for scalable and privacy-aware AI systems, Federated Learning (FL) has emerged as a promising solution, allowing decentralized model training without moving raw data. At the same time, the combination of high-performance…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-11-26 Sangam Ghimire , Paribartan Timalsina , Nirjal Bhurtel , Bishal Neupane , Bigyan Byanju Shrestha , Subarna Bhattarai , Prajwal Gaire , Jessica Thapa , Sudan Jha

Generative AI has made impressive strides in enabling users to create diverse and realistic visual content such as images, videos, and audio. However, training generative models on large centralized datasets can pose challenges in terms of…

Machine Learning · Computer Science 2025-10-03 Fiona Victoria Stanley Jothiraj , Afra Mashhadi