English
Related papers

Related papers: A Recoverable Mutex Algorithm with Sub-logarithmic…

200 papers

Mixture of Experts (MoE) LLMs have recently gained attention for their ability to enhance performance by selectively engaging specialized subnetworks or "experts" for each input. However, deploying MoEs on memory-constrained devices remains…

We present $O(\log\log n)$-round algorithms in the Massively Parallel Computation (MPC) model, with $\tilde{O}(n)$ memory per machine, that compute a maximal independent set, a $1+\epsilon$ approximation of maximum matching, and a…

Data Structures and Algorithms · Computer Science 2022-03-21 Mohsen Ghaffari , Themis Gouleakis , Christian Konrad , Slobodan Mitrović , Ronitt Rubinfeld

Mutexes (i.e., locks) are well understood in separation logic, and can be specified in terms of either protecting an invariant or atomically changing the state of the lock. In this abstract, we develop the same styles of specifications for…

Programming Languages · Computer Science 2026-02-02 Ke Du , William Mansky , Paolo G. Giarrusso , Gregory Malecha

The optimized certainty equivalent (OCE) is a family of risk measures that cover important examples such as entropic risk, conditional value-at-risk and mean-variance models. In this paper, we propose a new episodic risk-sensitive…

Machine Learning · Computer Science 2023-06-09 Wenhao Xu , Xuefeng Gao , Xuedong He

Recently, studying fundamental graph problems in the \emph{Massively Parallel Computation (MPC) framework, inspired by the MapReduce paradigm, has gained a lot of attention. An assumption common to a vast majority of approaches is to allow…

Data Structures and Algorithms · Computer Science 2019-05-28 Sebastian Brandt , Manuela Fischer , Jara Uitto

Major chip manufacturers have all introduced multicore microprocessors. Multi-socket systems built from these processors are used for running various server applications. However to the best of our knowledge current commercial operating…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-10-24 Suryanarayana Murthy Durbhakula

Retrieval-Augmented Generation (RAG) systems typically face constraints because of their inherent mechanism: a simple top-k semantic search [1]. The approach often leads to the incorporation of irrelevant or redundant information in the…

Computation and Language · Computer Science 2025-09-03 Andreas Ottem

We present Hemlock, a novel mutual exclusion locking algorithm that is extremely compact, requiring just one word per thread plus one word per lock, but which still provides local spinning in most circumstances, high throughput under…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-01-07 Dave Dice , Alex Kogan

Major chip manufacturers have all introduced multicore microprocessors. Multi-socket systems built from these processors are routinely used for running various server applications. Depending on the application that is run on the system,…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-09-25 Murthy Durbhakula

Large Language Models (LLMs) demonstrate human-level capabilities in dialogue, reasoning, and knowledge retention. However, even the most advanced LLMs face challenges such as hallucinations and real-time updating of their knowledge.…

Computation and Language · Computer Science 2024-09-10 Xuanwang Zhang , Yunze Song , Yidong Wang , Shuyun Tang , Xinfeng Li , Zhengran Zeng , Zhen Wu , Wei Ye , Wenyuan Xu , Yue Zhang , Xinyu Dai , Shikun Zhang , Qingsong Wen

Mutual exclusion is a classical problem in distributed computing that provides isolation among concurrent action executions that may require access to the same shared resources. Inspired by algorithmic research on distributed systems of…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-02-25 Joshua J. Daymude , Andréa W. Richa , Christian Scheideler

In this paper we revisit the classical regular expression matching problem, namely, given a regular expression $R$ and a string $Q$, decide if $Q$ matches one of the strings specified by $R$. Let $m$ and $n$ be the length of $R$ and $Q$,…

Data Structures and Algorithms · Computer Science 2007-05-23 Philip Bille

The classical majority-logic decoder proposed by Reed for Reed-Muller codes RM(r, m) of order r and length 2^m, unfolds in r+1 sequential steps, decoding message symbols from highest to lowest degree. Several follow-up decoding algorithms…

Information Theory · Computer Science 2026-01-21 Hoang Ly , Emina Soljanin

In large-scale distributed environments, avoiding concurrent access to the same resource by multiple processes becomes a core challenge, commonly termed distributed mutual exclusion (DME). Token-based mechanisms have long been recognized as…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-02-10 Elahe Tohidi , Seyed Sattar Lotfi Fatemi

Long-running autonomous AI agents suffer from a well-documented memory coherence problem: tool-execution success rates degrade 14 percentage points over 72-hour operation windows due to four compounding failure modes in existing flat-file…

Artificial Intelligence · Computer Science 2026-05-26 Bronislav Sidik , Lior Rokach

Large language models (LLMs) have demonstrated remarkable capabilities across a variety of tasks. One of the main challenges towards the successful deployment of LLMs is memory management, since they typically involve billions of…

Machine Learning · Computer Science 2025-09-03 Spyros Angelopoulos , Loris Marchal , Adrien Obrecht , Bertrand Simon

The rapid evolution of mobile edge computing (MEC) has introduced significant challenges in optimizing resource allocation in highly dynamic wireless communication systems, in which task offloading decisions should be made in real-time.…

Signal Processing · Electrical Eng. & Systems 2024-12-31 Runtao Ren , Yinyu Wu , Xuhui Zhang , Jinke Ren , Yanyan Shen , Shuqiang Wang , Kim-Fung Tsang

Retrieval-Augmented Generation (RAG) systems enhance the performance of large language models (LLMs) by incorporating supplementary retrieved documents, enabling more accurate and context-aware responses. However, integrating these external…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-03-25 Wenfeng Wang , Xiaofeng Hou , Peng Tang , Hengyi Zhou , Jing Wang , Xinkai Wang , Chao Li , Minyi Guo

Autonomous LLM agents require structured long-term memory, yet current "append-and-evolve" systems like A-MEM face O(N^2) write-latency and excessive token costs. We introduce D-MEM (Dopamine-Gated Agentic Memory), a biologically inspired…

Neurons and Cognition · Quantitative Biology 2026-03-17 Yuru Song , Qi Xin

Memory plays a key role in enhancing LLMs' performance when deployed to real-world applications. Existing solutions face trade-offs: explicit memory designs based on external storage require complex management and incur storage overhead,…

Computation and Language · Computer Science 2025-02-25 Xiaoqiang Wang , Suyuchen Wang , Yun Zhu , Bang Liu