English
Related papers

Related papers: PRISM: Distributed Inference for Foundation Models…

200 papers

We present PRISM (Policy Reuse via Interpretable Strategy Mapping), a framework that grounds reinforcement learning agents' decisions in discrete, causally validated concepts and uses those concepts as a zero-shot transfer interface between…

Machine Learning · Computer Science 2026-04-06 Thomas Pravetz

Vision Foundation Models (VFMs) have demonstrated impressive representational capabilities. However, adapting them to downstream tasks via full fine-tuning incurs prohibitive computational and storage overhead. Parameter-Efficient…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Lingyu Xiong , Jinjin Shi , Xuran Xu , Cong Luo , Runyu Shi , Ying Huang

Aiming at achieving artificial general intelligence (AGI) for Metaverse, pretrained foundation models (PFMs), e.g., generative pretrained transformers (GPTs), can effectively provide various AI services, such as autonomous driving, digital…

Networking and Internet Architecture · Computer Science 2023-05-01 Minrui Xu , Dusit Niyato , Hongliang Zhang , Jiawen Kang , Zehui Xiong , Shiwen Mao , Zhu Han

Large language models (LLMs) have demonstrated remarkable success across various application domains, but their enormous sizes and computational demands pose significant challenges for deployment on resource-constrained edge devices. To…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-03-20 Kai Zhang , Hengtao He , Shenghui Song , Jun Zhang , Khaled B. Letaief

Diffusion models have shown remarkable capabilities in generating high-fidelity data across modalities such as images, audio, and video. However, their computational intensity makes deployment on edge devices a significant challenge. This…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-04-23 Dongqi Zheng

As LLMs continue to scale, improving training efficiency increasingly depends on using data more effectively. Data selection addresses this problem by allocating a limited training budget to samples that best promote a target behavior.…

Machine Learning · Computer Science 2026-05-21 Qihao Lin , Guanxu Chen , Dongrui Liu , Jing Shao

Due to the increasing demand of capacity in wireless cellular networks, the small cells such as pico and femto cells are becoming more popular to enjoy a spatial reuse gain, and thus cells with different sizes are expected to coexist in a…

Networking and Internet Architecture · Computer Science 2011-05-05 Kyuho Son , Soohwan Lee , Yung Yi , Song Chong

Background: Increasingly, decision-making in healthcare relies on computer models, be it clinical prediction models at point of care or decision-analytic models at the policymaking level. Given the important role models play in both…

Computation · Statistics 2022-02-22 Amin Adibi , Stephanie Harvard , Mohsen Sadatsafavi

The foundation-model ecosystem remains highly centralized because training requires immense compute resources and is therefore largely limited to large cloud operators. Edge-assisted foundation model training that harnesses spare compute on…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-14 Leyang Xue , Meghana Madhyastha , Myungjin Lee , Amos Storkey , Randal Burns , Mahesh K. Marina

Deploying Vision Transformers on edge devices is challenging due to their high computational complexity, while full offloading to cloud resources presents significant latency overheads. We propose a novel collaborative inference framework,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Hao Liu , Suhaib A. Fahmy

Large language models (LLMs) have achieved near-human performance across diverse reasoning tasks, yet their deployment on resource-constrained Internet-of-Things (IoT) devices remains impractical due to massive parameter footprints and…

Machine Learning · Computer Science 2025-11-07 Mingyu Sung , Vikas Palakonda , Suhwan Im , Sunghwan Moon , Il-Min Kim , Sangseok Yun , Jae-Mo Kang

Detecting glass regions is a challenging task due to the inherent ambiguity in their transparency and reflective characteristics. Current solutions in this field remain rooted in conventional deep learning paradigms, requiring the…

Computer Vision and Pattern Recognition · Computer Science 2024-05-22 Jing Hao , Moyun Liu , Jinrong Yang , Kuo Feng Hung

Diffusion models are now commonly used to solve inverse problems in computational imaging. However, most diffusion-based inverse solvers require complete knowledge of the forward operator to be used. In this work, we introduce a novel…

Image and Video Processing · Electrical Eng. & Systems 2025-09-22 Yuanyun Hu , Evan Bell , Guijin Wang , Yu Sun

In this paper, we introduce PrivDFS, a distributed feature-sharing framework for input-private inference in image classification. A single holistic intermediate representation in split inference gives diffusion-based Data Reconstruction…

Machine Learning · Computer Science 2025-11-17 Zihan Liu , Jiayi Wen , Junru Wu , Xuyang Zou , Shouhong Tan , Zhirun Zheng , Cheng Huang

Contextual Artificial Intelligence (AI) based on emerging Transformer models is predicted to drive the next technology revolution in interactive wearable devices such as new-generation smart glasses. By coupling numerous sensors with small,…

Hardware Architecture · Computer Science 2025-03-27 Severin Bochem , Victor J. B. Jung , Arpan Prasad , Francesco Conti , Luca Benini

Large Language Models (LLMs) based on autoregressive, decoder-only Transformers generate text one token at a time, where a token represents a discrete unit of text. As each newly produced token is appended to the partial output sequence,…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-05-06 Dimitrios Kafetzis , Ramin Khalili , Iordanis Koutsopoulos

Recent advances in Deep Neural Networks (DNNs) have demonstrated outstanding performance across various domains. However, their large size is a challenge for deployment on resource-constrained devices such as mobile, edge, and IoT…

Machine Learning · Computer Science 2024-10-10 Divya Jyoti Bajpai , Manjesh Kumar Hanawal

Foundation models are deep neural networks (such as GPT-5, Gemini~3, and Opus~4) trained on large datasets that can perform diverse downstream tasks -- text and code generation, question answering, summarization, image classification, and…

Machine Learning · Computer Science 2026-05-01 Logan G Wright , Tianyu Wang , Tatsuhiro Onodera , Peter L. McMahon

Simulation plays a central role in scientific discovery. In many applications, the bottleneck is no longer running a simulator; it is choosing among large families of plausible simulators, each corresponding to different forward…

Pretrained models are ubiquitous in the current deep learning landscape, offering strong results on a broad range of tasks. Recent works have shown that models differing in various design choices exhibit categorically diverse generalization…

Machine Learning · Computer Science 2025-10-28 Siddharth Jain , Shyamgopal Karthik , Vineet Gandhi