English
Related papers

Related papers: Self-Adaptive Probabilistic Skyline Query Processi…

200 papers

Recent progress in scientific machine learning (SciML) has opened up the possibility of training novel neural network architectures that solve complex partial differential equations (PDEs). Several (nearly data free) approaches have been…

Methods for distributed optimization have received significant attention in recent years owing to their wide applicability in various domains. A distributed optimization method typically consists of two key components: communication and…

Optimization and Control · Mathematics 2018-06-04 Albert S. Berahas , Raghu Bollapragada , Nitish Shirish Keskar , Ermin Wei

Recently, enhancing the numerical and logical reasoning capability of Large Language Models (LLMs) has emerged as a research hotspot. Existing methods face several limitations: inference-phase techniques (e.g., Chain of Thoughts) rely on…

Artificial Intelligence · Computer Science 2025-02-20 Hao Yi , Qingyang Li , Yulan Hu , Fuzheng Zhang , Di Zhang , Yong Liu

Distributed deep learning (DDL) training systems are designed for cloud and data-center environments that assumes homogeneous compute resources, high network bandwidth, sufficient memory and storage, as well as independent and identically…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-01-30 Sahil Tyagi , Martin Swany

While Diffusion Language Models (DLMs) offer a flexible, arbitrary-order alternative to the autoregressive paradigm, their non-causal nature precludes standard KV caching, forcing costly hidden state recomputation at every decoding step.…

Machine Learning · Computer Science 2026-05-26 Wenhao Sun , Rong-Cheng Tu , Yifu Ding , Zhao Jin , Jingyi Liao , Yongcheng Jing , Dacheng Tao

We introduce the Structured Knowledge Accumulation (SKA) framework, which reinterprets entropy as a dynamic, layer-wise measure of knowledge alignment in neural networks. Instead of relying on traditional gradient-based optimization, SKA…

Machine Learning · Computer Science 2025-03-19 Bouarfa Mahi Quantiota

We study federated machine learning (ML) at the wireless edge, where power- and bandwidth-limited wireless devices with local datasets carry out distributed stochastic gradient descent (DSGD) with the help of a remote parameter server (PS).…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-04-08 Mohammad Mohammadi Amiri , Deniz Gunduz

In this paper, we propose a novel deep architecture tailored for 3D point cloud applications, named as SPE-Net. The embedded ``Selective Position Encoding (SPE)'' procedure relies on an attention mechanism that can effectively attend to the…

Computer Vision and Pattern Recognition · Computer Science 2022-11-16 Zhaofan Qiu , Yehao Li , Yu Wang , Yingwei Pan , Ting Yao , Tao Mei

Realistic physical phenomena exhibit random fluctuations across many scales in the input and output processes. Models of these phenomena require stochastic PDEs. For three-dimensional coupled (vector-valued) stochastic PDEs (SPDEs), for…

Computational Engineering, Finance, and Science · Computer Science 2022-08-24 Ajit Desai , Mohammad Khalil , Chris L. Pettit , Dominique Poirel , Abhijit Sarkar

Skyline computation is an essential database operation that has many applications in multi-criteria decision making scenarios such as recommender systems. Existing algorithms have focused on checking point domination, which lack efficiency…

Databases · Computer Science 2021-07-22 Chuanwen Li , Yu Gu , Jianzhong Qi , Ge Yu

Despite their remarkable success in complex tasks propelling widespread adoption, large language-model-based agents still face critical deployment challenges due to prohibitive latency and inference costs. While recent work has explored…

Artificial Intelligence · Computer Science 2025-09-23 Yilin Guan , Qingfeng Lan , Sun Fei , Dujian Ding , Devang Acharya , Chi Wang , William Yang Wang , Wenyue Hua

While many Particle Swarm Optimization (PSO) algorithms only use fitness to assess the performance of particles, in this work, we adopt Surprisingly Popular Algorithm (SPA) as a complementary metric in addition to fitness. Consequently,…

Neural and Evolutionary Computing · Computer Science 2023-09-14 Xuan Wu , Jizong Han , Di Wang , Pengyue Gao , Quanlong Cui , Liang Chen , Yanchun Liang , Han Huang , Heow Pueh Lee , Chunyan Miao , You Zhou , Chunguo Wu

In this paper, we propose a novel reduced-rank adaptive filtering algorithm by blending the idea of the Krylov subspace methods with the set-theoretic adaptive filtering framework. Unlike the existing Krylov-subspace-based reduced-rank…

Information Theory · Computer Science 2013-06-28 R. C. de Lamare , M. Yukawa , I. Yamada

We consider a hierarchical edge-cloud architecture in which services are provided to mobile users as chains of virtual network functions. Each service has specific computation requirements and target delay performance, which require placing…

Networking and Internet Architecture · Computer Science 2022-02-21 Itamar Cohen , Carla Fabiana Chiasserini , Paolo Giaccone , Gabriel Scalosub

As Spark becomes a common big data analytics platform, its growing complexity makes automatic tuning of numerous parameters critical for performance. Our work on Spark parameter tuning is particularly motivated by two recent trends: Spark's…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-09-24 Chenghao Lyu , Qi Fan , Philippe Guyard , Yanlei Diao

Multi-criteria decision analysis in databases has been actively studied, especially through the Skyline operator. Yet, few approaches offer a relevant comparison of Pareto optimal, or Skyline, points for high cardinality result sets. We…

Databases · Computer Science 2024-11-05 Mickaël Martin-Nevot , Lotfi Lakhal

Edge computing decentralizes computing resources, allowing for novel applications in domains such as the Internet of Things (IoT) in healthcare and agriculture by reducing latency and improving performance. This decentralization is achieved…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-12-17 Suhrid Gupta , Muhammed Tawfiqul Islam , Rajkumar Buyya

Scalable Bayesian sampling is playing an important role in modern machine learning, especially in the fast-developed unsupervised-(deep)-learning models. While tremendous progresses have been achieved via scalable Bayesian sampling such as…

Machine Learning · Statistics 2018-11-26 Yang Zhao , Jianyi Zhang , Changyou Chen

This paper proposes a communication strategy for decentralized learning on wireless systems. Our discussion is based on the decentralized parallel stochastic gradient descent (D-PSGD), which is one of the state-of-the-art algorithms for…

Networking and Internet Architecture · Computer Science 2020-02-26 Koya Sato , Yasuyuki Satoh , Daisuke Sugimura

Numerical resolution of high-dimensional nonlinear PDEs remains a huge challenge due to the curse of dimensionality. Starting from the weak formulation of the Lawson-Euler scheme, this paper proposes a stochastic particle method (SPM) by…

Numerical Analysis · Mathematics 2025-02-11 Zhengyang Lei , Sihong Shao , Yunfeng Xiong