English
Related papers

Related papers: Adaptive Distributed Resampling Algorithm with Non…

200 papers

With the rapid scaling of large language models (LLMs), serving numerous low-rank adaptations (LoRAs) concurrently has become increasingly impractical, leading to unaffordable costs and necessitating more parameter-efficient finetuning…

Machine Learning · Computer Science 2024-05-28 Sheng Wang , Boyang Xue , Jiacheng Ye , Jiyue Jiang , Liheng Chen , Lingpeng Kong , Chuan Wu

In this article, we present a novel approach for block-structured adaptive mesh refinement (AMR) that is suitable for extreme-scale parallelism. All data structures are designed such that the size of the meta data in each distributed…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-07-24 Florian Schornbaum , Ulrich Rüde

Efficient topology optimization based on the adaptive auxiliary reduced model reanalysis (AARMR) is proposed to improve computational efficiency and scale. In this method, a projection auxiliary reduced model (PARM) is integrated into the…

Computational Engineering, Finance, and Science · Computer Science 2023-01-04 Jichao Yin , Hu Wang , Shuhao Li , Daozhen Guo

Data replication is a common method used to improve the performance of data access in distributed database systems. In this paper, we present an object replication algorithm in distributed database systems (ORAD). We optimize the created…

Databases · Computer Science 2012-10-08 Arash Ghorbannia Delavar , Golnoosh Keshani

In modern digital filter chip design, efficient resource utilization is a hot topic. Due to the linear phase characteristics of FIR filters, a pulsed fully parallel structure can be applied to address the problem. To further reduce hardware…

Hardware Architecture · Computer Science 2023-11-27 Mengwei Hu , Zhengxiong Li , Xianyang Jiang

Several research works have applied Reinforcement Learning (RL) algorithms to solve the Rate Adaptation (RA) problem in Wi-Fi networks. The dynamic nature of the radio link requires the algorithms to be responsive to changes in link…

Networking and Internet Architecture · Computer Science 2023-03-31 Ricardo Trancoso , Ruben Queiros , Helder Fontes , Rui Campos

Adaptive training methods for Physics-informed neural network (PINN) require dedicated constructions of the distribution of weights assigned at each training sample. To efficiently seek such an optimal weight distribution is not a simple…

Machine Learning · Computer Science 2022-12-09 Jiayue Han , Zhiqiang Cai , Zhiyou Wu , Xiang Zhou

Most methods for Bundle Adjustment (BA) in computer vision are either centralized or operate incrementally. This leads to poor scaling and affects the quality of solution as the number of images grows in large scale structure from motion…

Computer Vision and Pattern Recognition · Computer Science 2017-08-29 Karthikeyan Natesan Ramamurthy , Chung-Ching Lin , Aleksandr Aravkin , Sharath Pankanti , Raphael Viguier

We present a new approach-the ALVar estimator-to estimation of asymptotic variance in sequential Monte Carlo methods, or, particle filters. The method, which adjusts adaptively the lag of the estimator proposed in [Olsson, J. and Douc, R.…

Computation · Statistics 2022-07-21 Alessandro Mastrototaro , Jimmy Olsson

Appropriately designing the proposal kernel of particle filters is an issue of significant importance, since a bad choice may lead to deterioration of the particle sample and, consequently, waste of computational power. In this paper we…

Methodology · Statistics 2012-10-12 J. Cornebise , E. Moulines , J. Olsson

Fine-tuning large-scale pre-trained models is inherently a resource-intensive task. While it can enhance the capabilities of the model, it also incurs substantial computational costs, posing challenges to the practical application of…

Computation and Language · Computer Science 2024-06-27 Yulong Mao , Kaiyu Huang , Changhao Guan , Ganglin Bao , Fengran Mo , Jinan Xu

Biological network alignment is currently in a state of disarray, with more than two dozen network alignment tools having been introduced in the past decade, with no clear winner, and other new tools being published almost quarterly. Part…

Molecular Networks · Quantitative Biology 2017-09-06 Dillon P. Kanne , Wayne B. Hayes

Distributed computing excels at processing large scale data, but the communication cost for synchronizing the shared parameters may slow down the overall performance. Fortunately, the interactions between parameter and data in many problems…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-05-19 Mu Li , Dave G. Andersen , Alexander J. Smola

This paper considers online optimization for a system that performs a sequence of back-to-back tasks. Each task can be processed in one of multiple processing modes that affect the duration of the task, the reward earned, and an additional…

Optimization and Control · Mathematics 2024-01-17 Michael J. Neely

Neural architecture search has attracted wide attentions in both academia and industry. To accelerate it, researchers proposed weight-sharing methods which first train a super-network to reuse computation among different operators, from…

Machine Learning · Computer Science 2020-12-16 Xin Chen , Lingxi Xie , Jun Wu , Longhui Wei , Yuhui Xu , Qi Tian

The objective of this study is to evaluate whether the number of requisite training samples can be reduced with the use of various transfer learning models for predicting, for example, the chemical source terms of the data-driven…

Chemical Physics · Physics 2024-12-18 Ki Sung Jung , Tarek Echekki , Jacqueline H. Chen , Mohammad Khalil

Autonomous systems (AS) often use Deep Neural Network (DNN) classifiers to allow them to operate in complex, high-dimensional, non-linear, and dynamically changing environments. Due to the complexity of these environments, DNN classifiers…

Machine Learning · Computer Science 2024-08-16 Abanoub Ghobrial , Xuan Zheng , Darryl Hond , Hamid Asgari , Kerstin Eder

This work considers the problem of control and resource scheduling in networked systems. We present DIRA, a Deep reinforcement learning based Iterative Resource Allocation algorithm, which is scalable and control-aware. Our algorithm is…

Systems and Control · Computer Science 2019-09-24 Adrian Redder , Arunselvan Ramaswamy , Daniel E. Quevedo

In this paper, we revisit the widely known performance anomaly that results in severe network utility degradation in WiFi networks when nodes use diverse modulation and coding schemes. The proportional-fair allocation was shown to mitigate…

Networking and Internet Architecture · Computer Science 2021-02-11 Piotr Gawłowicz , Jean Walrand , Adam Wolisz

Nowadays, huge amounts of data are naturally collected in distributed sites due to different facts and moving these data through the network for extracting useful knowledge is almost unfeasible for either technical reasons or policies.…

Databases · Computer Science 2017-03-30 Lamine M. Aouad , Nhien-An Le-Khac , Tahar Kechadi