English
Related papers

Related papers: EPSO: A Caching-Based Efficient Superoptimizer for…

200 papers

Bayesian optimization is efficient even with a small amount of data and is used in engineering and in science, including biology and chemistry. In Bayesian optimization, a parameterized model with an uncertainty is fitted to explain the…

Machine Learning · Computer Science 2024-12-06 Yujin Taguchi , Yusuke Shibuya , Yusuke Hiki , Takashi Morikura , Takahiro G. Yamada , Akira Funahashi

Kernel density estimation is a well known method involving a smoothing parameter (the bandwidth) that needs to be tuned by the user. Although this method has been widely used the bandwidth selection remains a challenging issue in terms of…

Statistics Theory · Mathematics 2019-02-05 Suzanne Varet , Claire Lacour , Pascal Massart , Vincent Rivoirard

It is commonly believed that Bayesian optimization (BO) algorithms are highly efficient for optimizing numerically costly functions. However, BO is not often compared to widely different alternatives, and is mostly tested on narrow sets of…

Optimization and Control · Mathematics 2021-10-01 Rodolphe Le Riche , Victor Picheny

FPGA accelerators on the NIC enable the offloading of expensive packet processing tasks from the CPU. However, FPGAs have limited resources that may need to be shared among diverse applications, and programming them is difficult. We present…

This paper is concerned with sequential filtering based stochastic optimization (FSO) approaches that leverage a probabilistic perspective to implement the incremental proximity method (IPM). The present FSO methods are derived based on the…

Machine Learning · Computer Science 2020-01-08 Bin Liu

Large language models (LLMs) have demonstrated transformative capabilities across diverse artificial intelligence applications, yet their deployment is hindered by substantial memory and computational demands, especially in…

Hardware Architecture · Computer Science 2025-05-13 Feng Cheng , Cong Guo , Chiyue Wei , Junyao Zhang , Changchun Zhou , Edward Hanson , Jiaqi Zhang , Xiaoxiao Liu , Hai "Helen" Li , Yiran Chen

Existing methods for fine-tuning sparse LLMs often suffer from resource-intensive requirements and high retraining costs. Additionally, many fine-tuning methods often rely on approximations or heuristic optimization strategies, which may…

Machine Learning · Computer Science 2024-02-21 Song Guo , Fan Wu , Lei Zhang , Xiawu Zheng , Shengchuan Zhang , Fei Chao , Yiyu Shi , Rongrong Ji

Information-theoretic Bayesian optimisation techniques have demonstrated state-of-the-art performance in tackling important global optimisation problems. However, current information-theoretic approaches require many approximations in…

Machine Learning · Statistics 2018-06-07 Binxin Ru , Mark McLeod , Diego Granziol , Michael A. Osborne

Bayesian Optimization (BO) has shown promise in tuning processor design parameters. However, standard BO does not support constraints involving categorical parameters such as types of branch predictors and division circuits. In addition,…

Hardware Architecture · Computer Science 2025-06-10 Haoran Wu , Ce Guo , Wayne Luk , Robert Mullins

Reinforcement learning from verifiable rewards has significantly advanced the reasoning capabilities of large language models. However, Group Relative Policy Optimization (GRPO) typically assigns a uniform, sequence-level advantage to all…

Machine Learning · Computer Science 2026-04-06 Song Yu , Li Li , Wenwen Zhao , Zhisheng Yang

The Linux kernel extensively uses the Berkeley Packet Filter (BPF) to allow user-written BPF applications to execute in the kernel space. The BPF employs a verifier to check the security of user-supplied BPF code statically. Recent attacks…

Cryptography and Security · Computer Science 2024-06-10 Hongyi Lu , Shuai Wang , Yechang Wu , Wanning He , Fengwei Zhang

Existing tamper-evident logging systems suffer from high overhead and severe data loss in high-load settings, yet only provide coarse-grained tamper detection. Moreover, installing such systems requires recompiling kernel code. To address…

Cryptography and Security · Computer Science 2025-09-09 Rui Zhao , Muhammad Shoaib , Viet Tung Hoang , Wajih Ul Hassan

Bayesian optimization is a popular method for optimizing expensive black-box functions. Yet it oftentimes struggles in high dimensions where the computation could be prohibitively heavy. To alleviate this problem, we introduce Coordinate…

Machine Learning · Computer Science 2022-04-21 Jian Tan , Niv Nayman , Mengchang Wang

Software engineering presents complex, multi-step challenges for Large Language Models (LLMs), requiring reasoning over large codebases and coordinated tool use. The difficulty of these tasks is exemplified by benchmarks like SWE-bench,…

Artificial Intelligence · Computer Science 2026-02-05 Jiahao Yu , Zelei Cheng , Xian Wu , Xinyu Xing

The problems of Lasso regression and optimal design of experiments share a critical property: their optimal solutions are typically \emph{sparse}, i.e., only a small fraction of the optimal variables are non-zero. Therefore, the…

Methodology · Statistics 2023-12-07 Guillaume Sagnol , Luc Pronzato

We leverage eBPF in order to implement custom policies in the Linux memory subsystem. Inspired by CBMM, we create a mechanism that provides the kernel with hints regarding the benefit of promoting a page to a specific size. We introduce a…

Operating Systems · Computer Science 2024-09-18 Konstantinos Mores , Stratos Psomadakis , Georgios Goumas

In the online packet buffering problem (also known as the unweighted FIFO variant of buffer management), we focus on a single network packet switching device with several input ports and one output port. This device forwards unit-size,…

Data Structures and Algorithms · Computer Science 2012-08-15 Marcin Bienkowski

Code optimization is a challenging task requiring a substantial level of expertise from developers. Nonetheless, this level of human capacity is not sufficient considering the rapid evolution of new hardware architectures and software…

Aligning language models for both helpfulness and safety typically requires complex pipelines-separate reward and cost models, online reinforcement learning, and primal-dual updates. Recent direct preference optimization approaches simplify…

Machine Learning · Computer Science 2026-05-13 Tien-Phat Nguyen , Truong Nguyen , Thin Nguyen , Duy Minh Ho Nguyen , Ngoc-Thanh Dinh , Trung Le

Today's monolithic kernels often implement a small, fixed set of policies such as disk I/O scheduling policies, while exposing many parameters to let users select a policy or adjust the specific setting of the policy. Ideally, the…

Operating Systems · Computer Science 2015-10-20 Yan Cui , Quan Chen , Junfeng Yang