中文
相关论文

相关论文: Efficient Transformer-based Hyper-parameter Optimi…

200 篇论文

Recent advances of reasoning models, exemplified by OpenAI's o1 and DeepSeek's R1, highlight the significant potential of Reinforcement Learning (RL) to enhance the reasoning capabilities of Large Language Models (LLMs). However,…

With the continuous increase of IoT applications, their effective scheduling in edge and cloud computing has become a critical challenge. The inherent dynamism and stochastic characteristics of edge and cloud computing, along with IoT…

分布式、并行与集群计算 · 计算机科学 2024-11-01 Zhiyu Wang , Mohammad Goudarzi , Rajkumar Buyya

Transformer, originally devised for natural language processing, has also attested significant success in computer vision. Thanks to its super expressive power, researchers are investigating ways to deploy transformers to reinforcement…

机器学习 · 计算机科学 2023-01-24 Shengchao Hu , Li Shen , Ya Zhang , Yixin Chen , Dacheng Tao

Hyperparameter optimization (HPO) is a powerful technique for automating the tuning of machine learning (ML) models. However, in many real-world applications, accuracy is only one of multiple performance criteria that must be considered.…

机器学习 · 计算机科学 2023-05-12 Noor Awad , Ayushi Sharma , Philipp Muller , Janek Thomas , Frank Hutter

Hyperparameters play a critical role in the performances of many machine learning methods. Determining their best settings or Hyperparameter Optimization (HPO) faces difficulties presented by the large number of hyperparameters as well as…

机器学习 · 统计学 2020-07-21 Yang Yang , Ke Deng , Michael Zhu

Reinforcement Learning with Human Feedback (RLHF) enhances the alignment of Large Language Models (LLMs). However, its limitations have led to the development of Direct Preference Optimization (DPO), an RL-free approach designed to overcome…

计算与语言 · 计算机科学 2025-02-19 Amir Saeidi , Shivanshu Verma , Aswin RRV , Kashif Rasul , Chitta Baral

State-of-the-art image recognition systems use sophisticated Convolutional Neural Networks (CNNs) that are designed and trained to identify numerous object classes. Such networks are fairly resource intensive to compute, prohibiting their…

机器学习 · 计算机科学 2019-01-04 Mohammad Motamedi , Felix Portillo , Mahya Saffarpour , Daniel Fong , Soheil Ghiasi

The purpose of offline multi-task reinforcement learning (MTRL) is to develop a unified policy applicable to diverse tasks without the need for online environmental interaction. Recent advancements approach this through sequence modeling,…

机器学习 · 计算机科学 2024-11-05 Ziqing Fan , Shengchao Hu , Yuhang Zhou , Li Shen , Ya Zhang , Yanfeng Wang , Dacheng Tao

The proliferation of large-scale AI and data-intensive applications has driven the development of Computing Power Networks (CPN). It is a key paradigm for delivering ubiquitous, on-demand computational services with high efficiency.…

网络与互联网体系结构 · 计算机科学 2026-02-04 Haoxiang Luo , Kun Yang , Qi Huang , Marco Aiello , Schahram Dustdar

On-policy reinforcement learning (RL) algorithms are widely used for their strong asymptotic performance and training stability, but they struggle to scale with larger batch sizes, as additional parallel environments yield redundant data…

机器学习 · 计算机科学 2025-11-13 Jianren Wang , Yifan Su , Abhinav Gupta , Deepak Pathak

Hierarchical reinforcement learning (HRL) is a promising approach to extend traditional reinforcement learning (RL) methods to solve more complex tasks. Yet, the majority of current HRL methods require careful task-specific design and…

机器学习 · 计算机科学 2018-10-08 Ofir Nachum , Shixiang Gu , Honglak Lee , Sergey Levine

Federated Reinforcement Learning (FRL) has been deemed as a promising solution for intelligent decision-making in the era of Artificial Internet of Things. However, existing FRL approaches often entail repeated interactions with the…

机器学习 · 计算机科学 2024-05-30 Sheng Yue , Zerui Qin , Xingyuan Hua , Yongheng Deng , Ju Ren

Solving real-world complex tasks using reinforcement learning (RL) without high-fidelity simulation environments or large amounts of offline data can be quite challenging. Online RL agents trained in imperfect simulation environments can…

Optimizing HVAC (Heating, Ventilation and Air Conditioning) can enhance a building's energy efficiency while providing comfort levels for its occupants. Using conventional control systems to maintain HVAC functions is often difficult…

Deep Reinforcement Learning (DRL) has become a powerful tool for developing control policies in queueing networks, but the common use of Multi-layer Perceptron (MLP) neural networks in these applications has significant drawbacks. MLP…

机器学习 · 计算机科学 2025-01-22 Jerrod Wigmore , Brooke Shrader , Eytan Modiano

Legged locomotion in unstructured environments demands not only high-performance control policies but also formal guarantees to ensure robustness under perturbations. Control methods often require carefully designed reference trajectories,…

机器人学 · 计算机科学 2026-03-23 Vrushabh Zinage , Narek Harutyunyan , Eric Verheyden , Fred Y. Hadaegh , Soon-Jo Chung

Real-time data processing in large geo-distributed applications, like the Internet of Things (IoT), increasingly shifts computation from the cloud to the network edge to reduce latency and mitigate network congestion. In this setting,…

数据库 · 计算机科学 2026-03-17 Xenofon Chatziliadis , Eleni Tzirita Zacharatou , Samira Akili , Alphan Eracar , Volker Markl

Severe constraints on memory and computation characterizing the Internet-of-Things (IoT) units may prevent the execution of Deep Learning (DL)-based solutions, which typically demand large memory and high processing load. In order to…

机器学习 · 计算机科学 2021-07-30 Simone Disabato , Manuel Roveri , Cesare Alippi

Traditional DL models are complex and resource hungry and thus, care needs to be taken in designing Internet of (medical) things (IoT, or IoMT) applications balancing efficiency-complexity trade-off. Recent IoT solutions tend to avoid using…

机器学习 · 计算机科学 2023-01-24 Ahsan Habib , Chandan Karmakar , John Yearwood

The low-altitude Internet of Things (IoT), supported by unmanned aerial vehicles (UAVs), provides ground sensing networks with advanced real-time monitoring and data collection. To maximize data collection volume from distributed IoT nodes,…

计算工程、金融与科学 · 计算机科学 2026-05-25 Zhenjia Xu , Xiaoling Zhang , Nan Qi , Guangxu Zhu , Xiaojie Li , Luliang Jia