English
Related papers

Related papers: A Hierarchical HAZOP-Like Safety Analysis for Lear…

200 papers

Online Continual Learning (OCL) aims to learn from endless non\text{-}stationary data streams, yet most existing methods assume a flat label space and overlook the hierarchical organization of real\text{-}world concepts that evolves both…

Machine Learning · Computer Science 2026-05-13 Xinrui Wang , Shao-Yuan Li , Bartłomiej Twardowski , Alexandra Gomez-Villa , Songcan Chen

Typical design flows are hierarchical and rely on assembling many individual technology elements from standard cells to complete boards. Providers use compact models to provide simplified views of their products to their users. Designers…

Hardware Architecture · Computer Science 2021-04-23 Dan Alexandrescu , Aneesh Balakrishnan , Thomas Lange , Maximilien Glorieux

Autonomous systems like aircraft and assistive robots often operate in scenarios where guaranteeing safety is critical. Methods like Hamilton-Jacobi reachability can provide guaranteed safe sets and controllers for such systems. However,…

This paper reviews the reasons that Human-in-the-Loop is both critical for preventing widely-understood failure modes for machine learning, and not a practical solution. Following this, we review two current heuristic methods for addressing…

Artificial Intelligence · Computer Science 2018-11-26 David Manheim

Machine Learning (ML) has emerged as a pivotal technology in the operation of large and complex systems, driving advancements in fields such as autonomous vehicles, healthcare diagnostics, and financial fraud detection. Despite its…

Cryptography and Security · Computer Science 2026-02-17 Xinrui Zhang , Pincan Zhao , Jason Jaskolka , Heng Li , Rongxing Lu

Humans perceive actions through key transitions that structure actions across multiple abstraction levels, whereas machines, relying on visual features, tend to over-segment. This highlights the difficulty of enabling hierarchical reasoning…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Junxian Huang , Ruichu Cai , Hao Zhu , Juntao Fang , Boyan Xu , Weilin Chen , Zijian Li , Shenghua Gao

The performance of deep learning models in remote sensing (RS) strongly depends on the availability of high-quality labeled data. However, collecting large-scale annotations is costly and time-consuming, while vast amounts of unlabeled…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Wei Huang , Zhitong Xiong , Chenying Liu , Xiao Xiang Zhu

Information systems increasingly leverage artificial intelligence (AI) and machine learning (ML) to generate value from vast amounts of data. However, ML models are imperfect and can generate incorrect classifications. Hence,…

Machine Learning · Computer Science 2023-07-10 Johannes Jakubik , Daniel Weber , Patrick Hemmer , Michael Vössing , Gerhard Satzger

Hierarchical Reinforcement Learning (HRL) algorithms have been demonstrated to perform well on high-dimensional decision making and robotic control tasks. However, because they solely optimize for rewards, the agent tends to search the same…

Robotics · Computer Science 2022-12-27 Kandai Watanabe , Mathew Strong , Omer Eldar

Hierarchical reinforcement learning (HRL) is a promising approach to extend traditional reinforcement learning (RL) methods to solve more complex tasks. Yet, the majority of current HRL methods require careful task-specific design and…

Machine Learning · Computer Science 2018-10-08 Ofir Nachum , Shixiang Gu , Honglak Lee , Sergey Levine

Hierarchical agents have the potential to solve sequential decision making tasks with greater sample efficiency than their non-hierarchical counterparts because hierarchical agents can break down tasks into sets of subtasks that only…

Artificial Intelligence · Computer Science 2019-09-05 Andrew Levy , George Konidaris , Robert Platt , Kate Saenko

In recent years, by utilizing optimization techniques to formulate the propagation of deep model, a variety of so-called Optimization-Derived Learning (ODL) approaches have been proposed to address diverse learning and vision tasks.…

Machine Learning · Computer Science 2023-09-13 Risheng Liu , Xuan Liu , Shangzhi Zeng , Jin Zhang , Yixuan Zhang

Open vocabulary models (e.g. CLIP) have shown strong performance on zero-shot classification through their ability generate embeddings for each class based on their (natural language) names. Prior work has focused on improving the accuracy…

Computer Vision and Pattern Recognition · Computer Science 2023-06-01 Zachary Novack , Julian McAuley , Zachary C. Lipton , Saurabh Garg

Adaptive traffic signal control (ATSC) is essential for mitigating urban congestion in modern smart cities, where traffic infrastructure is evolving into interconnected Web-of-Things (WoT) environments with thousands of sensing-and-control…

Machine Learning · Computer Science 2026-03-23 Yaqiao Zhu , Hongkai Wen , Geyong Min , Man Luo

Hierarchical reinforcement learning (HRL) holds great potential for sample-efficient learning on challenging long-horizon tasks. In particular, letting a higher level assign subgoals to a lower level has been shown to enable fast learning…

Machine Learning · Computer Science 2021-12-07 Nico Gürtler , Dieter Büchler , Georg Martius

Hierarchical Instruction Following (HIF) refers to the problem of prompting large language models with a priority-ordered stack of instructions. Standard methods like RLHF and DPO typically fail in this problem since they mainly optimize…

Machine Learning · Computer Science 2026-03-18 Keru Chen , Jun Luo , Sen Lin , Yingbin Liang , Alvaro Velasquez , Nathaniel Bastian , Shaofeng Zou

Machine Learning (ML) will play a significant role in the success of the upcoming High-Luminosity LHC (HL-LHC) program at CERN. An unprecedented amount of data at the exascale will be collected by LHC experiments in the next decade, and…

High Energy Physics - Experiment · Physics 2020-12-14 Valentin Kuznetsov , Luca Giommi , Daniele Bonacorsi

We propose a novel hierarchical reinforcement learning framework for quadruped locomotion over challenging terrain. Our approach incorporates a two-layer hierarchy in which a high-level policy (HLP) selects optimal goals for a low-level…

Robotics · Computer Science 2025-06-26 Jeremiah Coholich , Muhammad Ali Murtaza , Seth Hutchinson , Zsolt Kira

In this work, we propose a hierarchical reinforcement learning (HRL) structure which is capable of performing autonomous vehicle planning tasks in simulated environments with multiple sub-goals. In this hierarchical structure, the network…

Robotics · Computer Science 2019-11-12 Zhiqian Qiao , Zachariah Tyree , Priyantha Mudalige , Jeff Schneider , John M. Dolan

Machine learning (ML) components are increasingly integrated into software products, yet their complexity and inherent uncertainty often lead to unintended and hazardous consequences, both for individuals and society at large. Despite these…

Software Engineering · Computer Science 2025-09-15 Yining Hong , Christopher S. Timperley , Christian Kästner