English
Related papers

Related papers: NovGrid: A Flexible Grid World for Evaluating Agen…

200 papers

Reinforcement learning is an emerging approach to control dynamical systems for which classical approaches are difficult to apply. However, trained agents may not generalize against the variations of system parameters. This paper presents…

Systems and Control · Electrical Eng. & Systems 2023-11-10 Abdel Gafoor Haddad , Igor Boiko , Yahya Zweiri

This paper introduces a framework for quantitative characterization of the controllability of time-varying linear systems (or networks) in terms of input novelty. The motivation for such an approach comes from the study of biophysical…

Optimization and Control · Mathematics 2014-11-24 Gautam Kumar , Delsin Menolascino , ShiNung Ching

Neural networks (NNs) can achieved high performance in various fields such as computer vision, and natural language processing. However, deploying NNs in resource-constrained safety-critical systems has challenges due to uncertainty in the…

Machine Learning · Computer Science 2024-01-17 Soyed Tuhin Ahmed

Many sequential decision-making problems that are currently automated, such as those in manufacturing or recommender systems, operate in an environment where there is either little uncertainty, or zero risk of catastrophe. As companies and…

Machine Learning · Computer Science 2023-04-04 Marc Rigter

This paper presents the Real-time Adaptive and Interpretable Detection (RAID) algorithm. The novel approach addresses the limitations of state-of-the-art anomaly detection methods for multivariate dynamic processes, which are restricted to…

Machine Learning · Computer Science 2023-04-07 Marek Wadinger , Michal Kvasnica

Novel object synthesis by integrating distinct textual concepts from diverse categories remains a significant challenge in Text-to-Image (T2I) generation. Existing methods often suffer from insufficient concept mixing, lack of rigorous…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Jun Li , Zikun Chen , Haibo Chen , Shuo Chen , Jian Yang

Managing inputs that are novel, unknown, or out-of-distribution is critical as an agent moves from the lab to the open world. Novelty-related problems include being tolerant to novel perturbations of the normal input, detecting when the…

Recent work on visual world models shows significant promise in latent state dynamics obtained from pre-trained image backbones. However, most of the current approaches are sensitive to training quality, requiring near-complete coverage of…

Robotics · Computer Science 2025-08-11 Eric Jing , Abdeslam Boularias

Reinforcement learning (RL) can provide adaptive and scalable controllers essential for power grid decarbonization. However, RL methods struggle with power grids' complex dynamics, long-horizon goals, and hard physical constraints. For…

Novelty Detection methods identify samples that are not representative of a model's training set thereby flagging misleading predictions and bringing a greater flexibility and transparency at deployment time. However, research in this area…

Computer Vision and Pattern Recognition · Computer Science 2022-09-08 Rahaf Aljundi , Daniel Olmeda Reino , Nikolay Chumerin , Richard E. Turner

Discovering functional crystalline materials entails navigating an immense combinatorial design space. While recent advances in generative artificial intelligence have enabled the sampling of chemically plausible compositions and…

Machine Learning · Computer Science 2025-11-11 Hyunsoo Park , Aron Walsh

The vast majority of recommender systems model preferences as static or slowly changing due to observable user experience. However, spontaneous changes in user preferences are ubiquitous in many domains like media consumption and key…

Human-Computer Interaction · Computer Science 2016-10-24 Arun Kumar , Paul Schrater

Robust generalization to new concepts has long remained a distinctive feature of human intelligence. However, recent progress in deep generative models has now led to neural architectures capable of synthesizing novel instances of unknown…

Artificial Intelligence · Computer Science 2022-10-10 Victor Boutin , Lakshya Singhal , Xavier Thomas , Thomas Serre

Flexibility design problems are a class of problems that appear in strategic decision-making across industries, where the objective is to design a ($e.g.$, manufacturing) network that affords flexibility and adaptivity. The underlying…

Machine Learning · Computer Science 2021-01-19 Yehua Wei , Lei Zhang , Ruiyi Zhang , Shijing Si , Hao Zhang , Lawrence Carin

Generative Recommendation has emerged as a transformative paradigm, reformulating recommendation as an end-to-end autoregressive sequence generation task. Despite its promise, existing preference optimization methods typically rely on…

Information Retrieval · Computer Science 2026-02-13 Chenxiao Fan , Chongming Gao , Yaxin Gong , Haoyan Liu , Fuli Feng , Xiangnan He

When evaluated in dynamic, open-world situations, neural networks struggle to detect unseen classes. This issue complicates the deployment of continual learners in realistic environments where agents are not explicitly informed when novel…

Machine Learning · Computer Science 2023-09-07 Abe Ejilemele , Jorge Mendez-Mendez

Despite the numerous advances, reinforcement learning remains away from widespread acceptance for autonomous controller design as compared to classical methods due to lack of ability to effectively tackle the reality gap. The reliance on…

Machine Learning · Computer Science 2024-09-23 Narendra Patwardhan , Zequn Wang

Supervised representation learning with deep networks tends to overfit the training classes and the generalization to novel classes is a challenging question. It is common to evaluate a learned embedding on held-out images of the same…

Computer Vision and Pattern Recognition · Computer Science 2022-08-18 Quentin Leroy , Olivier Buisson , Alexis Joly

The advent of Convolutional Neural Networks (CNNs) has led to their application in several domains. One noteworthy application is the perception system for autonomous driving that relies on the predictions from CNNs. Practitioners evaluate…

Computer Vision and Pattern Recognition · Computer Science 2022-02-04 Arvind Kumar Shekar , Laureen Lake , Liang Gou , Liu Ren

Novelty detection is commonly referred to as the discrimination of observations that do not conform to a learned model of regularity. Despite its importance in different application settings, designing a novelty detector is utterly complex…

Computer Vision and Pattern Recognition · Computer Science 2019-03-07 Davide Abati , Angelo Porrello , Simone Calderara , Rita Cucchiara