English
Related papers

Related papers: A Framework for Characterizing Novel Environment T…

200 papers

This paper investigates the ability of transformer-based models to learn structural recursion from examples. Recursion is a universal concept in both natural and formal languages. Structural recursion is central to the programming language…

Computation and Language · Computer Science 2024-01-24 Dylan Zhang , Curt Tigges , Zory Zhang , Stella Biderman , Maxim Raginsky , Talia Ringer

Traditional models of rational action treat the agent as though it is cleanly separated from its environment, and can act on that environment from the outside. Such agents have a known functional relationship with their environment, can…

Artificial Intelligence · Computer Science 2020-10-08 Abram Demski , Scott Garrabrant

Existing change detection methods often lack the versatility to handle diverse real-world queries and the intelligence for comprehensive analysis. This paper presents a general agent framework, integrating Large Language Models (LLM) with…

Artificial Intelligence · Computer Science 2026-01-08 Zixuan Xiao , Jun Ma

Large Language Models (LLMs) have recently shown great promise in planning and reasoning applications. These tasks demand robust systems, which arguably require a causal understanding of the environment. While LLMs can acquire and reflect…

Artificial Intelligence · Computer Science 2024-10-29 John Gkountouras , Matthias Lindemann , Phillip Lippe , Efstratios Gavves , Ivan Titov

Understanding learning as a dynamic process is challenging due to the interaction of multiple factors, including cognitive load, internal state change, and subjective evaluation. Existing approaches often address these elements in…

Computers and Society · Computer Science 2026-01-08 Miyuki T. Nakata

Generative AI is rapidly reshaping STEM higher education. Not only are our educational practices changing, but how we think about educational transformation must adapt. Existing models of institutional change in STEM, aimed at interactive…

Physics Education · Physics 2026-05-14 David Perl-Nussbaum , Noah D. Finkelstein

Interacting with the actual environment to acquire data is often costly and time-consuming in robotic tasks. Model-based offline reinforcement learning (RL) provides a feasible solution. On the one hand, it eliminates the requirements of…

Machine Learning · Computer Science 2023-10-17 Pengqin Wang , Meixin Zhu , Shaojie Shen

Modal testing plays a critical role in structural analysis by providing essential insights into dynamic behaviour across a wide range of engineering industries. In practice, designing an effective modal test campaign involves complex…

Machine Learning · Computer Science 2025-08-21 Collins O. Ogbodo , Timothy J. Rogers , Mattia Dal Borgo , David J. Wagg

Large-scale natural language understanding (NLU) systems have made impressive progress: they can be applied flexibly across a variety of tasks, and employ minimal structural assumptions. However, extensive empirical research has shown this…

Artificial Intelligence · Computer Science 2020-05-26 Ronen Tamari , Gabriel Stanovsky , Dafna Shahaf , Reut Tsarfaty

Interacting with human agents in complex scenarios presents a significant challenge for robotic navigation, particularly in environments that necessitate both collision avoidance and collaborative interaction, such as indoor spaces. Unlike…

Robotics · Computer Science 2024-11-07 Lingfeng Sun , Yixiao Wang , Pin-Yun Hung , Changhao Wang , Xiang Zhang , Zhuo Xu , Masayoshi Tomizuka

As one of the crucial human aspects, individual decision-making behavior that may affect the quality of a software project is adaptive to the environment in which the individual is. However, no comprehensive reference framework of the…

Software Engineering · Computer Science 2016-12-05 Jingdong Jia , Pengnan Zhang , Luiz Fernando Capretz

We present a framework for autonomously learning a portable representation that describes a collection of low-level continuous environments. We show that these abstract representations can be learned in a task-independent egocentric space…

Machine Learning · Computer Science 2019-05-30 Steven James , Benjamin Rosman , George Konidaris

Embodied agents require robust navigation systems to operate in unstructured environments, making the robustness of Simultaneous Localization and Mapping (SLAM) models critical to embodied agent autonomy. While real-world datasets are…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Xiaohao Xu , Tianyi Zhang , Sibo Wang , Xiang Li , Yongqi Chen , Ye Li , Bhiksha Raj , Matthew Johnson-Roberson , Xiaonan Huang

In model-based reinforcement learning, generative and temporal models of environments can be leveraged to boost agent performance, either by tuning the agent's representations during training or via use as part of an explicit planning…

Most of the works on planning and learning, e.g., planning by (model based) reinforcement learning, are based on two main assumptions: (i) the set of states of the planning domain is fixed; (ii) the mapping between the observations from the…

Artificial Intelligence · Computer Science 2018-11-27 Luciano Serafini , Paolo Traverso

Integrating multimodal foundation models into enterprise ecosystems presents a fundamental software architecture challenge. Architects must balance competing quality attributes: the high latency and non-determinism of vision language action…

Artificial Intelligence · Computer Science 2026-05-01 Habtom Kahsay Gidey , Alexander Lenz , Alois Knoll

We propose an explainable reinforcement learning (XRL) framework that analyzes an agent's history of interaction with the environment to extract interestingness elements that help explain its behavior. The framework relies on data readily…

Machine Learning · Computer Science 2020-08-20 Pedro Sequeira , Melinda Gervasio

Training a model-free reinforcement learning agent requires allowing the agent to sufficiently explore the environment to search for an optimal policy. In safety-constrained environments, utilizing unsupervised exploration or a non-optimal…

Artificial Intelligence · Computer Science 2024-08-05 Erfan Entezami , Mahsa Sahebdel , Dhawal Gupta

The landscape of video generation is shifting, from a focus on generating visually appealing clips to building virtual environments that support interaction and maintain physical plausibility. These developments point toward the emergence…

Artificial Intelligence · Computer Science 2026-02-09 Jingtong Yue , Ziqi Huang , Zhaoxi Chen , Xintao Wang , Pengfei Wan , Ziwei Liu

Understanding a Reinforcement Learning (RL) policy is crucial for ensuring that autonomous agents behave according to human expectations. This goal can be achieved using Explainable Reinforcement Learning (XRL) techniques. Although textual…

Artificial Intelligence · Computer Science 2026-01-07 Ahmad Terra , Mohit Ahmed , Rafia Inam , Elena Fersman , Martin Törngren