English
Related papers

Related papers: Embodied Interpretability: Linking Causal Understa…

200 papers

We consider a causal inference model in which individuals interact in a social network and they may not comply with the assigned treatments. In particular, we suppose that the form of network interference is unknown to researchers. To…

Methodology · Statistics 2023-10-24 Tadao Hoshino , Takahide Yanagi

Estimating the effects of continuous-valued interventions from observational data is a critically important task for climate science, healthcare, and economics. Recent work focuses on designing neural network architectures and…

Machine Learning · Computer Science 2022-10-13 Andrew Jesson , Alyson Douglas , Peter Manshausen , Maëlys Solal , Nicolai Meinshausen , Philip Stier , Yarin Gal , Uri Shalit

Generalized linear mixed models are useful in studying hierarchical data with possibly non-Gaussian responses. However, the intractability of likelihood functions poses challenges for estimation. We develop a new method suitable for this…

Methodology · Statistics 2022-01-26 Zexi Song , Zhiqiang Tan

Vision-language-action models (VLAs) have shown generalization capabilities in robotic manipulation tasks by inheriting from vision-language models (VLMs) and learning action generation. Most VLA models focus on interpreting vision and…

The expansion of explainable artificial intelligence as a field of research has generated numerous methods of visualizing and understanding the black box of a machine learning model. Attribution maps are generally used to highlight the…

Machine Learning · Computer Science 2023-08-02 Ian E. Nielsen , Ravi P. Ramachandran , Nidhal Bouaynaya , Hassan M. Fathallah-Shaykh , Ghulam Rasool

Mediation analysis is a strategy for understanding the mechanisms by which treatments or interventions affect later outcomes. Mediation analysis is frequently applied in randomized trial settings, but typically assumes: a) that randomized…

Methodology · Statistics 2021-12-30 Kara E. Rudolph , Nicholas Williams , Ivan Diaz

Vision-Language-Action (VLA) models for autonomous driving must integrate diverse textual inputs, including navigation commands, hazard warnings, and traffic state descriptions, yet current systems often present these as disconnected…

Robotics · Computer Science 2026-04-03 Yun Li , Yidu Zhang , Simon Thompson , Ehsan Javanmardi , Manabu Tsukada

Understanding the internal representations of large language models (LLMs) is a central challenge in interpretability research. Existing feature interpretability methods often rely on strong assumptions about the structure of…

Machine Learning · Computer Science 2025-09-30 Yifan Luo , Zhennan Zhou , Bin Dong

We study the problem of learning causal representations from unknown, latent interventions in a general setting, where the latent distribution is Gaussian but the mixing function is completely general. We prove strong identifiability…

Machine Learning · Computer Science 2023-12-19 Simon Buchholz , Goutham Rajendran , Elan Rosenfeld , Bryon Aragam , Bernhard Schölkopf , Pradeep Ravikumar

We present Vision-based Navigation with Language-based Assistance (VNLA), a grounded vision-language task where an agent with visual perception is guided via language to find objects in photorealistic indoor environments. The task emulates…

Machine Learning · Computer Science 2019-04-09 Khanh Nguyen , Debadeepta Dey , Chris Brockett , Bill Dolan

Vision-language models (VLMs) are increasingly used as automated judges for multimodal systems, yet their scores provide no indication of reliability. We study this problem through conformal prediction, a distribution-free framework that…

Machine Learning · Computer Science 2026-04-30 Divake Kumar , Sina Tayebati , Devashri Naik , Ranganath Krishnan , Amit Ranjan Trivedi

It has become increasingly common nowadays to collect observations of feature and response pairs from different environments. As a consequence, one has to apply learned predictors to data with a different distribution due to distribution…

Methodology · Statistics 2023-10-31 Kang Du , Yu Xiang

Moral reasoning is fundamental to safe Artificial Intelligence (AI), yet ensuring its consistency across modalities becomes critical as AI systems evolve from text-based assistants to embodied agents. Current safety techniques demonstrate…

Artificial Intelligence · Computer Science 2026-03-18 Xinyi Yang , Chenheng Xu , Weijun Hong , Ce Mo , Qian Wang , Fang Fang , Yixin Zhu

Vision-Language-Action (VLA) models extend vision-language models to embodied control by mapping natural-language instructions and visual observations to robot actions. Despite their capabilities, VLA systems face significant challenges due…

Robotics · Computer Science 2025-10-24 Weifan Guan , Qinghao Hu , Aosheng Li , Jian Cheng

Vision Language Action (VLA) models are widely used in Embodied AI, enabling robots to interpret and execute language instructions. However, their robustness to natural language variability in real-world scenarios has not been thoroughly…

An important goal of computer vision is to build systems that learn visual representations over time that can be applied to many tasks. In this paper, we investigate a vision-language embedding as a core representation and show that it…

Computer Vision and Pattern Recognition · Computer Science 2017-10-17 Tanmay Gupta , Kevin Shih , Saurabh Singh , Derek Hoiem

The instrumental-variables (IV) setting is standard for partial identification of causal effects when unobserved confounding makes point identification impossible. Existing approaches face methodological bottlenecks: closed-form bound…

Machine Learning · Computer Science 2026-05-14 Vahid Balazadeh , Hamidreza Kamkari , Medha Barath , Ricardo Silva , Rahul G. Krishnan

Interpretable insights from predictive models remain critical in bio-statistics, particularly when assessing causality, where classical statistical and machine learning methods often provide inherent clarity. While Neural Networks (NNs)…

Applications · Statistics 2025-05-02 Jean-Baptiste A. Conan

As large language models are increasingly trained and fine-tuned, practitioners need methods to identify which training data drive specific behaviors, particularly unintended ones. Training Data Attribution (TDA) methods address this by…

This paper proposes a general interpretable predictive system with shared information. The system is able to perform predictions in a multi-task setting where distinct tasks are not bound to have the same input/output structure. Embeddings…

Machine Learning · Computer Science 2024-07-02 Maciej Żelaszczyk , Jacek Mańdziuk