English
Related papers

Related papers: Intrinsic Barriers to Explaining Deep Foundation M…

200 papers

Declarative approaches to process modeling are regarded as well suited for highly volatile environments as they provide a high degree of flexibility. However, problems in understanding and maintaining declarative business process models…

Software Engineering · Computer Science 2015-11-12 Cornelia Haisjackl , Stefan Zugal , Pnina Soffer , Irit Hadar , Manfred Reichert , Jakob Pinggera , Barbara Weber

This paper proposes and argues for a counterintuitive thesis: the truly valuable capabilities of large language models (LLMs) reside precisely in the part that cannot be fully captured by human-readable discrete rules. The core argument is…

Artificial Intelligence · Computer Science 2026-03-18 Quan Cheng

Modeling environmental ecosystems is essential for effective resource management, sustainable development, and understanding complex ecological processes. However, traditional data-driven methods face challenges in capturing inherently…

Machine Learning · Computer Science 2025-04-08 Runlong Yu , Shengyu Chen , Yiqun Xie , Huaxiu Yao , Jared Willard , Xiaowei Jia

Model-based methods and deep neural networks have both been tremendously successful paradigms in machine learning. In model-based methods, problem domain knowledge can be built into the constraints of the model, typically at the expense of…

Machine Learning · Computer Science 2014-11-21 John R. Hershey , Jonathan Le Roux , Felix Weninger

The success of artificial intelligence (AI), and deep learning models in particular, has led to their widespread adoption across various industries due to their ability to process huge amounts of data and learn complex patterns. However,…

Artificial Intelligence · Computer Science 2023-09-22 Wei Jie Yeo , Wihan van der Heever , Rui Mao , Erik Cambria , Ranjan Satapathy , Gianmarco Mengaldo

Recent advances in Deep Machine Learning have shown promise in solving complex perception and control loops via methods such as reinforcement and imitation learning. However, guaranteeing safety for such learned deep policies has been a…

Robotics · Computer Science 2020-03-03 Tom Hirshberg , Sai Vemprala , Ashish Kapoor

Machine Learning has been successfully applied in systems applications such as memory prefetching and caching, where learned models have been shown to outperform heuristics. However, the lack of understanding the inner workings of these…

Machine Learning · Computer Science 2022-02-14 Leon Sixt , Evan Zheran Liu , Marie Pellat , James Wexler , Milad Hashemi , Been Kim , Martin Maas

Foundation Models (FMs) such as Large Language Models (LLMs) are reshaping the software industry by enabling FMware, systems that integrate these FMs as core components. In this KDD 2025 tutorial, we present a comprehensive exploration of…

Foundation models, as a mainstream technology in artificial intelligence, have demonstrated immense potential across various domains in recent years, particularly in handling complex tasks and multimodal data. In the field of geophysics,…

Geophysics · Physics 2025-04-28 Hanlin Sheng , Xinming Wu , Hang Gao , Haibin Di , Sergey Fomel , Jintao Li , Xu Si

Time series foundation models (TSFMs) are a class of potentially powerful, general-purpose tools for time series forecasting and related temporal tasks, but their behavior is strongly shaped by subtle inductive biases in their design.…

The interest in complex deep neural networks for computer vision applications is increasing. This leads to the need for improving the interpretable capabilities of these models. Recent explanation methods present visualizations of the…

Machine Learning · Computer Science 2020-04-24 Dan Valle , Tiago Pimentel , Adriano Veloso

Recent advances in artificial intelligence have witnessed the emergence of large-scale deep learning models capable of interpreting and generating both textual and imaging data. Such models, typically referred to as foundation models, are…

Deep Neural Networks (DNNs) are intensively used to solve a wide variety of complex problems. Although powerful, such systems require manual configuration and tuning. To this end, we view DNNs as configurable systems and propose an…

Machine Learning · Computer Science 2019-04-10 Salah Ghamizi , Maxime Cordy , Mike Papadakis , Yves Le Traon

Advances in the general capabilities of large language models (LLMs) have led to their use for information retrieval, and as components in automated decision systems. A faithful representation of probabilistic reasoning in these models may…

Artificial Intelligence · Computer Science 2025-04-21 Gabriel Freedman , Francesca Toni

Can language models (LMs) learn to faithfully describe their internal computations? Are they better able to describe themselves than other models? We study the extent to which LMs' privileged access to their own internals can be leveraged…

Computation and Language · Computer Science 2026-02-10 Belinda Z. Li , Zifan Carl Guo , Vincent Huang , Jacob Steinhardt , Jacob Andreas

Large foundation models, including large language models (LLMs), vision transformers (ViTs), diffusion, and LLM-based multimodal models, are revolutionizing the entire machine learning lifecycle, from training to deployment. However, the…

Foundational Models (FMs) are gaining increasing attention in the biomedical AI ecosystem due to their ability to represent and contextualize multimodal biomedical data. These capabilities make FMs a valuable tool for a variety of tasks,…

Problem-solving has been a fundamental driver of human progress in numerous domains. With advancements in artificial intelligence, Large Language Models (LLMs) have emerged as powerful tools capable of tackling complex problems across…

Machine Learning · Computer Science 2025-05-07 Da Zheng , Lun Du , Junwei Su , Yuchen Tian , Yuqi Zhu , Jintian Zhang , Lanning Wei , Ningyu Zhang , Huajun Chen

A task of interest in machine learning (ML) is that of ascribing explanations to the predictions made by ML models. Furthermore, in domains deemed high risk, the rigor of explanations is paramount. Indeed, incorrect explanations can and…

Artificial Intelligence · Computer Science 2025-07-11 Mohamed Siala , Jordi Planes , Joao Marques-Silva

In recent years, the use of sophisticated statistical models that influence decisions in domains of high societal relevance is on the rise. Although these models can often bring substantial improvements in the accuracy and efficiency of…

Machine Learning · Computer Science 2021-04-13 Alfredo Carrillo , Luis F. Cantú , Alejandro Noriega