English
Related papers

Related papers: Bridging Reasoning to Learning: Unmasking Illusion…

200 papers

Deep learning (DL) has driven broad advances across scientific and engineering domains. Despite its success, DL models often exhibit limited interpretability and generalization, which can undermine trust, especially in safety-critical…

Machine Learning · Computer Science 2026-01-14 Atefeh Termehchi , Ekram Hossain , Isaac Woungang

Machine learning has achieved tremendous success in a variety of domains in recent years. However, a lot of these success stories have been in places where the training and the testing distributions are extremely similar to each other. In…

Machine Learning · Statistics 2021-03-05 Martin Arjovsky

Real-world machine learning applications often face simultaneous covariate and semantic shifts, challenging traditional domain generalization and out-of-distribution (OOD) detection methods. We introduce Meta-learned Across Domain…

Machine Learning · Computer Science 2024-11-06 Haoliang Wang , Chen Zhao , Feng Chen

In recent years, machine learning models have achieved success based on the independently and identically distributed assumption. However, this assumption can be easily violated in real-world applications, leading to the Out-of-Distribution…

Machine Learning · Computer Science 2024-03-27 Yifan Hao , Yong Lin , Difan Zou , Tong Zhang

Out-of-distribution (OoD) detection and segmentation have attracted growing attention as concerns about AI security rise. Conventional OoD detection methods identify the existence of OoD objects but lack spatial localization, limiting their…

Computer Vision and Pattern Recognition · Computer Science 2025-08-15 Wenjie Zhao , Jia Li , Yunhui Guo

Out-of-distribution (OOD) detection is an important task in machine learning systems for ensuring their reliability and safety. Deep probabilistic generative models facilitate OOD detection by estimating the likelihood of a data sample.…

Machine Learning · Computer Science 2021-06-16 Jaemoo Choi , Changyeon Yoon , Jeongwoo Bae , Myungjoo Kang

Reasoning based on Large Language Models (LLMs) has garnered increasing attention due to outstanding performance of these models in mathematical and complex logical tasks. Beginning with the Chain-of-Thought (CoT) prompting technique,…

Artificial Intelligence · Computer Science 2025-11-27 Yuto Suzuki , Farnoush Banaei-Kashani

Out-of-distribution (OOD) testing is increasingly popular for evaluating a machine learning system's ability to generalize beyond the biases of a training set. OOD benchmarks are designed to present a different joint distribution of data…

Computer Vision and Pattern Recognition · Computer Science 2020-05-20 Damien Teney , Kushal Kafle , Robik Shrestha , Ehsan Abbasnejad , Christopher Kanan , Anton van den Hengel

Out-of-distribution (OOD) detection is the task of identifying data sampled from distributions that were not used during training. This task is essential for reliable machine learning and a better understanding of their generalization…

Computer Vision and Pattern Recognition · Computer Science 2024-12-11 Kohei Fukuda , Hiroaki Aizawa

Learning complex functions that involve multi-step reasoning poses a significant challenge for standard supervised learning from input-output examples. Chain-of-thought (CoT) supervision, which provides intermediate reasoning steps together…

Machine Learning · Statistics 2025-05-23 Awni Altabaa , Omar Montasser , John Lafferty

Detecting anomalies or out-of-distribution (OOD) samples is critical for maintaining the reliability and trustworthiness of machine learning systems. Recently, Large Language Models (LLMs) have demonstrated their effectiveness not only in…

Machine Learning · Computer Science 2025-02-17 Ruiyao Xu , Kaize Ding

The ability to cope with out-of-distribution (OOD) corruptions and adversarial attacks is crucial in real-world safety-demanding applications. In this study, we develop a general mechanism to increase neural network robustness based on…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Meir Yossef Levi , Guy Gilboa

LLMs show remarkable emergent abilities, such as inferring concepts from presumably out-of-distribution prompts, known as in-context learning. Though this success is often attributed to the Transformer architecture, our systematic…

Computation and Language · Computer Science 2024-10-25 Anna Mészáros , Szilvia Ujváry , Wieland Brendel , Patrik Reizinger , Ferenc Huszár

Deep neural networks often face generalization problems to handle out-of-distribution (OOD) data, and there remains a notable theoretical gap between the contributing factors and their respective impacts. Literature evidence from…

Machine Learning · Computer Science 2024-04-24 Songming Zhang , Yuxiao Luo , Qizhou Wang , Haoang Chi , Xiaofeng Chen , Bo Han , Jinyan Li

Query-driven learned estimators are accurate, flexible, and lightweight alternatives to traditional estimators in query optimization. However, existing query-driven approaches struggle with the Out-of-distribution (OOD) problem, where the…

Databases · Computer Science 2024-12-10 Rui Li , Kangfei Zhao , Jeffrey Xu Yu , Guoren Wang

Large Language Models (LLMs) excel at many tasks but often falter on complex problems that require structured, multi-step reasoning. We introduce the Diagram of Thought (DoT), a framework that enables a single LLM to build and navigate a…

Computation and Language · Computer Science 2026-05-15 Yifan Zhang , Yang Yuan , Andrew Chi-Chih Yao

Supervised learning aims to train a classifier under the assumption that training and test data are from the same distribution. To ease the above assumption, researchers have studied a more realistic setting: out-of-distribution (OOD)…

Machine Learning · Computer Science 2023-02-28 Zhen Fang , Yixuan Li , Jie Lu , Jiahua Dong , Bo Han , Feng Liu

Out-of-Distribution (OOD) detection is a critical task that has garnered significant attention. The emergence of CLIP has spurred extensive research into zero-shot OOD detection, often employing a training-free approach. Current methods…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Haoran Xu , Yanlin Liu , Zizhao Tong , Jiaze Li , Kexue Fu , Yuyang Zhang , Longxiang Gao , Shuaiguang Li , Xingyu Li , Yanran Xu , Changwei Wang

As deep learning methods form a critical part in commercially important applications such as autonomous driving and medical diagnostics, it is important to reliably detect out-of-distribution (OOD) inputs while employing these algorithms.…

Machine Learning · Computer Science 2018-09-12 Apoorv Vyas , Nataraj Jammalamadaka , Xia Zhu , Dipankar Das , Bharat Kaul , Theodore L. Willke

Recent advances on large-scale pre-training have shown great potentials of leveraging a large set of Pre-Trained Models (PTMs) for improving Out-of-Distribution (OoD) generalization, for which the goal is to perform well on possible unseen…

Machine Learning · Computer Science 2022-10-18 Qishi Dong , Awais Muhammad , Fengwei Zhou , Chuanlong Xie , Tianyang Hu , Yongxin Yang , Sung-Ho Bae , Zhenguo Li