English
Related papers

Related papers: Model editing for distribution shifts in uranium o…

200 papers

Universal machine learned interatomic potentials (uMLIPs) embody a growing area of interest due to their transferability across the periodic table, displaying an error of about 0.6 kcal/mol against the Matbench Discovery test set. However,…

Materials Science · Physics 2026-03-12 Nicolas Wong , Julia H. Yang

Methods for knowledge editing and unlearning in large language models seek to edit or remove undesirable knowledge or capabilities without compromising general language modeling performance. This work investigates how mechanistic…

Machine Learning · Computer Science 2024-12-06 Phillip Guo , Aaquib Syed , Abhay Sheshadri , Aidan Ewart , Gintare Karolina Dziugaite

Today, deep learning is increasingly applied in security-critical situations such as autonomous driving and medical diagnosis. Despite its success, the behavior and robustness of deep networks are not fully understood yet, posing a…

Machine Learning · Computer Science 2023-03-27 Sven Elflein

Reliable out-of-distribution (OOD) detection is important for safe deployment of deep learning models in fetal ultrasound amidst heterogeneous image characteristics and clinical settings. OOD detection relies on estimating a classification…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Chun Kit Wong , Anders N. Christensen , Cosmin I. Bercea , Julia A. Schnabel , Martin G. Tolsgaard , Aasa Feragen

Deep neural networks are proven to be vulnerable to data poisoning attacks. Recently, a specific type of data poisoning attack known as availability attacks has led to the failure of data utilization for model learning by adding…

Cryptography and Security · Computer Science 2024-08-16 Yi Yu , Qichen Zheng , Siyuan Yang , Wenhan Yang , Jun Liu , Shijian Lu , Yap-Peng Tan , Kwok-Yan Lam , Alex Kot

Deep Learning models are easily disturbed by variations in the input images that were not seen during training, resulting in unpredictable behaviours. Such Out-of-Distribution (OOD) images represent a significant challenge in the context of…

Image and Video Processing · Electrical Eng. & Systems 2024-10-28 Benjamin Lambert , Florence Forbes , Senan Doyle , Alan Tucholka , Michel Dojat

Time series modeling techniques based on deep learning have seen many advancements in recent years, especially in data-abundant settings and with the central aim of learning global models that can extract patterns across multiple time…

Machine Learning · Computer Science 2020-05-21 Stephan Rabanser , Tim Januschowski , Valentin Flunkert , David Salinas , Jan Gasthaus

Currently, enhancing Unified Multimodal Models (UMMs) with image understanding, generation, and editing capabilities mainly relies on mixed multi-task training. Due to inherent task conflicts, such strategy requires complex multi-stage…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Dian Zheng , Manyuan Zhang , Hongyu Li , Hongbo Liu , Kai Zou , Kaituo Feng , Hongsheng Li

Out-of-Distribution (OOD) detection is essential for the trustworthiness of AI systems. Methods using prior information (i.e., subspace-based methods) have shown effective performance by extracting information geometry to detect OOD data…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Kaiyu Guo , Zijian Wang , Tan Pan , Brian C. Lovell , Mahsa Baktashmotlagh

Transformer-based pretrained language models (PLMs) have achieved great success in modern NLP. An important advantage of PLMs is good out-of-distribution (OOD) robustness. Recently, diffusion models have attracted a lot of work to apply…

Computation and Language · Computer Science 2023-07-27 Huazheng Wang , Daixuan Cheng , Haifeng Sun , Jingyu Wang , Qi Qi , Jianxin Liao , Jing Wang , Cong Liu

The dominating NLP paradigm of training a strong neural predictor to perform one task on a specific dataset has led to state-of-the-art performance in a variety of applications (eg. sentiment classification, span-prediction based question…

Computation and Language · Computer Science 2021-09-06 Paul Michel

Numerous pre-training techniques for visual document understanding (VDU) have recently shown substantial improvements in performance across a wide range of document tasks. However, these pre-trained VDU models cannot guarantee continued…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Jiabang He , Yi Hu , Lei Wang , Xing Xu , Ning Liu , Hui Liu , Heng Tao Shen

To detect distribution shifts and improve model safety, many out-of-distribution (OOD) detection methods rely on the predictive uncertainty or features of supervised models trained on in-distribution data. In this paper, we critically…

Machine Learning · Computer Science 2025-07-03 Yucen Lily Li , Daohan Lu , Polina Kirichenko , Shikai Qiu , Tim G. J. Rudner , C. Bayan Bruss , Andrew Gordon Wilson

Though deep neural networks have achieved impressive success on various vision tasks, obvious performance degradation still exists when models are tested in out-of-distribution scenarios. In addressing this limitation, we ponder that the…

Computer Vision and Pattern Recognition · Computer Science 2023-01-18 Xiaotong Li , Zixuan Hu , Jun Liu , Yixiao Ge , Yongxing Dai , Ling-Yu Duan

Despite their growing popularity, data-driven models of real-world dynamical systems require lots of data. However, due to sensing limitations as well as privacy concerns, this data is not always available, especially in domains such as…

Machine Learning · Computer Science 2023-02-24 Hussain Kazmi , Pierre Pinson

Deep neural networks are often considered opaque systems, prompting the need for explainability methods to improve trust and accountability. Existing approaches typically attribute test-time predictions either to input features (e.g.,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 Aziz Bacha , Thomas George

Recent advances in diffusion transformers have shown remarkable generalization in visual synthesis, yet most dense perception methods still rely on text-to-image (T2I) generators designed for stochastic generation. We revisit this paradigm…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Yiqing Shi , Yiren Song , Mike Zheng Shou

Diffusion models learn to restore noisy data, which is corrupted with different levels of noise, by optimizing the weighted sum of the corresponding loss terms, i.e., denoising score matching loss. In this paper, we show that restoring data…

Computer Vision and Pattern Recognition · Computer Science 2022-04-04 Jooyoung Choi , Jungbeom Lee , Chaehun Shin , Sungwon Kim , Hyunwoo Kim , Sungroh Yoon

State-of-the art vision models can achieve superhuman performance on image classification tasks when testing and training data come from the same distribution. However, when models are tested on corrupted images (e.g. due to scale changes,…

Machine Learning · Computer Science 2019-06-11 Luke Metz , Niru Maheswaranathan , Jonathon Shlens , Jascha Sohl-Dickstein , Ekin D. Cubuk

A significant research effort is focused on exploiting the amazing capacities of pretrained diffusion models for the editing of images.They either finetune the model, or invert the image in the latent space of the pretrained model. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-09 Senmao Li , Joost van de Weijer , Taihang Hu , Fahad Shahbaz Khan , Qibin Hou , Yaxing Wang , Jian Yang , Ming-Ming Cheng