English
Related papers

Related papers: Mapping the Mind of an Instruction-based Image Edi…

200 papers

Medical imaging diagnosis increasingly relies on Machine Learning (ML) models. This is a task that is often hampered by severely imbalanced datasets, where positive cases can be quite rare. Their use is further compromised by their limited…

Machine Learning · Computer Science 2024-01-26 Yumnah Hasan , Allan de Lima , Fatemeh Amerehi , Darian Reyes Fernandez de Bulnes , Patrick Healy , Conor Ryan

Deep learning models are widely used nowadays for their reliability in performing various tasks. However, they do not typically provide the reasoning behind their decision, which is a significant drawback, particularly for more sensitive…

Computer Vision and Pattern Recognition · Computer Science 2024-12-09 Tiago Roxo , Joana C. Costa , Pedro R. M. Inácio , Hugo Proença

Instruction-based image editing models offer increased personalization opportunities in generative tasks. However, properly evaluating their results is challenging, and most of the existing metrics lag in terms of alignment with human…

Computer Vision and Pattern Recognition · Computer Science 2025-05-28 Lorenzo Baraldi , Davide Bucciarelli , Federico Betti , Marcella Cornia , Lorenzo Baraldi , Nicu Sebe , Rita Cucchiara

Ensuring transparency in machine learning decisions is critically important, especially in sensitive sectors such as healthcare, finance, and justice. Despite this, some popular explainable algorithms, such as Local Interpretable…

Machine Learning · Computer Science 2025-03-27 Shakiba Rahimiaghdam , Hande Alemdar

Many Machine Learning algorithms, such as deep neural networks, have long been criticized for being "black-boxes"-a kind of models unable to provide how it arrive at a decision without further efforts to interpret. This problem has raised…

Machine Learning · Statistics 2019-07-04 Yihuang Kang , I-Ling Cheng , Wenjui Mao , Bowen Kuo , Pei-Ju Lee

Machine learning models are exceptionally effective in capturing complex non-linear relationships of high-dimensional datasets and making accurate predictions. However, their intrinsic ``black-box'' nature makes it difficult to interpret…

Plasma Physics · Physics 2024-07-29 Tadas Pyragius , Cary Colgan , Hazel Lowe , Filip Janky , Matteo Fontana , Yichen Cai , Graham Naylor

We introduce a new model-agnostic explanation technique which explains the prediction of any classifier called CLE. CLE gives an faithful and interpretable explanation to the prediction, by approximating the model locally using an…

Machine Learning · Computer Science 2019-10-03 Zijian Zhang , Fan Yang , Haofan Wang , Xia Hu

Instruction-based image editing improves the controllability and flexibility of image manipulation via natural commands without elaborate descriptions or regional masks. However, human instructions are sometimes too brief for current…

Computer Vision and Pattern Recognition · Computer Science 2024-02-06 Tsu-Jui Fu , Wenze Hu , Xianzhi Du , William Yang Wang , Yinfei Yang , Zhe Gan

Interpretability methods aim to help users build trust in and understand the capabilities of machine learning models. However, existing approaches often rely on abstract, complex visualizations that poorly map to the task at hand or require…

Human-Computer Interaction · Computer Science 2021-07-12 Harini Suresh , Kathleen M. Lewis , John V. Guttag , Arvind Satyanarayan

In recent years, the use of sophisticated statistical models that influence decisions in domains of high societal relevance is on the rise. Although these models can often bring substantial improvements in the accuracy and efficiency of…

Machine Learning · Computer Science 2021-04-13 Alfredo Carrillo , Luis F. Cantú , Alejandro Noriega

While deep learning makes significant achievements in Artificial Intelligence (AI), the lack of transparency has limited its broad application in various vertical domains. Explainability is not only a gateway between AI and real world, but…

Machine Learning · Computer Science 2020-04-28 Sheng Shi , Yangzhou Du , Wei Fan

Image Manipulation Localization (IML) aims to identify edited regions in an image. However, with the increasing use of modern image editing and generative models, many manipulations no longer exhibit obvious low-level artifacts. Instead,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Zhenshan Tan , Chenhan Lu , Yuxiang Huang , Ziwen He , Xiang Zhang , Yuzhe Sha , Xianyi Chen , Tianrun Chen , Zhangjie Fu

Fine-grained facial expression editing has long been limited by intrinsic semantic overlap. To address this, we construct the Flex Facial Expression (FFE) dataset with continuous affective annotations and establish FFE-Bench to evaluate…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Jiabin Hua , Hengyuan Xu , Aojie Li , Wei Cheng , Gang Yu , Xingjun Ma , Yu-Gang Jiang

Image enhancement improves visual quality and helps reveal details that are hard to see in the original image. In medical imaging, it can support clinical decision-making, but current models often over-edit. This can distort organs, create…

Statistical learning methods are widely utilized in tackling complex problems due to their flexibility, good predictive performance and its ability to capture complex relationships among variables. Additionally, recently developed automatic…

Methodology · Statistics 2023-11-14 Natalia da Silva , Ignacio Alvarez-Castro , Leonardo Moreno , Andrés Sosa

Despite widespread adoption, machine learning models remain mostly black boxes. Understanding the reasons behind predictions is, however, quite important in assessing trust, which is fundamental if one plans to take action based on a…

Machine Learning · Computer Science 2016-08-10 Marco Tulio Ribeiro , Sameer Singh , Carlos Guestrin

Most of the work on interpretable machine learning has focused on designing either inherently interpretable models, which typically trade-off accuracy for interpretability, or post-hoc explanation systems, which lack guarantees about their…

Machine Learning · Computer Science 2019-06-05 Gregory Plumb , Maruan Al-Shedivat , Eric Xing , Ameet Talwalkar

Explainability is motivated by the lack of transparency of black-box Machine Learning approaches, which do not foster trust and acceptance of Machine Learning algorithms. This also happens in the Predictive Process Monitoring field, where…

Artificial Intelligence · Computer Science 2025-07-25 Williams Rizzi , Marco Comuzzi , Chiara Di Francescomarino , Chiara Ghidini , Suhwan Lee , Fabrizio Maria Maggi , Alexander Nolte

We propose Partially Interpretable Estimators (PIE) which attribute a prediction to individual features via an interpretable model, while a (possibly) small part of the PIE prediction is attributed to the interaction of features via a…

Machine Learning · Computer Science 2021-05-07 Tong Wang , Jingyi Yang , Yunyi Li , Boxiang Wang

In recent years, deep neural networks have been widely used for building high-performance Artificial Intelligence (AI) systems for computer vision applications. Object detection is a fundamental task in computer vision, which has been…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Milad Moradi , Ke Yan , David Colwell , Matthias Samwald , Rhona Asgari