English
Related papers

Related papers: HEIE: MLLM-Based Hierarchical Explainable AIGC Ima…

200 papers

As large language models (LLMs) are increasingly deployed in sensitive domains such as healthcare, law, and education, the demand for transparent, interpretable, and accountable AI systems becomes more urgent. Explainable AI (XAI) acts as a…

Computers and Society · Computer Science 2025-05-28 Francisco Herrera

The surge in developing deep learning models for diagnosing skin lesions through image analysis is notable, yet their clinical black faces challenges. Current dermatology AI models have limitations: limited number of possible diagnostic…

Computer Vision and Pattern Recognition · Computer Science 2023-11-03 Deval Mehta , Brigid Betz-Stablein , Toan D Nguyen , Yaniv Gal , Adrian Bowling , Martin Haskett , Maithili Sashindranath , Paul Bonnington , Victoria Mar , H Peter Soyer , Zongyuan Ge

Aesthetic Image Captioning (AIC) aims to generate textual descriptions of image aesthetics, becoming a key research direction in the field of computational aesthetics. In recent years, pretrained Multimodal Large Language Models (MLLMs)…

Computer Vision and Pattern Recognition · Computer Science 2025-09-10 Yilin Tao , Jiashui Huang , Huaze Xu , Ling Shao

This paper quantifies the quality of heatmap-based eXplainable AI (XAI) methods w.r.t image classification problem. Here, a heatmap is considered desirable if it improves the probability of predicting the correct classes. Different XAI…

Machine Learning · Computer Science 2023-01-24 Erico Tjoa , Hong Jing Khok , Tushar Chouhan , Guan Cuntai

Robust detection of AI-generated images in the wild remains challenging due to the rapid evolution of generative models and varied real-world distortions. We argue that relying on a single training regime, resolution, or backbone is…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Fei Wu , Dagong Lu , Mufeng Yao , Xinlei Xu , Fengjun Guo

Despite outstanding contribution to the significant progress of Artificial Intelligence (AI), deep learning models remain mostly black boxes, which are extremely weak in explainability of the reasoning process and prediction results.…

Machine Learning · Computer Science 2020-02-11 Sheng Shi , Xinfeng Zhang , Wei Fan

Local Interpretable Model-Agnostic Explanations (LIME) is a popular technique used to increase the interpretability and explainability of black box Machine Learning (ML) algorithms. LIME typically generates an explanation for a single…

Machine Learning · Computer Science 2019-06-26 Muhammad Rehman Zafar , Naimul Mefraz Khan

Heatmaps are widely used to interpret deep neural networks, particularly for computer vision tasks, and the heatmap-based explainable AI (XAI) techniques are a well-researched topic. However, most studies concentrate on enhancing the…

Computer Vision and Pattern Recognition · Computer Science 2023-04-06 Osman Tursun , Simon Denman , Sridha Sridharan , Clinton Fookes

Evaluating AI-generated medical image segmentations for clinical acceptability poses a significant challenge, as traditional pixelagreement metrics often fail to capture true diagnostic utility. This paper introduces Hierarchical Clinical…

Image and Video Processing · Electrical Eng. & Systems 2025-06-03 Jiaxi Sheng , Leyi Yu , Haoyue Li , Yifan Gao , Xin Gao

Hydrocarbon prospect risking is a critical application in geophysics predicting well outcomes from a variety of data including geological, geophysical, and other information modalities. Traditional routines require interpreters to go…

Machine Learning · Computer Science 2022-12-16 Ahmad Mustafa , Ghassan AlRegib

Human-Object Interaction (HOI) detection is a challenging computer vision task that requires visual models to address the complex interactive relationship between humans and objects and predict HOI triplets. Despite the challenges posed by…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Yichao Cao , Qingfei Tang , Feng Yang , Xiu Su , Shan You , Xiaobo Lu , Chang Xu

The ability for a human to understand an Artificial Intelligence (AI) model's decision-making process is critical in enabling stakeholders to visualize model behavior, perform model debugging, promote trust in AI models, and assist in…

Machine Learning · Computer Science 2022-03-07 Yiwei Lyu , Paul Pu Liang , Zihao Deng , Ruslan Salakhutdinov , Louis-Philippe Morency

While mechanistic interpretability has developed powerful tools to analyze the internal workings of Large Language Models (LLMs), their complexity has created an accessibility gap, limiting their use to specialists. We address this…

Computation and Language · Computer Science 2026-02-23 Aaron Louis Eidt , Nils Feldhus

This work investigates a challenging task named open-domain interleaved image-text generation, which generates interleaved texts and images following an input query. We propose a new interleaved generation framework based on prompting…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Jie An , Zhengyuan Yang , Linjie Li , Jianfeng Wang , Kevin Lin , Zicheng Liu , Lijuan Wang , Jiebo Luo

Image explanation has been one of the key research interests in the Deep Learning field. Throughout the years, several approaches have been adopted to explain an input image fed by the user. From detecting an object in a given image to…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Debjyoti Das Adhikary , Aritra Hazra , Partha Pratim Chakrabarti

Machine learning and especially deep learning have garneredtremendous popularity in recent years due to their increased performanceover other methods. The availability of large amount of data has aidedin the progress of deep learning.…

Machine Learning · Computer Science 2019-09-06 Sharath M. Shankaranarayana , Davor Runje

Hierarchical multi-label classification (HMLC) is essential for modeling complex label dependencies in remote sensing. Existing methods, however, struggle with multi-path hierarchies where instances belong to multiple branches, and they…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Marjan Stoimchev , Boshko Koloski , Jurica Levatić , Dragi Kocev , Sašo Džeroski

Hallucinations in multimodal large language models (MLLMs) -- where the model generates content inconsistent with the input image -- pose significant risks in real-world applications, from misinformation in visual question answering to…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Bingkui Tong , Jiaer Xia , Sifeng Shang , Kaiyang Zhou

Artificial intelligence (AI) has rapidly developed through advancements in computational power and the growth of massive datasets. However, this progress has also heightened challenges in interpreting the "black-box" nature of AI models. To…

Computer Vision and Pattern Recognition · Computer Science 2024-12-19 Shilin Sun , Wenbin An , Feng Tian , Fang Nan , Qidong Liu , Jun Liu , Nazaraf Shah , Ping Chen

Machine learning (ML) is crucial in network anomaly detection for proactive threat hunting, reducing detection and response times significantly. However, challenges in model training, maintenance, and frequent false positives impact its…

Cryptography and Security · Computer Science 2023-09-29 Tarek Ali , Panos Kostakos