English
Related papers

Related papers: Toward Understanding Deep Learning Framework Bugs

200 papers

Deep learning (DL) techniques have achieved significant success in various software engineering tasks (e.g., code completion by Copilot). However, DL systems are prone to bugs from many sources, including training data. Existing literature…

Software Engineering · Computer Science 2025-08-12 Mehil B Shah , Mohammad Masudur Rahman , Foutse Khomh

As Deep Learning (DL) systems are widely deployed for mission-critical applications, debugging such systems becomes essential. Most existing works identify and repair suspicious neurons on the trained Deep Neural Network (DNN), which,…

Software Engineering · Computer Science 2022-05-05 Jialun Cao , Meiziniu Li , Xiao Chen , Ming Wen , Yongqiang Tian , Bo Wu , Shing-Chi Cheung

Deep Learning (DL) libraries such as PyTorch provide the core components to build major AI-enabled applications. Finding bugs in these libraries is important and challenging. Prior approaches have tackled this by performing either API-level…

Software Engineering · Computer Science 2025-09-19 Feiran Qin , M. M. Abid Naziri , Hengyu Ai , Saikat Dutta , Marcelo d'Amorim

Deep Learning (DL) library bugs affect downstream DL applications, emphasizing the need for reliable systems. Generating valid input programs for fuzzing DL libraries is challenging due to the need for satisfying both language…

Software Engineering · Computer Science 2023-04-05 Yinlin Deng , Chunqiu Steven Xia , Chenyuan Yang , Shizhuo Dylan Zhang , Shujing Yang , Lingming Zhang

Deep Learning (DL) is a class of machine learning algorithms that are used in a wide variety of applications. Like any software system, DL programs can have bugs. To support bug localization in DL programs, several tools have been proposed…

Software Engineering · Computer Science 2024-12-10 Ruchira Manke , Mohammad Wardat , Foutse Khomh , Hridesh Rajan

Deep learning (DL) has been a common thread across several recent techniques for vulnerability detection. The rise of large, publicly available datasets of vulnerabilities has fueled the learning process underpinning these techniques. While…

Software Engineering · Computer Science 2025-01-27 Adriana Sejfia , Satyaki Das , Saad Shafiq , Nenad Medvidović

Deep neural networks (DNNs) are becoming an integral part of most software systems. Previous work has shown that DNNs have bugs. Unfortunately, existing debugging techniques do not support localizing DNN bugs because of the lack of…

Software Engineering · Computer Science 2021-03-08 Mohammad Wardat , Wei Le , Hridesh Rajan

Large language model-specific inference engines (in short as \emph{LLM inference engines}) have become a fundamental component of modern AI infrastructure, enabling the deployment of LLM-powered applications (LLM apps) across cloud and…

Software Engineering · Computer Science 2026-01-12 Mugeng Liu , Siqi Zhong , Weichen Bi , Yixuan Zhang , Zhiyang Chen , Zhenpeng Chen , Xuanzhe Liu , Yun Ma

Deep learning (DL) has attracted wide attention and has been widely deployed in recent years. As a result, more and more research efforts have been dedicated to testing DL libraries and frameworks. However, existing work largely overlooked…

Software Engineering · Computer Science 2024-01-02 Chenyuan Yang , Yinlin Deng , Jiayi Yao , Yuxing Tu , Hanchi Li , Lingming Zhang

Quantum computing has emerged as a promising domain for the machine learning (ML) area, offering significant computational advantages over classical counterparts. With the growing interest in quantum machine learning (QML), ensuring the…

Software Engineering · Computer Science 2023-06-23 Pengzhan Zhao , Xiongfei Wu , Junjie Luo , Zhuo Li , Jianjun Zhao

Deep learning (DL) defines a new data-driven programming paradigm that constructs the internal system logic of a crafted neuron network through a set of training data. We have seen wide adoption of DL in many safety-critical scenarios.…

Software Engineering · Computer Science 2018-08-16 Lei Ma , Felix Juefei-Xu , Fuyuan Zhang , Jiyuan Sun , Minhui Xue , Bo Li , Chunyang Chen , Ting Su , Li Li , Yang Liu , Jianjun Zhao , Yadong Wang

Tile-based programming frameworks are increasingly adopted to write high-performance GPU kernels in domains such as deep learning and scientific computing. While these frameworks enhance productivity and hardware utilization, their…

Software Engineering · Computer Science 2026-05-20 Ravishka Rathnasuriya , Zihe Song , Nidhi Majoju , Aaryaa Moharir , Tingxi Li , Wei Yang , Tao Xie

Deep Neural Networks (DNNs) are used in a wide variety of applications. However, as in any software application, DNN-based apps are afflicted with bugs. Previous work observed that DNN bug fix patterns are different from traditional bug fix…

Software Engineering · Computer Science 2021-12-09 Mohammad Wardat , Breno Dantas Cruz , Wei Le , Hridesh Rajan

Deep Learning (DL) has been widely adopted in diverse industrial domains, including autonomous driving, intelligent healthcare, and aided programming. Like traditional software, DL systems are also prone to faults, whose malfunctioning may…

Machine Learning · Computer Science 2026-01-01 Hanmo You , Zan Wang , Zishuo Dong , Luanqi Mo , Jianjun Zhao , Junjie Chen

Deep neural networks (DNNs) are susceptible to bugs, just like other types of software systems. A significant uptick in using DNN, and its applications in wide-ranging areas, including safety-critical systems, warrant extensive research on…

Software Engineering · Computer Science 2023-09-12 Ali Ghanbari , Deepak-George Thomas , Muhammad Arbab Arshad , Hridesh Rajan

Differential testing offers a promising strategy to alleviate the test oracle problem by comparing the test results between alternative implementations. However, existing differential testing techniques for deep learning (DL) libraries are…

Software Engineering · Computer Science 2025-05-09 Meiziniu Li , Dongze Li , Jianmeng Liu , Jialun Cao , Yongqiang Tian , Shing-Chi Cheung

Large Language Models (LLMs) have demonstrated exceptional coding capability. However, as another critical component of programming proficiency, the debugging capability of LLMs remains relatively unexplored. Previous evaluations of LLMs'…

Software Engineering · Computer Science 2024-06-07 Runchu Tian , Yining Ye , Yujia Qin , Xin Cong , Yankai Lin , Yinxu Pan , Yesai Wu , Haotian Hui , Weichuan Liu , Zhiyuan Liu , Maosong Sun

Deep reinforcement learning (DRL) has shown success in diverse domains such as robotics, computer games, and recommendation systems. However, like any other software system, DRL-based software systems are susceptible to faults that pose…

Software Engineering · Computer Science 2024-10-08 Rached Bouchoucha , Ahmed Haj Yahmed , Darshan Patil , Janarthanan Rajendran , Amin Nikanjam , Sarath Chandar , Foutse Khomh

The widespread application of large language models (LLMs) underscores the importance of deep learning (DL) technologies that rely on foundational DL libraries such as PyTorch and TensorFlow. Despite their robust features, these libraries…

Software Engineering · Computer Science 2024-12-12 Zhiyuan Li , Jingzheng Wu , Xiang Ling , Tianyue Luo , Zhiqing Rui , Yanjun Wu

Over the past decade, Deep Learning (DL) has become an integral part of our daily lives. This surge in DL usage has heightened the need for developing reliable DL software systems. Given that fault localization is a critical task in…

Software Engineering · Computer Science 2024-11-14 Mohammad Mehdi Morovati , Amin Nikanjam , Foutse Khomh