English
Related papers

Related papers: A Survey on Actionable Knowledge

200 papers

Automated driving is one of the most active research areas in computer science. Deep learning methods have made remarkable breakthroughs in machine learning in general and in automated driving (AD)in particular. However, there are still…

Robotics · Computer Science 2022-10-18 Juergen Luettin , Sebastian Monka , Cory Henson , Lavdim Halilaj

Deep neural networks have achieved remarkable performance for artificial intelligence tasks. The success behind intelligent systems often relies on large-scale models with high computational complexity and storage costs. The…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Chuanguang Yang , Xinqiang Yu , Zhulin An , Yongjun Xu

Knowledge distillation(KD) aims to improve the performance of a student network by mimicing the knowledge from a powerful teacher network. Existing methods focus on studying what knowledge should be transferred and treat all samples equally…

Computer Vision and Pattern Recognition · Computer Science 2020-08-05 Youcai Zhang , Zhonghao Lan , Yuchen Dai , Fangao Zeng , Yan Bai , Jie Chang , Yichen Wei

Knowledge distillation (KD) is the de facto standard for compressing large-scale models into smaller ones. Prior works have explored ever more complex KD strategies involving different objective functions, teacher-ensembles, and weight…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Vishaal Udandarao , Nikhil Parthasarathy , Muhammad Ferjad Naeem , Talfan Evans , Samuel Albanie , Federico Tombari , Yongqin Xian , Alessio Tonioni , Olivier J. Hénaff

Collaborative learning has emerged as a key paradigm in large-scale intelligent systems, enabling distributed agents to cooperatively train their models while addressing their privacy concerns. Central to this paradigm is knowledge…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-12-24 Pengchao Han , Xi Huang , Yi Fang , Guojun Han

With the ever-growing complexity of models in the field of remote sensing (RS), there is an increasing demand for solutions that balance model accuracy with computational efficiency. Knowledge distillation (KD) has emerged as a powerful…

Computer Vision and Pattern Recognition · Computer Science 2024-09-19 Yassine Himeur , Nour Aburaed , Omar Elharrouss , Iraklis Varlamis , Shadi Atalla , Wathiq Mansoor , Hussain Al Ahmad

We define knowledge as facts, information, and skills acquired by a person through experience or education. In turn, Disciplinary Knowledge is the knowledge related to a specific field or discipline, such as physics. Accountable…

Physics Education · Physics 2016-05-27 Eleanor C Sayre , Claudia Fracchiolla , Ben Van Dusen

Extracting key information from documents represents a large portion of business workloads and therefore offers a high potential for efficiency improvements and process automation. With recent advances in Deep Learning, a plethora of Deep…

Information Retrieval · Computer Science 2025-07-21 Alexander Michael Rombach , Peter Fettke

Knowledge-augmented learning enables the combination of knowledge-based and data-driven approaches. For anomaly detection and diagnosis, understandability is typically an important factor, especially in high-risk areas. Therefore,…

Machine Learning · Computer Science 2024-12-03 Martin Atzmueller , Tim Bohne , Patricia Windler

In recent years, AI models that mine intrinsic patterns from molecular structures and protein sequences have shown promise in accelerating drug discovery. However, these methods partly lag behind real-world pharmaceutical approaches of…

Machine Learning · Computer Science 2023-10-17 Yizhen Luo , Xing Yi Liu , Kai Yang , Kui Huang , Massimo Hong , Jiahuan Zhang , Yushuai Wu , Zaiqing Nie

With the long term accumulation of high quality educational data, artificial intelligence has shown excellent performance in knowledge tracing. However, due to the lack of interpretability and transparency of some algorithms, this approach…

Computation and Language · Computer Science 2024-03-13 Yanhong Bai , Jiabao Zhao , Tingjiang Wei , Qing Cai , Liang He

Action research provides the opportunity to explore the usefulness and usability of software engineering methods in industrial settings, and makes it possible to develop methods, tools and techniques with software engineering practitioners.…

Software Engineering · Computer Science 2025-11-14 Yvonne Dittrich , Johan Bolmsten , Catherine Seidelin

Knowledge Distillation (KD) is a model compression algorithm that helps transfer the knowledge of a large neural network into a smaller one. Even though KD has shown promise on a wide range of Natural Language Processing (NLP) applications,…

Computation and Language · Computer Science 2021-09-21 Tianda Li , Ahmad Rashid , Aref Jafari , Pranav Sharma , Ali Ghodsi , Mehdi Rezagholizadeh

The increasing digitalization of the manufacturing domain requires adequate knowledge modeling to capture relevant information. Ontologies and Knowledge Graphs provide means to model and relate a wide range of concepts, problems, and…

Artificial Intelligence · Computer Science 2021-07-07 Jože M. Rožanec , Inna Novalija , d Patrik Zajec , Klemen Kenda , Dunja Mladenić

Knowledge Distillation (KD) is a strategy for the definition of a set of transferability gangways to improve the efficiency of Convolutional Neural Networks. Feature-based Knowledge Distillation is a subfield of KD that relies on…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Alejandro López-Cifuentes , Marcos Escudero-Viñolo , Jesús Bescós , Juan C. SanMiguel

The rapid expansion of data from diverse sources has made anomaly detection (AD) increasingly essential for identifying unexpected observations that may signal system failures, security breaches, or fraud. As datasets become more complex…

Machine Learning · Computer Science 2025-03-18 Haoqi Huang , Ping Wang , Jianhua Pei , Jiacheng Wang , Shahen Alexanian , Dusit Niyato

Modern online education has the capacity to provide intelligent educational services by automatically analyzing substantial amounts of student behavioral data. Knowledge Tracing (KT) is one of the fundamental tasks for student behavioral…

Computers and Society · Computer Science 2024-07-16 Shuanghong Shen , Qi Liu , Zhenya Huang , Yonghe Zheng , Minghao Yin , Minjuan Wang , Enhong Chen

Knowledge distillation (KD), a technique widely employed in computer vision, has emerged as a de facto standard for improving the performance of small neural networks. However, prevailing KD-based approaches in video tasks primarily focus…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Guiqin Wang , Peng Zhao , Yanjiang Shi , Cong Zhao , Shusen Yang

In this paper, we study a sequential decision-making problem, called Adaptive Sampling for Discovery (ASD). Starting with a large unlabeled dataset, algorithms for ASD adaptively label the points with the goal to maximize the sum of…

Machine Learning · Statistics 2023-01-04 Ziping Xu , Eunjae Shim , Ambuj Tewari , Paul Zimmerman