English
Related papers

Related papers: Knowledge Amalgamation from Heterogeneous Networks…

200 papers

Imitation learning has emerged as a powerful paradigm in robot manipulation, yet its generalization capability remains constrained by object-specific dependencies in limited expert demonstrations. To address this challenge, we propose…

Robotics · Computer Science 2025-06-27 Zhuochen Miao , Jun Lv , Hongjie Fang , Yang Jin , Cewu Lu

Model merging has emerged as a lightweight alternative to joint multi-task learning (MTL), yet the generalization properties of merged models remain largely unexplored. Establishing such theoretical guarantees is non-trivial, as the merging…

Machine Learning · Computer Science 2025-12-25 Seyed Arshan Dalili , Mehrdad Mahdavi

A generative model based on training deep architectures is proposed. The model consists of K networks that are trained together to learn the underlying distribution of a given data set. The process starts with dividing the input data into K…

Machine Learning · Computer Science 2017-02-14 Ershad Banijamali , Ali Ghodsi , Pascal Poupart

Class-incremental continual learning is a core step towards developing artificial intelligence systems that can continuously adapt to changes in the environment by learning new concepts without forgetting those previously learned. This is…

Machine Learning · Computer Science 2023-07-07 Evelyn Chee , Mong Li Lee , Wynne Hsu

Modern data analysis pipelines are becoming increasingly complex due to the presence of multi-view information sources. While graphs are effective in modeling complex relationships, in many scenarios a single graph is rarely sufficient to…

Machine Learning · Statistics 2019-04-02 Uday Shankar Shanthamallu , Jayaraman J. Thiagarajan , Huan Song , Andreas Spanias

When humans perform inductive learning, they often enhance the process with background knowledge. With the increasing availability of well-formed collaborative knowledge bases, the performance of learning algorithms could be significantly…

Artificial Intelligence · Computer Science 2018-02-02 Lior Friedman , Shaul Markovitch

In recent years, deep neural network is introduced in recommender systems to solve the collaborative filtering problem, which has achieved immense success on computer vision, speech recognition and natural language processing. On one hand,…

Information Retrieval · Computer Science 2020-10-14 Ge Fan , Wei Zeng , Shan Sun , Biao Geng , Weiyi Wang , Weibo Liu

Performing multiple experiments is common when learning internal mechanisms of complex systems. These experiments can include perturbations to parameters or external disturbances. A challenging problem is to efficiently incorporate all…

Systems and Control · Computer Science 2020-08-25 Zuogong Yue , Johan Thunberg , Wei Pan , Lennart Ljung , Jorge Goncalves

The rise of the phenomenon of the "right to be forgotten" has prompted research on machine unlearning, which grants data owners the right to actively withdraw data that has been used for model training, and requires the elimination of the…

Machine Learning · Computer Science 2023-08-29 Xulong Zhang , Jianzong Wang , Ning Cheng , Yifu Sun , Chuanyao Zhang , Jing Xiao

In this letter, we propose a multitask deep learning method for classification of multiple hyperspectral data in a single training. Deep learning models have achieved promising results on hyperspectral image classification, but their…

Computer Vision and Pattern Recognition · Computer Science 2020-12-30 Shengjie Liu , Qian Shi

3D morphable models are widely used for the shape representation of an object class in computer vision and graphics applications. In this work, we focus on deep 3D morphable models that directly apply deep learning on 3D mesh data with a…

Computer Vision and Pattern Recognition · Computer Science 2021-05-06 Zhixiang Chen , Tae-Kyun Kim

We address the challenging problem of deep representation learning--the efficient adaption of a pre-trained deep network to different tasks. Specifically, we propose to explore gradient-based features. These features are gradients of the…

Machine Learning · Computer Science 2020-04-14 Fangzhou Mu , Yingyu Liang , Yin Li

We consider deep neural networks, in which the output of each node is a quadratic function of its inputs. Similar to other deep architectures, these networks can compactly represent any function on a finite training set. The main goal of…

Machine Learning · Computer Science 2014-02-21 Roi Livni , Shai Shalev-Shwartz , Ohad Shamir

For a very long time, unsupervised learning for anomaly detection has been at the heart of image processing research and a stepping stone for high performance industrial automation process. With the emergence of CNN, several methods have…

Computer Vision and Pattern Recognition · Computer Science 2023-06-19 Simon Thomine , Hichem Snoussi , Mahmoud Soua

With growing concerns regarding data privacy and rapid increase in data volume, Federated Learning(FL) has become an important learning paradigm. However, jointly learning a deep neural network model in a FL setting proves to be a…

Machine Learning · Computer Science 2022-07-11 Disha Makhija , Xing Han , Nhat Ho , Joydeep Ghosh

In this work, we compare the performance of six state-of-the-art deep neural networks in classification tasks when using only image features, to when these are combined with patient metadata. We utilise transfer learning from networks…

Computer Vision and Pattern Recognition · Computer Science 2022-07-20 Spencer A. Thomas

Multi-task learning leverages potential correlations among related tasks to extract common features and yield performance gains. However, most previous works only consider simple or weak interactions, thereby failing to model complex…

Computation and Language · Computer Science 2017-07-11 Honglun Zhang , Liqiang Xiao , Yongkun Wang , Yaohui Jin

Knowledge distillation refers to the process of training a compact student network to achieve better accuracy by learning from a high capacity teacher network. Most of the existing knowledge distillation methods direct the student to follow…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Himalaya Jain , Spyros Gidaris , Nikos Komodakis , Patrick Pérez , Matthieu Cord

Recently, segmentation neural networks have been significantly improved by demonstrating very promising accuracies on public benchmarks. However, these models are very heavy and generally suffer from low inference speed, which limits their…

Computer Vision and Pattern Recognition · Computer Science 2018-10-22 Jiafeng Xie , Bing Shuai , Jian-Fang Hu , Jingyang Lin , Wei-Shi Zheng

Ensuring the trustworthiness and interpretability of machine learning models is critical to their deployment in real-world applications. Feature attribution methods have gained significant attention, which provide local explanations of…

Machine Learning · Computer Science 2023-09-20 Md Abdul Kadir , Gowtham Krishna Addluri , Daniel Sonntag