English
Related papers

Related papers: Transferring Knowledge Distillation for Multilingu…

200 papers

Graph convolutional learning has led to many exciting discoveries in diverse areas. However, in some applications, traditional graphs are insufficient to capture the structure and intricacies of the data. In such scenarios, multigraphs…

Machine Learning · Computer Science 2023-04-26 Landon Butler , Alejandro Parada-Mayorga , Alejandro Ribeiro

Biomedical event extraction is critical in understanding biomolecular interactions described in scientific corpus. One of the main challenges is to identify nested structured events that are associated with non-indicative trigger words. We…

Computation and Language · Computer Science 2020-10-13 Kung-Hsiang Huang , Mu Yang , Nanyun Peng

Graph Neural Networks (GNNs) have gained considerable traction for their capability to effectively process topological data, yet their interpretability remains a critical concern. Current interpretation methods are dominated by post-hoc…

Machine Learning · Computer Science 2024-02-08 Jiahua Rao , Jiancong Xie , Hanjing Lin , Shuangjia Zheng , Zhen Wang , Yuedong Yang

Subgraph pattern detection aims to uncover complex interaction structures in graphs. However, state-of-the-art graph neural network (GNN)-based solutions assume centralized access to the entire graph. When graphs are instead distributed…

Machine Learning · Computer Science 2026-05-08 Selin Ceydeli , Rui Wang , Kubilay Atasu

Knowledge Distillation (KD) is a model compression algorithm that helps transfer the knowledge of a large neural network into a smaller one. Even though KD has shown promise on a wide range of Natural Language Processing (NLP) applications,…

Computation and Language · Computer Science 2021-09-21 Tianda Li , Ahmad Rashid , Aref Jafari , Pranav Sharma , Ali Ghodsi , Mehdi Rezagholizadeh

Semantic segmentation benchmarks in the realm of autonomous driving are dominated by large pre-trained transformers, yet their widespread adoption is impeded by substantial computational costs and prolonged training durations. To lift this…

Computer Vision and Pattern Recognition · Computer Science 2024-09-06 Ruiping Liu , Kailun Yang , Alina Roitberg , Jiaming Zhang , Kunyu Peng , Huayao Liu , Yaonan Wang , Rainer Stiefelhagen

Text classification is an important and classical problem in natural language processing. There have been a number of studies that applied convolutional neural networks (convolution on regular grid, e.g., sequence) to classification.…

Computation and Language · Computer Science 2018-11-14 Liang Yao , Chengsheng Mao , Yuan Luo

Text classification plays an important role in various downstream text-related tasks, such as sentiment analysis, fake news detection, and public opinion analysis. Recently, text classification based on Graph Neural Networks (GNNs) has made…

Computation and Language · Computer Science 2025-12-24 Zuo Wang , Ye Yuan

The message-passing mechanism helps Graph Neural Networks (GNNs) achieve remarkable results on various node classification tasks. Nevertheless, the recursive nodes fetching and aggregation in message-passing cause inference latency when…

Machine Learning · Computer Science 2022-10-19 Jie Chen , Shouzhen Chen , Mingyuan Bai , Junbin Gao , Junping Zhang , Jian Pu

Recently, a considerable literature has grown up around the theme of Graph Convolutional Network (GCN). How to effectively leverage the rich structural information in complex graphs, such as knowledge graphs with heterogeneous types of…

Machine Learning · Computer Science 2021-04-26 Donghan Yu , Yiming Yang , Ruohong Zhang , Yuexin Wu

Recent approaches of computer vision utilize deep learning methods as they perform quite well if training and testing domains follow the same underlying data distribution. However, it has been shown that minor variations in the images that…

Computer Vision and Pattern Recognition · Computer Science 2022-01-31 Sebastian Monka , Lavdim Halilaj , Achim Rettinger

Event analysis from news and social networks is very useful for a wide range of social studies and real-world applications. Recently, event graphs have been explored to model event datasets and their complex relationships, where events are…

Machine Learning · Computer Science 2022-01-04 Joao Pedro Rodrigues Mattos , Ricardo M. Marcacini

Word embedding, which refers to low-dimensional dense vector representations of natural words, has demonstrated its power in many natural language processing tasks. However, it may suffer from the inaccurate and incomplete information…

Computation and Language · Computer Science 2015-06-16 Fei Tian , Bin Gao , Enhong Chen , Tie-Yan Liu

Despite plentiful successes achieved by graph representation learning in various domains, the training of graph neural networks (GNNs) still remains tenaciously challenging due to the tremendous computational overhead needed for sizable…

Machine Learning · Computer Science 2025-05-28 Yurui Lai , Taiyan Zhang , Renchi Yang

Currently, most speaker recognition backends, such as cosine, linear discriminant analysis (LDA), or probabilistic linear discriminant analysis (PLDA), make decisions by calculating similarity or distance between enrollment and test…

Audio and Speech Processing · Electrical Eng. & Systems 2023-08-21 Liang He , Ruida Li , Mengqi Niu

Although deep neural networks have shown well-performance in various tasks, the poor interpretability of the models is always criticized. In the paper, we propose a new interpretable neural network method, by embedding neurons into the…

Machine Learning · Computer Science 2022-11-16 Wei Han , Yangqiming Wang , Christian Böhm , Junming Shao

Convolutional neural networks (CNNs) are extensively beneficial for medical image processing. Medical images are plentiful, but there is a lack of annotated data. Transfer learning is used to solve the problem of lack of labeled data and…

Computer Vision and Pattern Recognition · Computer Science 2020-02-11 Sajjad Abbasi , Mohsen Hajabdollahi , Nader Karimi , Shadrokh Samavi , Shahram Shirani

We present a family of neural-network--inspired models for computing continuous word representations, specifically designed to exploit both monolingual and multilingual text. This framework allows us to perform unsupervised training of…

Computation and Language · Computer Science 2016-12-15 Radu Soricut , Nan Ding

Traditional Graph Neural Network (GNN) approaches for fake news detection (FND) often depend on auxiliary, non-textual data such as user interaction histories or content dissemination patterns. However, these data sources are not always…

Machine Learning · Computer Science 2025-02-27 Anantram Patel , Vijay Kumar Sutrakar

Temporal knowledge graphs (TKGs) support reasoning over time-evolving facts, yet state-of-the-art models are often computationally heavy and costly to deploy. Existing compression and distillation techniques are largely designed for static…

Computation and Language · Computer Science 2026-02-17 Wang Xing , Wei Song , Siyu Lin , Chen Wu , Man Wang