English
Related papers

Related papers: Finding Experts in Transformer Models

200 papers

Providing explanations along with predictions is crucial in some text processing tasks. Therefore, we propose a new self-interpretable model that performs output prediction and simultaneously provides an explanation in terms of the presence…

Machine Learning · Computer Science 2019-09-30 Diane Bouchacourt , Ludovic Denoyer

Transformers, the backbone of modern large language models (LLMs), face inherent architectural limitations that impede their reasoning capabilities. Unlike recurrent networks, Transformers lack recurrent connections, confining them to…

Computation and Language · Computer Science 2024-10-30 Xiang Zhang , Juntai Cao , Chenyu You

Language models (LMs) are being scaled and becoming powerful. Improving their efficiency is one of the core research topics in neural information processing systems. Tay et al. (2022) provided a comprehensive overview of efficient…

Machine Learning · Computer Science 2023-06-06 Meng Jiang , Hy Dang , Lingbo Tong

Sparse mixture of experts provides larger model capacity while requiring a constant computational overhead. It employs the routing mechanism to distribute input tokens to the best-matched experts according to their hidden representations.…

Computation and Language · Computer Science 2022-10-13 Zewen Chi , Li Dong , Shaohan Huang , Damai Dai , Shuming Ma , Barun Patra , Saksham Singhal , Payal Bajaj , Xia Song , Xian-Ling Mao , Heyan Huang , Furu Wei

We conduct the convergence analysis of parameter estimation in the contaminated mixture of experts. This model is motivated from the prompt learning problem where ones utilize prompts, which can be formulated as experts, to fine-tune a…

Machine Learning · Computer Science 2025-03-07 Fanqi Yan , Huy Nguyen , Dung Le , Pedram Akbarian , Nhat Ho

Network binarization is a promising hardware-aware direction for creating efficient deep models. Despite its memory and computational advantages, reducing the accuracy gap between binary models and their real-valued counterparts remains an…

Computer Vision and Pattern Recognition · Computer Science 2021-04-01 Adrian Bulat , Brais Martinez , Georgios Tzimiropoulos

Mixtures of Experts combine the outputs of several "expert" networks, each of which specializes in a different part of the input space. This is achieved by training a "gating" network that maps each input to a distribution over the experts.…

Machine Learning · Computer Science 2014-03-11 David Eigen , Marc'Aurelio Ranzato , Ilya Sutskever

This paper presents an evolutionary framework for the training of large language models(LLM). The models are divided into several experts(sub-networks), which have the same structure but different parameter values. Only one expert is…

Machine Learning · Computer Science 2025-09-30 Yingshi Chen

Topic models aim to reveal latent structures within a corpus of text, typically through the use of term-frequency statistics over bag-of-words representations from documents. In recent years, conceptual entities -- interpretable,…

Computation and Language · Computer Science 2024-08-27 Manuel V. Loureiro , Steven Derby , Tri Kurniawan Wijaya

CNNs have made an undeniable impact on computer vision through the ability to learn high-capacity models with large annotated training sets. One of their remarkable properties is the ability to transfer knowledge from a large source dataset…

Computer Vision and Pattern Recognition · Computer Science 2019-07-19 Yu-Xiong Wang , Deva Ramanan , Martial Hebert

Concepts play a pivotal role in various human cognitive functions, including learning, reasoning and communication. However, there is very little work on endowing machines with the ability to form and reason with concepts. In particular,…

Computation and Language · Computer Science 2023-11-06 Chen Shani , Jilles Vreeken , Dafna Shahaf

Neural machine translation (NMT) has significantly improved the quality of automatic translation models. One of the main challenges in current systems is the translation of rare words. We present a generic approach to address this weakness…

Computation and Language · Computer Science 2018-09-11 Ngoc-Quan Pham , Jan Niehues , Alex Waibel

Token-choice Mixture-of-Experts (TC-MoE) routes each token to a fixed number of experts, limiting dynamic computation allocation and requiring auxiliary losses to maintain load balance. We propose Expert Threshold (ET) routing, where each…

Artificial Intelligence · Computer Science 2026-03-13 Hanchi Sun , Yixin Liu , Yonghui Wu , Lichao Sun

The exponential growth of volume, variety and velocity of data is raising the need for investigations of automated or semi-automated ways to extract useful patterns from the data. It requires deep expert knowledge and extensive…

Machine Learning · Computer Science 2020-07-22 Abbas Raza Ali , Marcin Budka , Bogdan Gabrys

Computers are quickly gaining on us. Artificial systems are now exceeding the performance of human experts in several domains. However, we do not yet have a deep definition of expertise. This paper examines the nature of expertise and…

Artificial Intelligence · Computer Science 2022-12-21 Ron Fulbright

Transformer-based Neural Language Models achieve state-of-the-art performance on various natural language processing tasks. However, an open question is the extent to which these models rely on word-order/syntactic or word…

Computation and Language · Computer Science 2024-03-05 Vasudevan Nedumpozhimana , John D. Kelleher

Optimization in multi-task learning (MTL) is more challenging than single-task learning (STL), as the gradient from different tasks can be contradictory. When tasks are related, it can be beneficial to share some parameters among them…

Computer Vision and Pattern Recognition · Computer Science 2022-12-16 Zitian Chen , Yikang Shen , Mingyu Ding , Zhenfang Chen , Hengshuang Zhao , Erik Learned-Miller , Chuang Gan

Recent advances in general purpose pre-trained language models have shown great potential in commonsense reasoning. However, current works still perform poorly on standard commonsense reasoning benchmarks including the Com2Sense Dataset. We…

Computation and Language · Computer Science 2023-10-11 Yu Zhou , Yunqiu Han , Hanyu Zhou , Yulun Wu

Enriching existing medical terminology knowledge bases (KBs) is an important and never-ending work for clinical research because new terminology alias may be continually added and standard terminologies may be newly renamed. In this paper,…

Computation and Language · Computer Science 2019-09-04 Jiaying Zhang , Zhixing Zhang , Huanhuan Zhang , Zhiyuan Ma , Yangming Zhou , Ping He

Recent advances in interpretability suggest we can project weights and hidden states of transformer-based language models (LMs) to their vocabulary, a transformation that makes them more human interpretable. In this paper, we investigate LM…

Computation and Language · Computer Science 2023-11-27 Shahar Katz , Yonatan Belinkov