Solution of DeBERTaV3 on CommonsenseQA
Computation and Language
2022-06-22 v2
Abstract
We report the performance of DeBERTaV3 on CommonsenseQA in this report. We simply formalize the answer selection as a text classification for DeBERTaV3. The strong natural language inference ability of DeBERTaV3 helps its single and ensemble model set the new (w/o external knowledge) state-of-the-art on CommonsenseQA.
Cite
@article{arxiv.2206.05033,
title = {Solution of DeBERTaV3 on CommonsenseQA},
author = {Letian Peng and Zuchao Li and Hai Zhao},
journal= {arXiv preprint arXiv:2206.05033},
year = {2022}
}
Related papers
View all related →
Computation and Language · Computer Science
Benchmarking Knowledge-Enhanced Commonsense Question Answering via Knowledge-to-Text Transformation
Ning Bian, Xianpei Han, Bo Chen, Le Sun
2021-01-06
Computation and Language · Computer Science
CommonsenseQA: A Question Answering Challenge Targeting Commonsense Knowledge
Alon Talmor, Jonathan Herzig, Nicholas Lourie, Jonathan Berant
2019-03-19
Computation and Language · Computer Science
QiaoNing at SemEval-2020 Task 4: Commonsense Validation and Explanation system based on ensemble of language model
Pai Liu
2020-09-08
Computation and Language · Computer Science
elBERto: Self-supervised Commonsense Learning for Question Answering
Xunlin Zhan, Yuan Li, Xiao Dong, Xiaodan Liang +2
2022-10-05
Computation and Language · Computer Science
SheffieldVeraAI at SemEval-2023 Task 3: Mono and multilingual approaches for news genre, topic and persuasion technique classification
Ben Wu, Olesya Razuvayevskaya, Freddy Heppell, João A. Leite +3
2023-11-10
Computation and Language · Computer Science
KInITVeraAI at SemEval-2023 Task 3: Simple yet Powerful Multilingual Fine-Tuning for Persuasion Techniques Detection
Timo Hromadka, Timotej Smolen, Tomas Remis, Branislav Pecher +1
2024-06-11
Computation and Language · Computer Science
Improving Commonsense Question Answering by Graph-based Iterative Retrieval over Multiple Knowledge Sources
Qianglong Chen, Feng Ji, Haiqing Chen, Yin Zhang
2020-11-06
Computer Vision and Pattern Recognition · Computer Science
EKTVQA: Generalized use of External Knowledge to empower Scene Text in Text-VQA
Arka Ujjal Dey, Ernest Valveny, Gaurav Harit
2022-07-18
Computation and Language · Computer Science
Commonsense Knowledge Mining from Term Definitions
Zhicheng Liang, Deborah L. McGuinness
2021-02-02
Computation and Language · Computer Science
Ensemble Transfer Learning for Multilingual Coreference Resolution
Tuan Manh Lai, Heng Ji
2023-01-24
Computation and Language · Computer Science
Binary Token-Level Classification with DeBERTa for All-Type MWE Identification: A Lightweight Approach with Linguistic Enhancement
Diego Rossini, Lonneke van der Plas
2026-01-28
Computation and Language · Computer Science
Autoencoding Language Model Based Ensemble Learning for Commonsense Validation and Explanation
Ngo Quang Huy, Tu Minh Phuong, Ngo Xuan Bach
2022-04-08
Computation and Language · Computer Science
A Novel DeBERTa-based Model for Financial Question Answering Task
Yanbo J. Wang, Yuming Li, Hui Qin, Yuhang Guan +1
2022-07-14
Computer Vision and Pattern Recognition · Computer Science
Enhancing Scientific Visual Question Answering through Multimodal Reasoning and Ensemble Modeling
Prahitha Movva, Naga Harshita Marupaka
2025-07-09
Computation and Language · Computer Science
Data-Efficient French Language Modeling with CamemBERTa
Wissam Antoun, Benoît Sagot, Djamé Seddah
2023-06-05
Computation and Language · Computer Science
IXA/Cogcomp at SemEval-2023 Task 2: Context-enriched Multilingual Named Entity Recognition using Knowledge Bases
Iker García-Ferrero, Jon Ander Campos, Oscar Sainz, Ander Salaberria +1
2023-05-01
Computation and Language · Computer Science
Team QUST at SemEval-2023 Task 3: A Comprehensive Study of Monolingual and Multilingual Approaches for Detecting Online News Genre, Framing and Persuasion Techniques
Ye Jiang
2024-09-24
Computation and Language · Computer Science
Contextualized Representations Using Textual Encyclopedic Knowledge
Mandar Joshi, Kenton Lee, Yi Luan, Kristina Toutanova
2021-07-14
Computation and Language · Computer Science
Jaeger: A Concatenation-Based Multi-Transformer VQA Model
Jieting Long, Zewei Shi, Penghao Jiang, Yidong Gan
2023-10-20
Computation and Language · Computer Science
Gendered Pronoun Resolution using BERT and an extractive question answering formulation
Rakesh Chada
2019-06-11
Computation and Language · Computer Science
Social Commonsense Reasoning with Multi-Head Knowledge Attention
Debjit Paul, Anette Frank
2020-10-13
Computation and Language · Computer Science
SemEval-2015 Task 3: Answer Selection in Community Question Answering
Preslav Nakov, Lluís Màrquez, Walid Magdy, Alessandro Moschitti +2
2019-11-27
Artificial Intelligence · Computer Science
A Clarifying Question Selection System from NTES_ALONG in Convai3 Challenge
Wenjie Ou, Yue Lin
2020-11-23
Computation and Language · Computer Science
CS-NLP team at SemEval-2020 Task 4: Evaluation of State-of-the-art NLP Deep Learning Architectures on Commonsense Reasoning Task
Sirwe Saeedi, Aliakbar Panahi, Seyran Saeedi, Alvis C Fong
2020-07-21
Computation and Language · Computer Science
Commonsense for Generative Multi-Hop Question Answering Tasks
Lisa Bauer, Yicheng Wang, Mohit Bansal
2019-06-04