English
Related papers

Related papers: Adversarial Transformer Language Models for Contex…

200 papers

We present a universal framework to model contextualized sentence representations with visual awareness that is motivated to overcome the shortcomings of the multimodal parallel data with manual annotations. For each sentence, we first…

Computation and Language · Computer Science 2019-11-12 Zhuosheng Zhang , Rui Wang , Kehai Chen , Masao Utiyama , Eiichiro Sumita , Hai Zhao

In multi-turn dialog, utterances do not always take the full form of sentences \cite{Carbonell1983DiscoursePA}, which naturally makes understanding the dialog context more difficult. However, it is essential to fully grasp the dialog…

Computation and Language · Computer Science 2020-12-15 Xiuying Chen , Zhi Cui , Jiayi Zhang , Chen Wei , Jianwei Cui , Bin Wang , Dongyan Zhao , Rui Yan

When humans read or listen, they make implicit commonsense inferences that frame their understanding of what happened and why. As a step toward AI systems that can build similar mental models, we introduce GLUCOSE, a large-scale dataset of…

Computation and Language · Computer Science 2020-11-02 Nasrin Mostafazadeh , Aditya Kalyanpur , Lori Moon , David Buchanan , Lauren Berkowitz , Or Biran , Jennifer Chu-Carroll

Commonsense reasoning refers to the ability of evaluating a social situation and acting accordingly. Identification of the implicit causes and effects of a social context is the driving capability which can enable machines to perform…

Computation and Language · Computer Science 2020-11-03 Farhad Moghimifar , Lizhen Qu , Yue Zhuo , Mahsa Baktashmotlagh , Gholamreza Haffari

Identifying the topic (domain) of each user's utterance in open-domain conversational systems is a crucial step for all subsequent language understanding and response tasks. In particular, for complex domains, an utterance is often routed…

Computation and Language · Computer Science 2020-05-29 Ali Ahmadvand , Harshita Sahijwani , Jason Ingyu Choi , Eugene Agichtein

Unlike well-structured text, such as news reports and encyclopedia articles, dialogue content often comes from two or more interlocutors, exchanging information with each other. In such a scenario, the topic of a conversation can vary upon…

Computation and Language · Computer Science 2021-09-13 Junpeng Liu , Yanyan Zou , Hainan Zhang , Hongshen Chen , Zhuoye Ding , Caixia Yuan , Xiaojie Wang

Social norms are implicit, culturally grounded expectations that guide interpersonal communication. Unlike factual commonsense, norm reasoning is subjective, context-dependent, and varies across cultures, posing challenges for computational…

Computation and Language · Computer Science 2025-11-14 Pritish Sahu , Anirudh Som , Dimitra Vergyri , Ajay Divakaran

Sarcasm detection is important for several NLP tasks such as sentiment identification in product reviews, user feedback, and online forums. It is a challenging task requiring a deep understanding of language, context, and world knowledge.…

Computation and Language · Computer Science 2021-09-20 Somnath Basu Roy Chowdhury , Snigdha Chaturvedi

This paper studies constrained text generation, which is to generate sentences under certain pre-conditions. We focus on CommonGen, the task of generating text based on a set of concepts, as a representative task of constrained text…

Computation and Language · Computer Science 2021-03-15 Yixian Liu , Liwen Zhang , Wenjuan Han , Yue Zhang , Kewei Tu

Identifying arguments is a necessary prerequisite for various tasks in automated discourse analysis, particularly within contexts such as political debates, online discussions, and scientific reasoning. In addition to theoretical advances…

Computation and Language · Computer Science 2025-05-29 Marc Feger , Katarina Boland , Stefan Dietze

The ability to combine linguistic guidance from others with direct experience is central to human development, enabling safe and rapid learning in new environments. How do people integrate these two sources of knowledge, and how might AI…

Artificial Intelligence · Computer Science 2026-02-19 Cédric Colas , Tracey Mills , Ben Prystawski , Michael Henry Tessler , Noah Goodman , Jacob Andreas , Joshua Tenenbaum

How to select relevant key objects and reason about the complex relationships cross vision and linguistic domain are two key issues in many multi-modality applications such as visual question answering (VQA). In this work, we incorporate…

Computer Vision and Pattern Recognition · Computer Science 2023-11-14 Zongzhao Li , Xiangyu Zhu , Xi Zhang , Zhaoxiang Zhang , Zhen Lei

Knowledge underpins reasoning. Recent research demonstrates that when relevant knowledge is provided as additional context to commonsense question answering (QA), it can substantially enhance the performance even on top of state-of-the-art.…

Computation and Language · Computer Science 2022-10-25 Jiacheng Liu , Skyler Hallinan , Ximing Lu , Pengfei He , Sean Welleck , Hannaneh Hajishirzi , Yejin Choi

One of the challenges faced by conversational agents is their inability to identify unstated presumptions of their users' commands, a task trivial for humans due to their common sense. In this paper, we propose a zero-shot commonsense…

Artificial Intelligence · Computer Science 2021-09-20 Forough Arabshahi , Jennifer Lee , Antoine Bosselut , Yejin Choi , Tom Mitchell

Given a partial description like "she opened the hood of the car," humans can reason about the situation and anticipate what might come next ("then, she examined the engine"). In this paper, we introduce the task of grounded commonsense…

Computation and Language · Computer Science 2018-08-17 Rowan Zellers , Yonatan Bisk , Roy Schwartz , Yejin Choi

Multilingual generative models obtain remarkable cross-lingual in-context learning capabilities through pre-training on large-scale corpora. However, they still exhibit a performance bias toward high-resource languages and learn isolated…

Computation and Language · Computer Science 2024-06-13 Chong Li , Shaonan Wang , Jiajun Zhang , Chengqing Zong

We introduce a simple yet effective method of integrating contextual embeddings with commonsense graph embeddings, dubbed BERT Infused Graphs: Matching Over Other embeDdings. First, we introduce a preprocessing method to improve the speed…

Computation and Language · Computer Science 2019-10-18 Jeff Da

This paper focuses on how to take advantage of external relational knowledge to improve machine reading comprehension (MRC) with multi-task learning. Most of the traditional methods in MRC assume that the knowledge used to get the correct…

Computation and Language · Computer Science 2019-09-06 Jiangnan Xia , Chen Wu , Ming Yan

Knowledge-based recommendation models effectively alleviate the data sparsity issue leveraging the side information in the knowledge graph, and have achieved considerable performance. Nevertheless, the knowledge graphs used in previous…

Information Retrieval · Computer Science 2024-03-28 Shenghao Yang , Weizhi Ma , Peijie Sun , Min Zhang , Qingyao Ai , Yiqun Liu , Mingchen Cai

Recently, transformer-based methods such as RoBERTa and GPT-3 have led to significant experimental advances in natural language processing tasks such as question answering and commonsense reasoning. The latter is typically evaluated through…

Computation and Language · Computer Science 2020-11-19 Mayank Kejriwal , Ke Shen