English
Related papers

Related papers: Template Filling for Controllable Commonsense Reas…

200 papers

Large language models (LLMs) such as GPT-3 have demonstrated a strong capability to generate coherent and contextually relevant text. However, amidst their successes, a crucial issue persists: their generated outputs still lack commonsense…

Computation and Language · Computer Science 2023-10-27 Yufei Tian , Felix Zhang , Nanyun Peng

The state-of-the-art pre-trained language representation models, such as Bidirectional Encoder Representations from Transformers (BERT), rarely incorporate commonsense knowledge or other knowledge explicitly. We propose a pre-training…

Computation and Language · Computer Science 2020-05-07 Zhi-Xiu Ye , Qian Chen , Wen Wang , Zhen-Hua Ling

Open-domain dialogue systems need to grasp social commonsense to understand and respond effectively to human users. Commonsense-augmented dialogue models have been proposed that aim to infer commonsense knowledge from dialogue contexts in…

Computation and Language · Computer Science 2025-01-22 Sarah E. Finch , Jinho D. Choi

Reference-based Text-to-Speech (TTS) models can generate multiple, prosodically-different renditions of the same target text. Such models jointly learn a latent acoustic space during training, which can be sampled from during inference.…

Computation and Language · Computer Science 2023-09-20 Atli Thor Sigurgeirsson , Simon King

Stories generated with neural language models have shown promise in grammatical and stylistic consistency. However, the generated stories are still lacking in common sense reasoning, e.g., they often contain sentences deprived of world…

Machine Learning · Computer Science 2020-03-02 Huanru Henry Mao , Bodhisattwa Prasad Majumder , Julian McAuley , Garrison W. Cottrell

Commonsense generation is a challenging task of generating a plausible sentence describing an everyday scenario using provided concepts. Its requirement of reasoning over commonsense knowledge and compositional generalization ability even…

Computation and Language · Computer Science 2021-05-25 Han Wang , Yang Liu , Chenguang Zhu , Linjun Shou , Ming Gong , Yichong Xu , Michael Zeng

Reasoning-enhanced large language models (LLMs) explicitly generate intermediate reasoning steps prior to generating final answers, helping the model excel in complex problem-solving. In this paper, we demonstrate that this emerging…

Machine Learning · Computer Science 2025-05-22 Tong Wu , Chong Xiang , Jiachen T. Wang , G. Edward Suh , Prateek Mittal

Generating commonsense assertions within a given story context remains a difficult task for modern language models. Previous research has addressed this problem by aligning commonsense inferences with stories and training language…

Computation and Language · Computer Science 2024-10-04 Pedro Colon-Hernandez , Nanxi Liu , Chelsea Joe , Peter Chin , Claire Yin , Henry Lieberman , Yida Xin , Cynthia Breazeal

A transparent decision-making process is essential for developing reliable and trustworthy recommender systems. For sequential recommendation, it means that the model can identify key items that account for its recommendation results.…

Information Retrieval · Computer Science 2025-03-05 Kun Ma , Cong Xu , Zeyuan Chen , Wei Zhang

Large language models make remarkable progress in reasoning capabilities. Existing works focus mainly on deductive reasoning tasks (e.g., code and math), while another type of reasoning mode that better aligns with human learning, inductive…

Computation and Language · Computer Science 2025-03-18 Kedi Chen , Zhikai Lei , Fan Zhang , Yinqi Zhang , Qin Chen , Jie Zhou , Liang He , Qipeng Guo , Kai Chen , Wei Zhang

Transformer-based language model approaches to automated story generation currently provide state-of-the-art results. However, they still suffer from plot incoherence when generating narratives over time, and critically lack basic…

Computation and Language · Computer Science 2023-11-21 Xiangyu Peng , Siyan Li , Sarah Wiegreffe , Mark Riedl

Commonsense reasoning deals with the implicit knowledge that is well understood by humans and typically acquired via interactions with the world. In recent times, commonsense reasoning and understanding of various LLMs have been evaluated…

Computation and Language · Computer Science 2025-04-15 Abhinav Joshi , Areeb Ahmad , Divyaksh Shukla , Ashutosh Modi

Abductive reasoning aims to find plausible explanations for an event. This style of reasoning is critical for commonsense tasks where there are often multiple plausible explanations. Existing approaches for abductive reasoning in natural…

Computation and Language · Computer Science 2023-05-25 Wenting Zhao , Justin T. Chiu , Claire Cardie , Alexander M. Rush

Reasoning over Commonsense Knowledge Bases (CSKB), i.e. CSKB reasoning, has been explored as a way to acquire new commonsense knowledge based on reference knowledge in the original CSKBs and external prior knowledge. Despite the advancement…

Computation and Language · Computer Science 2024-01-26 Quyet V. Do , Tianqing Fang , Shizhe Diao , Zhaowei Wang , Yangqiu Song

Recent efforts in natural language processing (NLP) commonsense reasoning research have yielded a considerable number of new datasets and benchmarks. However, most of these datasets formulate commonsense reasoning challenges in artificial…

Computation and Language · Computer Science 2023-10-25 Mete Ismayilzada , Debjit Paul , Syrielle Montariol , Mor Geva , Antoine Bosselut

The success of language models has inspired the NLP community to attend to tasks that require implicit and complex reasoning, relying on human-like commonsense mechanisms. While such vertical thinking tasks have been relatively popular,…

Computation and Language · Computer Science 2023-11-13 Yifan Jiang , Filip Ilievski , Kaixin Ma , Zhivar Sourati

Commonsense question-answering (QA) tasks, in the form of benchmarks, are constantly being introduced for challenging and comparing commonsense QA systems. The benchmarks provide question sets that systems' developers can use to train and…

Artificial Intelligence · Computer Science 2020-12-23 Henrique Santos , Minor Gordon , Zhicheng Liang , Gretchen Forbush , Deborah L. McGuinness

Recent advances in cross-lingual commonsense reasoning (CSR) are facilitated by the development of multilingual pre-trained models (mPTMs). While mPTMs show the potential to encode commonsense knowledge for different languages, transferring…

Computation and Language · Computer Science 2023-02-28 Ruolin Su , Zhongkai Sun , Sixing Lu , Chengyuan Ma , Chenlei Guo

Large language models (LLMs) have recently attracted considerable interest for their ability to perform complex reasoning tasks, such as chain-of-thought (CoT) reasoning. However, most of the existing approaches to enhance this ability rely…

Computation and Language · Computer Science 2024-08-08 Xinyi Wang , Lucas Caccia , Oleksiy Ostapenko , Xingdi Yuan , William Yang Wang , Alessandro Sordoni

Contextualized or discourse aware commonsense inference is the task of generating coherent commonsense assertions (i.e., facts) from a given story, and a particular sentence from that story. Some problems with the task are: lack of…

Computation and Language · Computer Science 2023-02-13 Pedro Colon-Hernandez , Henry Lieberman , Yida Xin , Claire Yin , Cynthia Breazeal , Peter Chin