English
Related papers

Related papers: MCScript: A Novel Dataset for Assessing Machine Co…

200 papers

Recently, Large Language Models (LLMs) have been serving as general-purpose interfaces, posing a significant demand for comprehensive visual knowledge. However, it remains unclear how well current LLMs and their visually augmented…

Computation and Language · Computer Science 2023-10-24 Heming Xia , Qingxiu Dong , Lei Li , Jingjing Xu , Tianyu Liu , Ziwei Qin , Zhifang Sui

Since scripts were proposed in the 1970's as an inferencing mechanism for AI and natural language processing programs, there have been few attempts to build a database of scripts. This paper describes a database and lexicon of scripts that…

Artificial Intelligence · Computer Science 2007-05-23 Erik T. Mueller

Machine learning models such as Transformers or LSTMs struggle with tasks that are compositional in nature such as those involving reasoning/inference. Although many datasets exist to evaluate compositional generalization, when it comes to…

Artificial Intelligence · Computer Science 2022-04-12 Santiago Ontanon , Joshua Ainslie , Vaclav Cvicek , Zachary Fisher

Sarcasm detection is important for several NLP tasks such as sentiment identification in product reviews, user feedback, and online forums. It is a challenging task requiring a deep understanding of language, context, and world knowledge.…

Computation and Language · Computer Science 2021-09-20 Somnath Basu Roy Chowdhury , Snigdha Chaturvedi

Scientific machine reading comprehension (SMRC) aims to understand scientific texts through interactions with humans by given questions. As far as we know, there is only one dataset focused on exploring full-text scientific machine reading…

Computation and Language · Computer Science 2023-06-27 Xiao Zhang , Heqi Zheng , Yuxiang Nie , Heyan Huang , Xian-Ling Mao

Data users need relevant context and research expertise to effectively search for and identify relevant datasets. Leading data providers, such as the Inter-university Consortium for Political and Social Research (ICPSR), offer standardized…

Information Retrieval · Computer Science 2023-05-31 Lizhou Fan , Sara Lafia , Lingyao Li , Fangyuan Yang , Libby Hemphill

Machine learning datasets are powerful but unwieldy. Despite the fact that large datasets commonly contain problematic material--whether from a technical, legal, or ethical perspective--datasets are valuable resources when handled carefully…

Computers and Society · Computer Science 2025-01-28 Sarah Ciston , Mike Ananny , Kate Crawford

Conversational Machine Comprehension (CMC), a research track in conversational AI, expects the machine to understand an open-domain natural language text and thereafter engage in a multi-turn conversation to answer questions related to the…

Computation and Language · Computer Science 2021-02-09 Somil Gupta , Bhanu Pratap Singh Rawat , Hong Yu

Ensuring the reproducibility of scientific work is crucial as it allows the consistent verification of scientific claims and facilitates the advancement of knowledge by providing a reliable foundation for future research. However,…

Software Engineering · Computer Science 2025-04-14 Lázaro Costa , Susana Barbosa , Jácome Cunha

Identifying suitable datasets for a research question remains challenging because existing dataset search engines rely heavily on metadata quality and keyword overlap, which often fail to capture the semantic intent of scientific…

Digital Libraries · Computer Science 2026-01-09 Zhiyin Tan , Changxu Duan

In this paper, we present the first comprehensive categorization of essential commonsense knowledge for answering the Winograd Schema Challenge (WSC). For each of the questions, we invite annotators to first provide reasons for making…

Artificial Intelligence · Computer Science 2020-05-13 Hongming Zhang , Xinran Zhao , Yangqiu Song

This study aims at solving the Machine Reading Comprehension problem where questions have to be answered given a context passage. The challenge is to develop a computationally faster model which will have improved inference time. State of…

Computation and Language · Computer Science 2019-04-02 Debajyoti Chatterjee

Multimodal summarization with multimodal output (MSMO) has emerged as a promising research direction. Nonetheless, numerous limitations exist within existing public MSMO datasets, including insufficient maintenance, data inaccessibility,…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Jielin Qiu , Jiacheng Zhu , William Han , Aditesh Kumar , Karthik Mittal , Claire Jin , Zhengyuan Yang , Linjie Li , Jianfeng Wang , Ding Zhao , Bo Li , Lijuan Wang

Story ending generation is an interesting and challenging task, which aims to generate a coherent and reasonable ending given a story context. The key challenges of the task lie in how to comprehend the story context sufficiently and handle…

Computation and Language · Computer Science 2022-02-01 Jiaan Wang , Beiqi Zou , Zhixu Li , Jianfeng Qu , Pengpeng Zhao , An Liu , Lei Zhao

Reasoning is a crucial part of natural language argumentation. To comprehend an argument, one must analyze its warrant, which explains why its claim follows from its premises. As arguments are highly contextualized, warrants are usually…

Computation and Language · Computer Science 2022-03-07 Ivan Habernal , Henning Wachsmuth , Iryna Gurevych , Benno Stein

Commonsense knowledge acquisition is a key problem for artificial intelligence. Conventional methods of acquiring commonsense knowledge generally require laborious and costly human annotations, which are not feasible on a large scale. In…

Artificial Intelligence · Computer Science 2020-05-04 Hongming Zhang , Daniel Khashabi , Yangqiu Song , Dan Roth

Recently, end-to-end trained models for multiple-choice commonsense question answering (QA) have delivered promising results. However, such question-answering systems cannot be directly applied in real-world scenarios where answer…

Computation and Language · Computer Science 2023-03-21 Zhen Han , Yue Feng , Mingming Sun

Generating commonsense assertions within a given story context remains a difficult task for modern language models. Previous research has addressed this problem by aligning commonsense inferences with stories and training language…

Computation and Language · Computer Science 2024-10-04 Pedro Colon-Hernandez , Nanxi Liu , Chelsea Joe , Peter Chin , Claire Yin , Henry Lieberman , Yida Xin , Cynthia Breazeal

To provide a survey on the existing tasks and models in Machine Reading Comprehension (MRC), this report reviews: 1) the dataset collection and performance evaluation of some representative simple-reasoning and complex-reasoning MRC tasks;…

Computation and Language · Computer Science 2020-01-24 Chao Wang

In e-commerce, the salience of commonsense knowledge (CSK) is beneficial for widespread applications such as product search and recommendation. For example, when users search for ``running'' in e-commerce, they would like to find products…

Computation and Language · Computer Science 2023-01-30 Yincen Qu , Ningyu Zhang , Hui Chen , Zelin Dai , Zezhong Xu , Chengming Wang , Xiaoyu Wang , Qiang Chen , Huajun Chen
‹ Prev 1 8 9 10 Next ›