English
Related papers

Related papers: QADYNAMICS: Training Dynamics-Driven Synthetic QA …

200 papers

Conversational question answering (CQA) facilitates an incremental and interactive understanding of a given context, but building a CQA system is difficult for many domains due to the problem of data scarcity. In this paper, we introduce a…

Computation and Language · Computer Science 2022-10-25 Seonjeong Hwang , Yunsu Kim , Gary Geunbae Lee

Synthesizing QA pairs with a question generator (QG) on the target domain has become a popular approach for domain adaptation of question answering (QA) models. Since synthetic questions are often noisy in practice, existing work adapts…

Computation and Language · Computer Science 2022-03-18 Xiang Yue , Ziyu Yao , Huan Sun

With the rise of large-scale pre-trained language models, open-domain question-answering (ODQA) has become an important research topic in NLP. Based on the popular pre-training fine-tuning approach, we posit that an additional in-domain…

Computation and Language · Computer Science 2022-05-03 Patrick Huber , Armen Aghajanyan , Barlas Oğuz , Dmytro Okhonko , Wen-tau Yih , Sonal Gupta , Xilun Chen

Plausibility Estimation (PE) plays a crucial role for enabling language models to objectively comprehend the real world. While large language models (LLMs) demonstrate remarkable capabilities in PE tasks but sometimes produce trivial…

Computation and Language · Computer Science 2024-12-31 Chong Liu , Zaiwen Feng , Lin Liu , Zhenyun Deng , Jiuyong Li , Ruifang Zhai , Debo Cheng , Li Qin

This paper presents SYMBIOSIS, an AI-powered framework and platform designed to make Systems Thinking accessible for addressing societal challenges and unlock paths for leveraging systems thinking frameworks to improve AI systems. The…

Computers and Society · Computer Science 2025-03-11 Sameer Sethi , Donald Martin , Emmanuel Klu

Nonlinear dynamics are ubiquitous in science and engineering applications, but the physics of most complex systems is far from being fully understood. Discovering interpretable governing equations from measurement data can help us…

Machine Learning · Computer Science 2022-10-18 Luning Sun , Daniel Zhengyu Huang , Hao Sun , Jian-Xun Wang

Data generation-based zero-shot learning, although effective in training Small Task-specific Models (STMs) via synthetic datasets generated by Pre-trained Language Models (PLMs), is often limited by the low quality of such synthetic…

Computation and Language · Computer Science 2024-06-19 Tianyuan Zou , Yang Liu , Peng Li , Jianqing Zhang , Jingjing Liu , Ya-Qin Zhang

With the demanding need for deploying dialogue systems in new domains with less cost, zero-shot dialogue state tracking (DST), which tracks user's requirements in task-oriented dialogues without training on desired domains, draws attention…

Computation and Language · Computer Science 2023-02-28 Ruolin Su , Jingfeng Yang , Ting-Wei Wu , Biing-Hwang Juang

Current Large Language Models (LLMs) have shown strong reasoning capabilities in commonsense question answering benchmarks, but the process underlying their success remains largely opaque. As a consequence, recent approaches have equipped…

Computation and Language · Computer Science 2024-10-08 Francesco Maria Molfese , Simone Conia , Riccardo Orlando , Roberto Navigli

Question Answering (QA) systems face challenges in handling complex questions that require multi-domain knowledge synthesis. The naive RAG models, although effective in information retrieval, struggle with complex questions that require…

Computation and Language · Computer Science 2024-10-24 Ziyang Chen , Xiaobin Wang , Yong Jiang , Jinzhi Liao , Pengjun Xie , Fei Huang , Xiang Zhao

Multimodal multihop question answering (MMQA) requires reasoning over images and text from multiple sources. Despite advances in visual question answering, this multihop setting remains underexplored due to a lack of quality datasets.…

Computation and Language · Computer Science 2025-09-16 Amirhossein Abaskohi , Spandana Gella , Giuseppe Carenini , Issam H. Laradji

A long-standing challenge for search and conversational assistants is query intention detection in ambiguous queries. Asking clarifying questions in conversational search has been widely studied and considered an effective solution to…

Information Retrieval · Computer Science 2023-02-13 Zhenduo Wang , Yuancheng Tu , Corby Rosset , Nick Craswell , Ming Wu , Qingyao Ai

In tasks like semantic parsing, instruction following, and question answering, standard deep networks fail to generalize compositionally from small datasets. Many existing approaches overcome this limitation with model architectures that…

Computation and Language · Computer Science 2023-07-06 Ekin Akyürek , Jacob Andreas

Question answering (QA) models for reading comprehension have been demonstrated to exploit unintended dataset biases such as question-context lexical overlap. This hinders QA models from generalizing to under-represented samples such as…

Computation and Language · Computer Science 2021-09-24 Kazutoshi Shinoda , Saku Sugawara , Akiko Aizawa

Synthetic data augmentation helps language models learn new knowledge in data-constrained domains. However, naively scaling existing synthetic data methods by training on more synthetic tokens or using stronger generators yields diminishing…

Machine Learning · Computer Science 2026-03-31 Seungju Han , Konwoo Kim , Chanwoo Park , Benjamin Newman , Suhas Kotha , Jaehun Jung , James Zou , Yejin Choi

Commonsense question answering (QA) requires background knowledge which is not explicitly stated in a given context. Prior works use commonsense knowledge graphs (KGs) to obtain this knowledge for reasoning. However, relying entirely on…

Computation and Language · Computer Science 2020-09-22 Peifeng Wang , Nanyun Peng , Filip Ilievski , Pedro Szekely , Xiang Ren

Despite Visual Question Answering (VQA) has realized impressive progress over the last few years, today's VQA models tend to capture superficial linguistic correlations in the train set and fail to generalize to the test set with different…

Computer Vision and Pattern Recognition · Computer Science 2020-03-17 Long Chen , Xin Yan , Jun Xiao , Hanwang Zhang , Shiliang Pu , Yueting Zhuang

The scarcity of high-quality, knowledge-intensive training data hinders the development of large language models (LLMs), as traditional corpora provide limited information. Previous studies have synthesized and integrated corpora-dependent…

Computation and Language · Computer Science 2025-08-05 Xuemiao Zhang , Chengying Tu , Can Ren , Rongxiang Weng , Hongfei Yan , Jingang Wang , Xunliang Cai

We demonstrate substantial performance gains in zero-shot dialogue state tracking (DST) by enhancing training data diversity through synthetic data generation. Existing DST datasets are severely limited in the number of application domains…

Computation and Language · Computer Science 2024-06-14 James D. Finch , Jinho D. Choi

In-context learning with Large Language Models (LLMs) has emerged as a promising avenue of research in Dialog State Tracking (DST). However, the best-performing in-context learning methods involve retrieving and adding similar examples to…

Computation and Language · Computer Science 2024-02-06 Atharva Kulkarni , Bo-Hsiang Tseng , Joel Ruben Antony Moniz , Dhivya Piraviperumal , Hong Yu , Shruti Bhargava