English
Related papers

Related papers: Data Ambiguity Strikes Back: How Documentation Imp…

200 papers

Data augmentation has attracted a lot of research attention in the deep learning era for its ability in alleviating data sparseness. The lack of labeled data for unseen evaluation databases is exactly the major challenge for cross-domain…

Computation and Language · Computer Science 2022-11-16 Kun Wu , Lijie Wang , Zhenghua Li , Ao Zhang , Xinyan Xiao , Hua Wu , Min Zhang , Haifeng Wang

The proliferation of complex structured data in hybrid sources, such as PDF documents and web pages, presents unique challenges for current Large Language Models (LLMs) and Multi-modal Large Language Models (MLLMs) in providing accurate…

Information Retrieval · Computer Science 2025-08-22 Shivani Upadhyay , Messiah Ataey , Syed Shariyar Murtaza , Yifan Nie , Jimmy Lin

Today's Web of Data is noisy. Linked Data often needs extensive preprocessing to enable efficient use of heterogeneous resources. While consistent and valid data provides the key to efficient data processing and aggregation we are facing…

Information Retrieval · Computer Science 2012-04-13 Magnus Knuth , Johannes Hercher , Harald Sack

Maintaining consistent model performance across domains is a fundamental challenge in machine learning. While recent work has explored using LLM-generated data for fine-tuning, its impact on cross-domain generalization remains poorly…

Computation and Language · Computer Science 2025-12-12 Chao-Chung Wu , Zhi Rui Tam , Chieh-Yen Lin , Yun-Nung Chen , Shao-Hua Sun , Hung-yi Lee

Questions regarding implicitness, ambiguity and underspecification are crucial for understanding the task validity and ethical concerns of multimodal image+text systems, yet have received little attention to date. This position paper maps…

Computer Vision and Pattern Recognition · Computer Science 2022-10-13 Ben Hutchinson , Jason Baldridge , Vinodkumar Prabhakaran

Translating natural language utterances to executable queries is a helpful technique in making the vast amount of data stored in relational databases accessible to a wider range of non-tech-savvy end users. Prior work in this area has…

Computation and Language · Computer Science 2020-10-21 Karthik Radhakrishnan , Arvind Srikantan , Xi Victoria Lin

Sentences containing multiple semantic operators with overlapping scope often create ambiguities in interpretation, known as scope ambiguities. These ambiguities offer rich insights into the interaction between semantic structure and world…

Computation and Language · Computer Science 2024-06-18 Gaurav Kamath , Sebastian Schuster , Sowmya Vajjala , Siva Reddy

Existing large language models (LLMs) for machine translation are typically fine-tuned on sentence-level translation instructions and achieve satisfactory performance at the sentence level. However, when applied to document-level…

Computation and Language · Computer Science 2024-01-17 Yachao Li , Junhui Li , Jing Jiang , Min Zhang

Cognitive computing systems require human labeled data for evaluation, and often for training. The standard practice used in gathering this data minimizes disagreement between annotators, and we have found this results in data that fails to…

Computation and Language · Computer Science 2018-09-27 Anca Dumitrache , Lora Aroyo , Chris Welty

One of the major challenges of machine translation (MT) is ambiguity, which can in some cases be resolved by accompanying context such as images. However, recent work in multimodal MT (MMT) has shown that obtaining improvements from images…

Computation and Language · Computer Science 2023-05-29 Matthieu Futeral , Cordelia Schmid , Ivan Laptev , Benoît Sagot , Rachel Bawden

Repairing inconsistent knowledge bases is a task that has been assessed, with great advances over several decades, from within the knowledge representation and reasoning and the database theory communities. As information becomes more…

Databases · Computer Science 2023-07-14 Sergio Abriola , Santiago Cifuentes , Nina Pardal , Edwin Pin

Conversational, multi-turn, text-to-SQL (CoSQL) tasks map natural language utterances in a dialogue to SQL queries. State-of-the-art (SOTA) systems use large, pre-trained and finetuned language models, such as the T5-family, in conjunction…

Computation and Language · Computer Science 2023-02-23 Sree Hari Krishnan Parthasarathi , Lu Zeng , Dilek Hakkani-Tur

Education that suits the individual learning level is necessary to improve students' understanding. The first step in achieving this purpose by using large language models (LLMs) is to adjust the textual difficulty of the response to…

Computation and Language · Computer Science 2024-02-23 Seiji Gobara , Hidetaka Kamigaito , Taro Watanabe

Large Language Models (LLMs) have been achieving competent performance on a wide range of downstream tasks, yet existing work shows that inference on structured data is challenging for LLMs. This is because LLMs need to either understand…

Computation and Language · Computer Science 2024-07-04 Younghun Lee , Sungchul Kim , Ryan A. Rossi , Tong Yu , Xiang Chen

Due to the lack of a large collection of high-quality labeled sentence pairs with textual similarity scores, existing approaches for Semantic Textual Similarity (STS) mostly rely on unsupervised techniques or training signals that are only…

Computation and Language · Computer Science 2023-12-13 Shuhe Wang , Beiming Cao , Shengyu Zhang , Xiaoya Li , Jiwei Li , Fei Wu , Guoyin Wang , Eduard Hovy

User queries are often underspecified and may admit multiple valid interpretations. Rather than silently making assumptions about the user's intent, a helpful assistant should surface such ambiguity by asking a clarifying question. Doing so…

Computation and Language · Computer Science 2026-05-26 Jinyan Su , Claire Cardie

Recent advances in Text-to-SQL have achieved strong results in static, single-turn tasks, where models generate SQL queries from natural language questions. However, these systems fall short in real-world interactive scenarios, where user…

Databases · Computer Science 2025-11-14 Linzhuang Sun , Tianyu Guo , Hao Liang , Yuying Li , Qifeng Cai , Jingxuan Wei , Bihui Yu , Wentao Zhang , Bin Cui

Linguistic ambiguity is and has always been one of the main challenges in Natural Language Processing (NLP) systems. Modern Transformer architectures like BERT, T5 or more recently InstructGPT have achieved some impressive improvements in…

Computation and Language · Computer Science 2023-02-21 Miguel Ortega-Martín , Óscar García-Sierra , Alfonso Ardoiz , Jorge Álvarez , Juan Carlos Armenteros , Adrián Alonso

The advent of multimodal learning has brought a significant improvement in document AI. Documents are now treated as multimodal entities, incorporating both textual and visual information for downstream analysis. However, works in this…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Nikitha SR , Tarun Ram Menta , Mausoom Sarkar

Ambiguous questions persist in open-domain question answering, because formulating a precise question with a unique answer is often challenging. Previously, Min et al. (2020) have tackled this issue by generating disambiguated questions for…

Computation and Language · Computer Science 2023-10-26 Dongryeol Lee , Segwang Kim , Minwoo Lee , Hwanhee Lee , Joonsuk Park , Sang-Woo Lee , Kyomin Jung