English
Related papers

Related papers: Task Preferences across Languages on Community Que…

200 papers

Complex query answering (CQA) on knowledge graphs (KGs) is gaining momentum as a challenging reasoning task. In this paper, we show that the current benchmarks for CQA might not be as complex as we think, as the way they are built distorts…

Machine Learning · Computer Science 2025-07-04 Cosimo Gregucci , Bo Xiong , Daniel Hernandez , Lorenzo Loconte , Pasquale Minervini , Steffen Staab , Antonio Vergari

Recent progress in Large Language Models (LLMs) has produced models that exhibit remarkable performance across a variety of NLP tasks. However, it remains unclear whether the existing focus of NLP research accurately captures the genuine…

Computation and Language · Computer Science 2023-10-20 Siru Ouyang , Shuohang Wang , Yang Liu , Ming Zhong , Yizhu Jiao , Dan Iter , Reid Pryzant , Chenguang Zhu , Heng Ji , Jiawei Han

Table-and-text hybrid question answering (HybridQA) is a widely used and challenging NLP task commonly applied in the financial and scientific domain. The early research focuses on migrating other QA task methods to HybridQA, while with…

Computation and Language · Computer Science 2023-02-03 Dingzirui Wang , Longxu Dou , Wanxiang Che

Large Language Models (LLMs) exhibit extensive knowledge about the world, but most evaluations have been limited to global or anglocentric subjects. This raises the question of how well these models perform on topics relevant to other…

Computation and Language · Computer Science 2024-11-19 Julen Etxaniz , Gorka Azkune , Aitor Soroa , Oier Lopez de Lacalle , Mikel Artetxe

Software developers have benefited from various sources of knowledge such as forums, question-and-answer sites, and social media platforms to help them in various tasks. Extracting software-related knowledge from different platforms…

Information Retrieval · Computer Science 2018-11-01 Agus Sulistya , Gede Artha Azriadi Prana , Abhishek Sharma , David Lo , Christoph Treude

Large Language Models (LLMs) have created opportunities for designing chatbots that can support complex question-answering (QA) scenarios and improve news audience engagement. However, we still lack an understanding of what roles…

Human-Computer Interaction · Computer Science 2024-03-26 Md Naimul Hoque , Ayman Mahfuz , Mayukha Kindi , Naeemul Hassan

Quality improvement methods are essential to gathering high-quality crowdsourced data, both for research and industry applications. A popular and broadly applicable method is task assignment that dynamically adjusts crowd workflow…

Human-Computer Interaction · Computer Science 2021-11-17 Danula Hettiachchi , Vassilis Kostakos , Jorge Goncalves

The breakthrough of generative large language models (LLMs) that can solve different tasks through chat interaction has led to a significant increase in the use of general benchmarks to assess the quality or performance of these models…

Computation and Language · Computer Science 2025-04-03 Fabio Barth , Georg Rehm

Research on customer satisfaction has increased substantially in recent years. However, the relative importance and relationships between different determinants of satisfaction remains uncertain. Moreover, quantitative studies to date tend…

Computation and Language · Computer Science 2017-11-23 Radoslaw Kowalski , Marc Esteve , Slava J. Mikhaylov

Open-domain Question Answering (OpenQA) is an important task in Natural Language Processing (NLP), which aims to answer a question in the form of natural language based on large-scale unstructured documents. Recently, there has been a surge…

Artificial Intelligence · Computer Science 2021-05-11 Fengbin Zhu , Wenqiang Lei , Chao Wang , Jianming Zheng , Soujanya Poria , Tat-Seng Chua

Can advanced multi-modal models effectively tackle complex web-based tasks? Such tasks are often found on crowdsourcing platforms, where crowdworkers engage in challenging micro-tasks within web-based environments. Building on this idea, we…

Artificial Intelligence · Computer Science 2025-02-25 Kevin Xu , Yeganeh Kordi , Tanay Nayak , Adi Asija , Yizhong Wang , Kate Sanders , Adam Byerly , Jingyu Zhang , Benjamin Van Durme , Daniel Khashabi

Large language models (LLMs) have grown in popularity due to their natural language interface and pre trained knowledge, leading to rapidly increasing success in question-answering (QA) tasks. More recently, multi-agent systems with…

Machine Learning · Computer Science 2024-10-21 Bhrij Patel , Vishnu Sashank Dorbala , Amrit Singh Bedi , Dinesh Manocha

Empowering language is important in many real-world contexts, from education to workplace dynamics to healthcare. Though language technologies are growing more prevalent in these contexts, empowerment has seldom been studied in NLP, and…

Computation and Language · Computer Science 2023-10-24 Lucille Njoo , Chan Young Park , Octavia Stappart , Marvin Thielk , Yi Chu , Yulia Tsvetkov

Search-augmented language models combine web search with Large Language Models (LLMs) to improve response groundedness and freshness. However, analyzing these systems remains challenging: existing datasets are limited in scale and narrow in…

Internet and online-based social systems are rising as the dominant mode of communication in society. However, the public or semi-private environment under which most online communications operate under do not make them suitable channels…

Social and Information Networks · Computer Science 2015-09-03 Derek Doran , Samir Yelne , Luisa Massari , Maria-Carla Calzarossa , LaTrelle Jackson , Glen Moriarty

We demonstrate that user preferences can be represented and predicted across topical domains using large-scale social modeling. Given information about popular entities favored by a user, we project the user into a social embedding space…

Social and Information Networks · Computer Science 2026-03-12 Nir Lotan , Adir Solomon , Ido Guy , Einat Minkov

While there has been substantial progress in text comprehension through simple factoid question answering, more holistic comprehension of a discourse still presents a major challenge (Dunietz et al., 2020). Someone critically reflecting on…

Computation and Language · Computer Science 2022-10-18 Wei-Jen Ko , Cutter Dalton , Mark Simmons , Eliza Fisher , Greg Durrett , Junyi Jessy Li

Cross-lingual open domain question answering (CLQA) is a complex problem, comprising cross-lingual retrieval from a multilingual knowledge base, followed by answer generation in the query language. Both steps are usually tackled by separate…

Computation and Language · Computer Science 2024-10-03 Fan Jiang , Tom Drummond , Trevor Cohn

Human knowledge is collectively encoded in the roughly 6500 languages spoken around the world, but it is not distributed equally across languages. Hence, for information-seeking question answering (QA) systems to adequately serve speakers…

Computation and Language · Computer Science 2021-09-27 Fahim Faisal , Antonios Anastasopoulos