English
Related papers

Related papers: Simplified Data Wrangling with ir_datasets

200 papers

This paper highlights the growing importance of information retrieval (IR) engines in the scientific community, addressing the inefficiency of traditional keyword-based search engines due to the rising volume of publications. The proposed…

Information Retrieval · Computer Science 2024-10-24 Mahsa Shamsabadi , Jennifer D'Souza

A large amount of data is present on the web. It contains huge number of web pages and to find suitable information from them is very cumbersome task. There is need to organize data in formal manner so that user can easily access and use…

Information Retrieval · Computer Science 2014-03-28 Gagandeep Singh , Vishal Jain

Effective information retrieval (IR) in settings with limited training data, particularly for complex queries, remains a challenging task. This paper introduces IR2, Information Regularization for Information Retrieval, a technique for…

Information Retrieval · Computer Science 2025-04-03 Jianyou Wang , Kaicheng Wang , Xiaoyue Wang , Weili Cao , Ramamohan Paturi , Leon Bergen

Various stakeholders, such as researchers, government agencies, businesses, and research laboratories require a large volume of reliable scientific research outcomes including research articles and patent data to support their work. These…

Databases · Computer Science 2024-10-01 Xinran Wu , Hui Zou , Yidan Xing , Jingjing Qu , Qiongxiu Li , Renxia Xue , Xiaoming Fu

Deep learning technology has developed unprecedentedly in the last decade and has become the primary choice in many application domains. This progress is mainly attributed to a systematic collaboration in which rapidly growing computing…

Machine Learning · Computer Science 2023-12-27 Shiye Lei , Dacheng Tao

Neural networks with deep architectures have demonstrated significant performance improvements in computer vision, speech recognition, and natural language processing. The challenges in information retrieval (IR), however, are different…

Information Retrieval · Computer Science 2021-03-23 Bhaskar Mitra

In the relatively short history of machine learning, the subtle balance between engineering and theoretical progress has been proved critical at various stages. The most recent wave of AI has brought to the IR community powerful techniques,…

Information Retrieval · Computer Science 2022-03-29 Da Xu , Chuanwei Ruan

Imitation learning field requires expert data to train agents in a task. Most often, this learning approach suffers from the absence of available data, which results in techniques being tested on its dataset. Creating datasets is a…

Machine Learning · Computer Science 2024-03-04 Nathan Gavenski , Michael Luck , Odinaldo Rodrigues

Successful development of software systems involves efficient navigation among software artifacts. One state-of-practice approach to structure information is to establish trace links between artifacts, a practice that is also enforced by…

Software Engineering · Computer Science 2016-02-25 Markus Borg

Pyserini is an easy-to-use Python toolkit that supports replicable IR research by providing effective first-stage retrieval in a multi-stage ranking architecture. Our toolkit is self-contained as a standard Python package and comes with…

Information Retrieval · Computer Science 2021-02-22 Jimmy Lin , Xueguang Ma , Sheng-Chieh Lin , Jheng-Hong Yang , Ronak Pradeep , Rodrigo Nogueira

Due to the still relatively low number of users, acquiring large-scale and multidimensional virtual reality datasets remains a significant challenge. Consequently, VR datasets comparable in size to state-of-the-art collections in natural…

Human-Computer Interaction · Computer Science 2024-12-24 Tim Rolff , Niklas Hypki , Markus Lappe , Frank Steinicke

We present a lightweight annotation tool, the Data AnnotatoR Tool (DART), for the general task of labeling structured data with textual descriptions. The tool is implemented as an interactive application that reduces human efforts in…

Computation and Language · Computer Science 2020-12-02 Ernie Chang , Jeriah Caplinger , Alex Marin , Xiaoyu Shen , Vera Demberg

Recommender systems have demonstrated significant impact across diverse domains, yet ensuring the reproducibility of experimental findings remains a persistent challenge. A primary obstacle lies in the fragmented and often opaque data…

A wide range of transformer-based language models have been proposed for information retrieval tasks. However, including transformer-based models in retrieval pipelines is often complex and requires substantial engineering effort. In this…

Information Retrieval · Computer Science 2025-04-16 Ferdinand Schlatt , Maik Fröbe , Matthias Hagen

The process of preparing potentially large and complex data sets for further analysis or manual examination is often called data wrangling. In classical warehousing environments, the steps in such a process have been carried out using…

Sharing and reusing research data can effectively reduce redundant efforts in data collection and curation, especially for small labs and research teams conducting human-centered system research, and enhance the replicability of evaluation…

Information Retrieval · Computer Science 2024-11-26 Tianji Jiang , Wenqi Li , Jiqun Liu

Generating value from data requires the ability to find, access and make sense of datasets. There are many efforts underway to encourage data sharing and reuse, from scientific publishers asking authors to submit data alongside manuscripts…

Data is a critical element in any discovery process. In the last decades, we observed exponential growth in the volume of available data and the technology to manipulate it. However, data is only practical when one can structure it for a…

TalkBank is an online database that facilitates the sharing of linguistics research data. However, the existing TalkBank's API has limited data filtering and batch processing capabilities. To overcome these limitations, this paper…

Databases · Computer Science 2023-06-23 Man Ho Wong

Extracting key information from scientific papers has the potential to help researchers work more efficiently and accelerate the pace of scientific progress. Over the last few years, research on Scientific Information Extraction (SciIE)…

Computation and Language · Computer Science 2023-12-19 Yuhan Li , Jian Wu , Zhiwei Yu , Börje F. Karlsson , Wei Shen , Manabu Okumura , Chin-Yew Lin