English
Related papers

Related papers: Towards Reducing Manual Workload in Technology-Ass…

200 papers

Long documents such as academic articles and business reports have been the standard format to detail out important issues and complicated subjects that require extra attention. An automatic summarization system that can effectively…

Computation and Language · Computer Science 2022-07-05 Huan Yee Koh , Jiaxin Ju , Ming Liu , Shirui Pan

Background: The use of large language models (LLMs) in the title-abstract screening process of systematic reviews (SRs) has shown promising results, but suffers from limited performance evaluation. Aims: Create a benchmark dataset to…

Software Engineering · Computer Science 2025-12-25 Aleksi Huotala , Miikka Kuutila , Mika Mäntylä

The exponential growth of scientific production makes secondary literature abridgements increasingly demanding. We introduce a new open-source framework for systematic reviews that significantly reduces time and workload for collecting and…

Digital Libraries · Computer Science 2022-02-24 Angelo D'Ambrosio , Hajo Grundmann , Tjibbe Donker

Systematic literature reviews play a vital role in identifying the best available evidence for health and social care policy. The resources required to produce systematic reviews can be significant, and a key to the success of any review is…

Information Retrieval · Computer Science 2021-12-20 Andrew MacFarlane , Tony Russell-Rose , Farhad Shokraneh

Peer review is essential for scientific progress but faces growing challenges due to increasing submission volumes and reviewer fatigue. Existing automated review approaches struggle with factual accuracy, rating consistency, and analytical…

Computation and Language · Computer Science 2025-08-15 Sihang Zeng , Kai Tian , Kaiyan Zhang , Yuru wang , Junqi Gao , Runze Liu , Sa Yang , Jingxuan Li , Xinwei Long , Jiaheng Ma , Biqing Qi , Bowen Zhou

Recent advancements in Artificial Intelligence (AI), particularly the widespread adoption of Large Language Models (LLMs), have significantly enhanced text analysis capabilities. This technological evolution offers considerable promise for…

Systematic review (SR) is a popular research method in software engineering (SE). However, conducting an SR takes an average of 67 weeks. Thus, automating any step of the SR process could reduce the effort associated with SRs. Our objective…

Computation and Language · Computer Science 2024-05-09 Aleksi Huotala , Miikka Kuutila , Paul Ralph , Mika Mäntylä

Reference management software is a well-known tool for scientific research work. Since the 1980s, it has been the subject of reviews and evaluations in library and information science literature. This paper presents a systematic review of…

Digital Libraries · Computer Science 2016-01-22 Jesús Tramullas , Ana I. Sánchez-Casabón , Piedad Garrido-Picazo

Ranking is at the core of Information Retrieval. Classic ranking optimization studies often treat ranking as a sorting problem with the assumption that the best performance of ranking would be achieved if we rank items according to their…

Information Retrieval · Computer Science 2023-04-18 Qingyao Ai , Xuanhui Wang , Michael Bendersky

Automatic summarization is the process of reducing a text document in order to generate a summary that retains the most important points of the original document. In this work, we study two problems - i) summarizing a text document as set…

Information Retrieval · Computer Science 2024-06-04 Jayaprakash Sundararaj

Extracting key information from documents represents a large portion of business workloads and therefore offers a high potential for efficiency improvements and process automation. With recent advances in Deep Learning, a plethora of Deep…

Information Retrieval · Computer Science 2025-07-21 Alexander Michael Rombach , Peter Fettke

In recent years, with the rapid development of information on the Internet, the number of complex texts and documents has increased exponentially, which requires a deeper understanding of deep learning methods in order to accurately…

Computation and Language · Computer Science 2023-09-26 Zhongwei Wan

According to common relevance-judgments regimes, such as TREC's, a document can be deemed relevant to a query even if it contains a very short passage of text with pertinent information. This fact has motivated work on passage-based…

Information Retrieval · Computer Science 2019-06-06 Eilon Sheetrit , Anna Shtok , Oren Kurland

[Background]: Systematic Literature Review (SLR) has become an important software engineering research method but costs tremendous efforts. [Aim]: This paper proposes an approach to leverage on empirically evolved ontology to support…

Digital Libraries · Computer Science 2016-09-27 Yueming Sun , Ye Yang , He Zhang , Wen Zhang , Qing Wang

Is it possible to reliably evaluate the quality of peer reviews? We study this question driven by two primary motivations -- incentivizing high-quality reviewing using assessed quality of reviews and measuring changes to review quality in…

Digital Libraries · Computer Science 2024-11-08 Alexander Goldberg , Ivan Stelmakh , Kyunghyun Cho , Alice Oh , Alekh Agarwal , Danielle Belgrave , Nihar B. Shah

Medical errors are a major public health concern and a leading cause of death worldwide. Many healthcare centers and hospitals use reporting systems where medical practitioners write a preliminary medical report and the report is later…

Information Retrieval · Computer Science 2020-05-01 Sean MacAvaney , Arman Cohan , Nazli Goharian , Ross Filice

Technology Assisted Review (TAR) stopping rules aim to reduce the cost of manually assessing documents for relevance by minimising the number of documents that need to be examined to ensure a desired level of recall. This paper extends an…

Information Retrieval · Computer Science 2023-12-07 Reem Bin-Hezam , Mark Stevenson

For many queries in the Web retrieval setting there is an on-going ranking competition: authors manipulate their documents so as to promote them in rankings. Such competitions can have unwarranted effects not only in terms of retrieval…

Information Retrieval · Computer Science 2018-06-14 Gregory Goren , Oren Kurland , Moshe Tennenholtz , Fiana Raiber

Large amount of unstructured designed information is difficult to deal with. Obtaining specific information is a hard mission and takes a lot of time. Information Retrieval System (IR) is a way to solve this kind of problem. IR is a good…

Information Retrieval · Computer Science 2018-04-03 Maher Abdullah , Mohammed GH. I. Al Zamil

Summarizing texts is not a straightforward task. Before even considering text summarization, one should determine what kind of summary is expected. How much should the information be compressed? Is it relevant to reformulate or should the…

Computation and Language · Computer Science 2020-07-16 Paul Tardy , David Janiszek , Yannick Estève , Vincent Nguyen