English
Related papers

Related papers: KnowledgeShovel: An AI-in-the-Loop Document Annota…

200 papers

Due to the lack of structure, scholarly knowledge remains hardly accessible for machines. Scholarly knowledge graphs have been proposed as a solution. Creating such a knowledge graph requires manual effort and domain experts, and is…

Digital Libraries · Computer Science 2020-12-02 Allard Oelen , Markus Stocker , Sören Auer

Real-world domain experts (e.g., doctors) rarely annotate only a decision label in their day-to-day workflow without providing explanations. Yet, existing low-resource learning techniques, such as Active Learning (AL), that aim to support…

Computation and Language · Computer Science 2023-10-24 Bingsheng Yao , Ishan Jindal , Lucian Popa , Yannis Katsis , Sayan Ghosh , Lihong He , Yuxuan Lu , Shashank Srivastava , Yunyao Li , James Hendler , Dakuo Wang

The availability of tera-byte scale experiment data calls for AI driven approaches which automatically discover scientific models from data. Nonetheless, significant challenges present in AI-driven scientific discovery: (i) The annotation…

Computer Vision and Pattern Recognition · Computer Science 2023-11-23 Md Nasim , Anter El-Azab , Xinghang Zhang , Yexiang Xue

Scientific research is being reshaped by AI systems that move beyond isolated assistance toward longer-horizon workflows spanning literature grounding, hypothesis generation, experimentation, validation, reporting, and revision. This shift…

This paper introduces a human-in-the-loop (HITL) data annotation pipeline to generate high-quality, large-scale speech datasets. The pipeline combines human and machine advantages to more quickly, accurately, and cost-effectively annotate…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-06 Mingkuan Liu , Chi Zhang , Hua Xing , Chao Feng , Monchu Chen , Judith Bishop , Grace Ngapo

Despite the growing availability of tools designed to support scholarly knowledge extraction and organization, many researchers still rely on manual methods, sometimes due to unfamiliarity with existing technologies or limited access to…

Science progresses by building upon the prior body of knowledge documented in scientific publications. The acceleration of research makes it hard to stay up-to-date with the recent developments and to summarize the ever-growing body of…

Computation and Language · Computer Science 2023-11-07 Martin Funkquist , Ilia Kuznetsov , Yufang Hou , Iryna Gurevych

With the rapid accumulation of text data produced by data-driven techniques, the task of extracting "data annotations"--concise, high-quality data summaries from unstructured raw text--has become increasingly important. The recent advances…

Human-Computer Interaction · Computer Science 2023-04-03 Xiaoyu Zhang , Xiwei Xuan , Alden Dima , Thurston Sexton , Kwan-Liu Ma

SMCalFlow is a large corpus of semantically detailed annotations of task-oriented natural dialogues. The annotations use a dataflow approach, in which the annotations are programs which represent user requests. Despite the availability,…

Computation and Language · Computer Science 2022-06-29 Joram Meron

The landscape of interactive systems is shifting toward dynamic, generative experiences that empower users to explore and construct knowledge in real time. Yet, timelines -- a fundamental tool for representing historical and conceptual…

Human-Computer Interaction · Computer Science 2025-10-22 Sangho Suh , Rahul Hingorani , Bryan Wang , Tovi Grossman

When answering a question, humans utilize the information available across different modalities to synthesize a consistent and complete chain of thought (CoT). This process is normally a black box in the case of deep learning models like…

Computation and Language · Computer Science 2022-10-18 Pan Lu , Swaroop Mishra , Tony Xia , Liang Qiu , Kai-Wei Chang , Song-Chun Zhu , Oyvind Tafjord , Peter Clark , Ashwin Kalyan

AI-assisted research compresses ideation, implementation, evaluation, and manuscript writing into a single interactive loop. This compression is useful, but it also creates a publication risk: paper claims can become easier to state than to…

Artificial Intelligence · Computer Science 2026-05-28 Yihan Xia , Taotao Wang

Systematic reviews and mapping studies are critical to synthesize research, identify gaps, and guide future work, but are often labor-intensive and time-consuming. Existing tools provide partial support for specific steps, leaving much of…

Information Retrieval · Computer Science 2026-02-09 Martim Afonso , Nuno Saavedra , Bruno Lourenço , Alexandra Mendes , João Ferreira

Scientific knowledge graphs have been proposed as a solution to structure the content of research publications in a machine-actionable way and enable more efficient, computer-assisted workflows for many research activities. Crowd-sourcing…

Digital Libraries · Computer Science 2023-04-27 Christof Bless , Ildar Baimuratov , Oliver Karras

Deep research systems are widely used for multi-step web research, analysis, and cross-source synthesis, yet their evaluation remains challenging. Existing benchmarks often require annotation-intensive task construction, rely on static…

Computation and Language · Computer Science 2026-01-15 Yibo Wang , Lei Wang , Yue Deng , Keming Wu , Yao Xiao , Huanjin Yao , Liwei Kang , Hai Ye , Yongcheng Jing , Lidong Bing

Automating scientific discovery requires more than generating papers from ideas. Real research is iterative: hypotheses are challenged from multiple perspectives, experiments fail and inform the next attempt, and lessons accumulate across…

Business documents come in a variety of structures, formats and information needs which makes information extraction a challenging task. Due to these variations, having a document generic model which can work well across all types of…

Computation and Language · Computer Science 2022-11-10 Neelesh K Shukla , Msp Raja , Raghu Katikeri , Amit Vaid

Creating presentation slides is a critical but time-consuming task for data scientists. While researchers have proposed many AI techniques to lift data scientists' burden on data preparation and model selection, few have targeted the…

Human-Computer Interaction · Computer Science 2023-01-27 Chengbo Zheng , Dakuo Wang , April Yi Wang , Xiaojuan Ma

Large language models (LLMs) are increasingly used in scientific writing but struggle with book-length tasks, often producing inconsistent structure and unreliable citations. We introduce CoAuthorAI, a human-in-the-loop writing system that…

Computation and Language · Computer Science 2026-04-23 Yangjie Tian , Xungang Gu , Yun Zhao , Jiale Yang , Lin Yang , Ning Li , He Zhang , Ruohua Xu , Hua Wang , Kewen Liao , Ming Liu

Recent research in the field of computer vision strongly focuses on deep learning architectures to tackle image processing problems. Deep neural networks are often considered in complex image processing scenarios since traditional computer…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Marcel P. Schilling , Luca Rettenberger , Friedrich Münke , Haijun Cui , Anna A. Popova , Pavel A. Levkin , Ralf Mikut , Markus Reischl