English
Related papers

Related papers: RE for AI in Practice: Managing Data Annotation Re…

200 papers

Human annotation remains the foundation of reliable and interpretable data in Natural Language Processing (NLP). As annotation and evaluation tasks continue to expand, from categorical labelling to segmentation, subjective judgment, and…

Computation and Language · Computer Science 2026-04-02 Joseph James

Automatic medical image segmentation plays a critical role in scientific research and medical care. Existing high-performance deep learning methods typically rely on large training datasets with high-quality manual annotations, which are…

Image and Video Processing · Electrical Eng. & Systems 2021-11-17 Shanshan Wang , Cheng Li , Rongpin Wang , Zaiyi Liu , Meiyun Wang , Hongna Tan , Yaping Wu , Xinfeng Liu , Hui Sun , Rui Yang , Xin Liu , Jie Chen , Huihui Zhou , Ismail Ben Ayed , Hairong Zheng

Prepared domain specific datasets plays an important role to supervised learning approaches. In this article a new sentence dataset for software quality-in-use is proposed. Three experts were chosen to annotate the data using a proposed…

Software Engineering · Computer Science 2015-09-21 Issa Atoum , Chih How Bong , Narayanan Kulathuramaiyer

Fervent calls for more robust governance of the harms associated with artificial intelligence (AI) are leading to the adoption around the world of what regulatory scholars have called a management-based approach to regulation. Recent…

Artificial Intelligence · Computer Science 2024-06-28 Cary Coglianese , Colton R. Crum

Auditing plays a pivotal role in the development of trustworthy AI. However, current research primarily focuses on creating auditable AI documentation, which is intended for regulators and experts rather than end-users affected by AI…

Computers and Society · Computer Science 2023-05-31 Nicolas Scharowski , Michaela Benk , Swen J. Kühne , Léane Wettstein , Florian Brühlmann

Deploying successful software-reliant systems that address their mission goals and user needs within cost, resource, and expected quality constraints require design trade-offs. These trade-offs dictate how systems are structured and how…

Other Computer Science · Computer Science 2019-11-11 Lena Pons , Ipek Ozkaya

Autonomous vehicle (AV) systems rely on robust perception models as a cornerstone of safety assurance. However, objects encountered on the road exhibit a long-tailed distribution, with rare or unseen categories posing challenges to a…

Computer Vision and Pattern Recognition · Computer Science 2024-03-27 Mingfu Liang , Jong-Chyi Su , Samuel Schulter , Sparsh Garg , Shiyu Zhao , Ying Wu , Manmohan Chandraker

Fact verification is a critical yet underexplored component of non-litigation legal practice. While existing research has examined automation in legal workflow and human-AI collaboration in high-stakes domains, little is known about how…

Human-Computer Interaction · Computer Science 2026-02-10 Sirui Han , Yuyao Zhang , Yidan Huang , Xueyan Li , Chengzhong Liu , Yike Guo

Weak alignment of requirements engineering (RE) with verification and validation (VV) may lead to problems in delivering the required products in time with the right quality. For example, weak communication of requirements changes to…

This report presents the design and implementation of a semi-automated data annotation pipeline developed within the DARTS project, whose goal is to create a large-scale, multimodal dataset of driving scenarios recorded in Polish…

Artificial Intelligence · Computer Science 2026-01-01 Andrii Gamalii , Daniel Górniak , Robert Nowak , Bartłomiej Olber , Krystian Radlak , Jakub Winter

Explainability has become a crucial non-functional requirement to enhance transparency, build user trust, and ensure regulatory compliance. However, translating explanation needs expressed in user feedback into structured requirements and…

In an era characterized by the pervasive integration of artificial intelligence into decision-making processes across diverse industries, the demand for trust has never been more pronounced. This thesis embarks on a comprehensive…

Machine Learning · Statistics 2024-01-18 Alessandro Castelnovo

The Semantic Web is an extension of the current web in which information is given well-defined meaning. The perspective of Semantic Web is to promote the quality and intelligence of the current web by changing its contents into machine…

Artificial Intelligence · Computer Science 2012-08-06 Hamed Hassanzadeh , MohammadReza Keyvanpour

Relation extraction (RE) aims to extract relations from sentences and documents. Existing relation extraction models typically rely on supervised machine learning. However, recent studies showed that many RE datasets are incompletely…

Computation and Language · Computer Science 2023-06-19 Qingyu Tan , Lu Xu , Lidong Bing , Hwee Tou Ng

Integration of AI into environmental regulation represents a significant advancement in data management. It offers promising results in both data protection plus algorithmic fairness. This research addresses the critical need for…

Computers and Society · Computer Science 2026-02-10 Sahibpreet Singh , Saksham Sharma

Despite Artificial Intelligence (AI) transformative potential for public sector services, decision-making, and administrative efficiency, adoption remains uneven due to complex technical, organizational, and institutional challenges.…

Requirements Engineering (RE) plays a pivotal role in software development, encompassing tasks such as requirements elicitation, analysis, specification, and change management. Despite its critical importance, RE faces challenges including…

Software Engineering · Computer Science 2024-09-04 Malik Abdul Sami , Muhammad Waseem , Zheying Zhang , Zeeshan Rasheed , Kari Systä , Pekka Abrahamsson

As AI models tackle increasingly complex problems, ensuring reliable human oversight becomes more challenging due to the difficulty of verifying solutions. Approaches to scaling AI supervision include debate, in which two agents engage in…

Artificial Intelligence · Computer Science 2025-04-01 Gabriel Recchia , Chatrik Singh Mangat , Issac Li , Gayatri Krishnakumar

AI systems in high-consequence domains such as defense, intelligence, and disaster response must detect rare, high-impact events while operating under tight resource constraints. Traditional annotation strategies that prioritize label…

Machine Learning · Computer Science 2025-05-22 Dave Cook , Tim Klawa

Image labeling is a critical bottleneck in the development of computer vision technologies, often constraining machine learning performance due to the time-intensive nature of manual annotations. This work introduces a novel approach that…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Amir Kazemi , Qurat ul ain Fatima , Volodymyr Kindratenko , Christopher W. Tessum