中文
相关论文

相关论文: Open-Source Tool for Evaluating Human-Generated vs…

200 篇论文

The lack of annotated datasets is a major bottleneck for training new task-specific supervised machine learning models, considering that manual annotation is extremely expensive and time-consuming. To address this problem, we present MONAI…

Automated deidentification of clinical text data is crucial due to the high cost of manual deidentification, which has been a barrier to sharing clinical text and the advancement of clinical natural language processing. However, creating…

计算与语言 · 计算机科学 2023-11-07 Callandra Moore , Jonathan Ranisau , Walter Nelson , Jeremy Petch , Alistair Johnson

Recent advances in data-centric medical AI have produced highly accurate diagnostic systems, but the emphasis on data curation and performance metrics has not translated into widespread clinical adoption. We conjecture that this limited…

We introduce SHEET, a multi-purpose open-source toolkit designed to accelerate subjective speech quality assessment (SSQA) research. SHEET stands for the Speech Human Evaluation Estimation Toolkit, which focuses on data-driven deep neural…

声音 · 计算机科学 2025-05-22 Wen-Chin Huang , Erica Cooper , Tomoki Toda

With the growing use of language models (LMs) in clinical environments, there is an immediate need to evaluate the accuracy and safety of LM-generated medical text. Currently, such evaluation relies solely on manual physician review.…

Responsible design of AI systems is a shared goal across HCI and AI communities. Responsible AI (RAI) tools have been developed to support practitioners to identify, assess, and mitigate ethical issues during AI development. These tools…

人机交互 · 计算机科学 2024-02-01 Glen Berman , Nitesh Goyal , Michael Madaio

We introduce Docling, an easy-to-use, self-contained, MIT-licensed, open-source toolkit for document conversion, that can parse several types of popular document formats into a unified, richly structured representation. It is powered by…

Background: Clinical documentation represents a significant burden for healthcare providers, with physicians spending up to 2 hours daily on administrative tasks. Recent advances in large language models (LLMs) offer promising solutions,…

计算与语言 · 计算机科学 2025-07-08 Johnson Thomas , Ayush Mudgal , Wendao Liu , Nisten Tahiraj , Zeeshaan Mohammed , Dhruv Diddi

With advances in generative artificial intelligence (AI), it is now possible to produce realistic-looking automated reports for preliminary reads of radiology images. This can expedite clinical workflows, improve accuracy and reduce overall…

人工智能 · 计算机科学 2025-06-03 Razi Mahmood , Diego Machado Reyes , Ge Wang , Mannudeep Kalra , Pingkun Yan

Physicians spend significant time documenting clinical encounters, a burden that contributes to professional burnout. To address this, robust automation tools for medical documentation are crucial. We introduce MedSynth -- a novel dataset…

计算与语言 · 计算机科学 2025-08-05 Ahmad Rezaie Mianroodi , Amirali Rezaie , Niko Grisel Todorov , Cyril Rakovski , Frank Rudzicz

Usability inspection is a well-established technique for identifying interaction issues in software interfaces, thereby contributing to improved product quality. However, it is a costly process that requires time and specialized knowledge…

软件工程 · 计算机科学 2025-10-21 Luis F. G. Campos , Leonardo C. Marques , Walter T. Nakamura

Authorship Analysis, also known as stylometry, has been an essential aspect of Natural Language Processing (NLP) for a long time. Likewise, the recent advancement of Large Language Models (LLMs) has made authorship analysis increasingly…

计算与语言 · 计算机科学 2023-10-26 Nafis Irtiza Tripto , Adaku Uchendu , Thai Le , Mattia Setzu , Fosca Giannotti , Dongwon Lee

Understanding and reasoning over academic handwritten notes remains a challenge in document AI, particularly for mathematical equations, diagrams, and scientific notations. Existing visual question answering (VQA) benchmarks focus on…

计算机视觉与模式识别 · 计算机科学 2025-04-15 Aniket Pal , Sanket Biswas , Alloy Das , Ayush Lodh , Priyanka Banerjee , Soumitri Chattopadhyay , Dimosthenis Karatzas , Josep Llados , C. V. Jawahar

Clinical notes are an efficient way to record patient information but are notoriously hard to decipher for non-experts. Automatically simplifying medical text can empower patients with valuable information about their health, while saving…

Human-AI interfaces play a pivotal role in integrating clinicians' expertise with artificial intelligence to enhance both healthcare practice and research. However, designing effective interfaces in this domain remains a significant…

人机交互 · 计算机科学 2026-01-21 Rui Sheng , Chuhan Shi , Sobhan Lotfi , Shiyi Liu , Adam Perer , Huamin Qu , Furui Cheng

Objective: Clinical notes contain information not present elsewhere, including drug response and symptoms, all of which are highly important when predicting key outcomes in acute care patients. We propose the automatic annotation of…

计算与语言 · 计算机科学 2021-11-25 Jingqing Zhang , Luis Bolanos , Ashwani Tanwar , Julia Ive , Vibhor Gupta , Yike Guo

The rapid advancement of large language models (LLMs) has led to increasingly human-like AI-generated text, raising concerns about content authenticity, misinformation, and trustworthiness. Addressing the challenge of reliably detecting…

ChatGPT has enabled access to AI-generated writing for the masses, and within just a few months, this product has disrupted the knowledge economy, initiating a culture shift in the way people work, learn, and write. The need to discriminate…

机器学习 · 计算机科学 2023-03-30 Heather Desaire , Aleesa E. Chua , Madeline Isom , Romana Jarosova , David Hua

Some traits making a "good" AI model are hard to describe upfront. For example, should responses be more polite or more casual? Such traits are sometimes summarized as model character or personality. Without a clear objective, conventional…

计算与语言 · 计算机科学 2025-10-01 Arduin Findeis , Timo Kaufmann , Eyke Hüllermeier , Robert Mullins

Qualitative analysis is critical to understanding human datasets in many social science disciplines. A central method in this process is inductive coding, where researchers identify and interpret codes directly from the datasets themselves.…