English
Related papers

Related papers: Measuring Human Involvement in AI-Generated Text: …

200 papers

The challenge of separating AI-generated text from human-authored content is becoming more urgent as generative AI technologies like ChatGPT become more widely available. In this work, we address this issue by looking at both the detection…

A wide variety of NLP applications, such as machine translation, summarization, and dialog, involve text generation. One major challenge for these applications is how to evaluate whether such generated texts are actually fluent, accurate,…

Computation and Language · Computer Science 2021-10-28 Weizhe Yuan , Graham Neubig , Pengfei Liu

Large Language Models (LLMs) are gearing up to surpass human creativity. The veracity of the statement needs careful consideration. In recent developments, critical questions arise regarding the authenticity of human work and the…

Computation and Language · Computer Science 2025-09-29 Sai Teja Lekkala , Yadagiri Annepaka , Arun Kumar Challa , Samatha Reddy Machireddy , Partha Pakray , Chukhu Chunka

The ability to research and synthesize knowledge is central to human expertise and progress. A new class of AI systems--designed for generative research synthesis--aims to automate this process by retrieving information from the live web…

Computation and Language · Computer Science 2026-02-10 Liana Patel , Negar Arabzadeh , Harshit Gupta , Ankita Sundar , Ion Stoica , Matei Zaharia , Carlos Guestrin

Recent advances in generative AI technologies like large language models raise both excitement and concerns about the future of human-AI co-creation in writing. To unpack people's attitude towards and experience with generative AI-powered…

Human-Computer Interaction · Computer Science 2024-03-19 Zhuoyan Li , Chen Liang , Jing Peng , Ming Yin

High-stakes applications rely on combining Artificial Intelligence (AI) and humans for responsive and reliable decision making. For example, content moderation in social media platforms often employs an AI-human pipeline to promptly remove…

Machine Learning · Computer Science 2025-08-14 Thodoris Lykouris , Wentao Weng

The rapid adoption of generative AI tools is reshaping how scholars produce and communicate knowledge, raising questions about who benefits and who is left behind. We analyze over 230,000 Scopus-indexed computer science articles between…

Computers and Society · Computer Science 2025-09-11 Farhan Kamrul Khan , Hazem Ibrahim , Nouar Aldahoul , Talal Rahwan , Yasir Zaki

Since the rise of neural natural-language-to-code models (NL->Code) that can generate long expressions and statements rather than a single next-token, one of the major problems has been reliably evaluating their generated output. In this…

Software Engineering · Computer Science 2023-11-01 Shuyan Zhou , Uri Alon , Sumit Agarwal , Graham Neubig

Generative AI tools are increasingly entering academic peer review workflows, raising questions about fairness, accountability, and the legitimacy of evaluative judgment. While these systems promise efficiency gains amid growing reviewer…

Computers and Society · Computer Science 2026-03-24 Tatiana Chakravorti , Pranav Narayanan Venkit , Sourojit Ghosh , Sarah Rajtmajer

As AI writing tools become widespread, we need to understand how both humans and machines evaluate literary style, a domain where objective standards are elusive and judgments are inherently subjective. We conducted controlled experiments…

Artificial Intelligence · Computer Science 2025-10-13 Wouter Haverals , Meredith Martin

Generative AI (GenAI) use in research writing is growing fast. However, it is unclear how peer reviewers recognize or misjudge AI-augmented manuscripts. To investigate the impact of AI-augmented writing on peer reviews, we conducted a…

Computation and Language · Computer Science 2025-09-22 Hilda Hadan , Derrick Wang , Reza Hadi Mogavi , Joseph Tu , Leah Zhang-Kennedy , Lennart E. Nacke

Generative AI is reshaping higher education programming through vibe coding, where students collaborate with AI via natural language rather than writing code line-by-line. We conceptualize this practice as help-seeking, analyzing 19,418…

Artificial Intelligence · Computer Science 2026-05-01 Daiana Rinja , Eduardo Araujo Oliveira , Sonsoles López-Pernas , Mohammed Saqr , Marcus Specht , Kamila Misiejuk

As AI advances in text generation, human trust in AI generated content remains constrained by biases that go beyond concerns of accuracy. This study explores how bias shapes the perception of AI versus human generated content. Through three…

Computation and Language · Computer Science 2025-08-07 Tiffany Zhu , Iain Weissburg , Kexun Zhang , William Yang Wang

Text generated by artificial intelligence (AI) chatbots is increasingly used in English as a foreign language (EFL) writing contexts, yet its impact on students' expository writing process and compositions remains understudied. This…

Computation and Language · Computer Science 2025-07-30 David James Woo , Yangyang Yu , Kai Guo , Yilin Huang , April Ka Yeng Fung

Generative AI is rapidly transforming how organizations create value and evaluate talent. While large language models enhance baseline output quality, they simultaneously introduce ambiguity in assessing human creativity, as observable…

Human-Computer Interaction · Computer Science 2026-04-23 Yigal Rosen , Ilia Rushkin

Generative AI (GenAI) is increasingly used in academic writing, yet its effects on students' writing self-efficacy remain contingent on how assistance is configured. This pilot study investigates how ideation-level, sentence-level,…

Human-Computer Interaction · Computer Science 2026-03-17 Yejoon Song , Bandi Kim , Yeju Kwon , Sung Park

With the rapid adoption of AI writing assistants in education, educators and researchers need empirical evidence to understand the impact on student writing and inform effective pedagogical design. Despite widespread use, we lack systematic…

Human-Computer Interaction · Computer Science 2026-04-09 Andrew Jelson , Daniel Manesh , Sangwook Lee , Alice Jang , Daniel Dunlap , Tamara Maddox , Young-Ho Kim , Sang Won Lee

The increasing use of Generative Artificial Intelligence (GAI) tools in education highlights the need to understand their influence on individuals' thinking processes and agency. This research explored 20 university students' interaction…

Human-Computer Interaction · Computer Science 2024-12-02 Tianlong Zhong , Gaoxia Zhu , Kang You Lim , Yew Soon Ong

Background: Recently, ChatGPT and similar generative AI models have attracted hundreds of millions of users and become part of the public discourse. Many believe that such models will disrupt society and will result in a significant change…

Computation and Language · Computer Science 2023-04-28 Steffen Herbold , Annette Hautli-Janisz , Ute Heuer , Zlata Kikteva , Alexander Trautsch

This study evaluates $n = 300$ short-form physics essay submissions, equally divided between student work submitted before the introduction of ChatGPT and those generated by OpenAI's GPT-4. In blinded evaluations conducted by five…

Physics Education · Physics 2024-03-11 Will Yeadon , Elise Agra , Oto-obong Inyang , Paul Mackay , Arin Mizouri