English
Related papers

Related papers: Beyond Human-Only: Evaluating Human-Machine Collab…

200 papers

Borrowing ideas from {\em Production functions} in micro-economics, in this paper we introduce a framework to systematically evaluate the performance and cost trade-offs between machine-translated and manually-created labelled data for…

Computation and Language · Computer Science 2022-11-15 Kabir Ahuja , Monojit Choudhury , Sandipan Dandapat

We demonstrate the potential of few-shot translation systems, trained with unpaired language data, for both high and low-resource language pairs. We show that with only 5 examples of high-quality translation data shown at inference, a…

Computation and Language · Computer Science 2023-02-06 Xavier Garcia , Yamini Bansal , Colin Cherry , George Foster , Maxim Krikun , Fangxiaoyu Feng , Melvin Johnson , Orhan Firat

Cross-language information retrieval (CLIR), where queries and documents are in different languages, needs a translation of queries and/or documents, so as to standardize both of them into a common representation. For this purpose, the use…

Computation and Language · Computer Science 2007-05-23 Atsushi Fujii , Tetsuya Ishikawa

One of the biggest challenges hindering progress in low-resource and multilingual machine translation is the lack of good evaluation benchmarks. Current evaluation benchmarks either lack good coverage of low-resource languages, consider…

Machine translation (MT) post-editing and research data collection often rely on inefficient, disconnected workflows. We introduce TranslationCorrect, an integrated framework designed to streamline these tasks. TranslationCorrect combines…

Computation and Language · Computer Science 2025-06-24 Syed Mekael Wasti , Shou-Yi Hung , Christopher Collins , En-Shiun Annie Lee

Machine Translation (MT) evaluation metrics assess translation quality automatically. Recently, researchers have employed MT metrics for various new use cases, such as data filtering and translation re-ranking. However, most MT metrics…

Computation and Language · Computer Science 2024-10-08 Stefano Perrella , Lorenzo Proietti , Pere-Lluís Huguet Cabot , Edoardo Barba , Roberto Navigli

Advances in machine learning have produced systems that attain human-level performance on certain visual tasks, e.g., object identification. Nonetheless, other tasks requiring visual expertise are unlikely to be entrusted to machines for…

Human-Computer Interaction · Computer Science 2016-12-28 Ronald T. Kneusel , Michael C. Mozer

With the introduction of collaborative robots, humans and robots can now work together in close proximity and share the same workspace. However, this collaboration presents various challenges that need to be addressed to ensure seamless…

Robotics · Computer Science 2023-07-24 Ali Noormohammadi-Asl , Ali Ayub , Stephen L. Smith , Kerstin Dautenhahn

We introduce translation error correction (TEC), the task of automatically correcting human-generated translations. Imperfections in machine translations (MT) have long motivated systems for improving translations post-hoc with automatic…

Computation and Language · Computer Science 2022-06-20 Jessy Lin , Geza Kovacs , Aditya Shastry , Joern Wuebker , John DeNero

Large language models (LLMs) have demonstrated impressive capabilities in general scenarios, exhibiting a level of aptitude that approaches, in some aspects even surpasses, human-level intelligence. Among their numerous skills, the…

Computation and Language · Computer Science 2023-11-30 Zhiwei He , Tian Liang , Wenxiang Jiao , Zhuosheng Zhang , Yujiu Yang , Rui Wang , Zhaopeng Tu , Shuming Shi , Xing Wang

New machine translations (MT) technologies are emerging rapidly and with them, bold claims of achieving human parity such as: (i) the results produced approach "accuracy achieved by average bilingual human translators" (Wu et al., 2017b) or…

Computation and Language · Computer Science 2020-04-01 Eva Vanmassenhove

In this paper, an extended combined approach of phrase based statistical machine translation (SMT), example based MT (EBMT) and rule based MT (RBMT) is proposed to develop a novel hybrid data driven MT system capable of outperforming the…

Computation and Language · Computer Science 2017-05-09 Omkar Dhariya , Shrikant Malviya , Uma Shanker Tiwary

Hybrid human/computer systems promise to greatly expand the usefulness of query processing by incorporating the crowd for data gathering and other tasks. Such systems raise many database system implementation questions. Perhaps most…

Databases · Computer Science 2012-02-13 Beth Trushkowsky , Tim Kraska , Michael J. Franklin , Purnamrita Sarkar

The recently released ChatGPT has demonstrated surprising abilities in natural language understanding and natural language generation. Machine translation relies heavily on the abilities of language understanding and generation. Thus, in…

Computation and Language · Computer Science 2023-04-24 Yuan Gao , Ruili Wang , Feng Hou

System combination is an important technique for combining the hypotheses of different machine translation systems to improve translation performance. Although early statistical approaches to system combination have been proven effective in…

Computation and Language · Computer Science 2020-07-15 Xuancheng Huang , Jiacheng Zhang , Zhixing Tan , Derek F. Wong , Huanbo Luan , Jingfang Xu , Maosong Sun , Yang Liu

We propose multi-way, multilingual neural machine translation. The proposed approach enables a single neural translation model to translate between multiple languages, with a number of parameters that grows only linearly with the number of…

Computation and Language · Computer Science 2016-01-07 Orhan Firat , Kyunghyun Cho , Yoshua Bengio

This paper proposes an efficient and semi-automated method for human-in-the-loop post-editing for machine translation (MT) corpus generation. The method is based on online training of a custom MT quality estimation metric on-the-fly as…

Computation and Language · Computer Science 2023-06-22 Kamer Ali Yuksel , Ahmet Gunduz , Shreyas Sharma , Hassan Sawaf

Document-level machine translation focuses on the translation of entire documents from a source to a target language. It is widely regarded as a challenging task since the translation of the individual sentences in the document needs to…

Computation and Language · Computer Science 2020-10-21 Inigo Jauregi Unanue , Nazanin Esmaili , Gholamreza Haffari , Massimo Piccardi

Humans rely more and more on systems with AI components. The AI community typically treats human inputs as a given and optimizes AI models only. This thinking is one-sided and it neglects the fact that humans can learn, too. In this work,…

Human-Computer Interaction · Computer Science 2020-09-22 Johannes Schneider

The growing prominence of large language models, such as GPT-4 and ChatGPT, has led to increased concerns over academic integrity due to the potential for machine-generated content and paraphrasing. Although studies have explored the…

Computation and Language · Computer Science 2023-03-27 Jonas Becker , Jan Philip Wahle , Terry Ruas , Bela Gipp