English
Related papers

Related papers: Towards General Error Diagnosis via Behavioral Tes…

200 papers

In recent years, large language models have made significant advancements in the field of natural language processing, yet there are still inadequacies in specific domain knowledge and applications. This paper Proposes MaintAGT, a…

Signal Processing · Electrical Eng. & Systems 2024-12-03 Hongliang He , Jinfeng Huang , Qi Li , Xu Wang , Feibin Zhang , Kangding Yang , Li Meng , Fulei Chu

In recent years, with the rapid development of deep learning technology, large language models (LLMs) such as BERT and GPT have achieved breakthrough results in natural language processing tasks. Machine translation (MT), as one of the core…

Computation and Language · Computer Science 2024-08-07 Yan Huang , Wei Liu

In recent years, there has been increased interest in building predictive models that harness natural language processing and machine learning techniques to detect emotions from various text sources, including social media posts,…

Computation and Language · Computer Science 2022-12-20 Sourabh Zanwar , Daniel Wiechmann , Yu Qiao , Elma Kerz

Detecting Machine-Generated Text (MGT) has emerged as a significant area of study within Natural Language Processing. While language models generate text, they often leave discernible traces, which can be scrutinized using either…

One of the major challenges of machine translation (MT) is ambiguity, which can in some cases be resolved by accompanying context such as images. However, recent work in multimodal MT (MMT) has shown that obtaining improvements from images…

Computation and Language · Computer Science 2023-05-29 Matthieu Futeral , Cordelia Schmid , Ivan Laptev , Benoît Sagot , Rachel Bawden

Large Language Models (LLMs) especially ChatGPT have produced impressive results in various areas, but their potential human-like psychology is still largely unexplored. Existing works study the virtual personalities of LLMs but rarely…

Computation and Language · Computer Science 2023-10-16 Haocong Rao , Cyril Leung , Chunyan Miao

Neural machine translation (NMT) has progressed rapidly in the past few years, promising improvements and quality translations for different languages. Evaluation of this task is crucial to determine the quality of the translation. Overall,…

Computation and Language · Computer Science 2024-03-07 Carinne Cherf , Yuval Pinter

In this paper, we focus on how current Machine Translation (MT) tools perform on the translation of emotion-loaded texts by evaluating outputs from Google Translate according to a framework proposed in this paper. We propose this evaluation…

Computation and Language · Computer Science 2023-06-22 Shenbin Qian , Constantin Orasan , Felix do Carmo , Qiuliang Li , Diptesh Kanojia

A major challenge in the practical use of Machine Translation (MT) is that users lack guidance to make informed decisions about when to rely on outputs. Progress in quality estimation research provides techniques to automatically assess MT…

Computation and Language · Computer Science 2023-10-27 Nikita Mehandru , Sweta Agrawal , Yimin Xiao , Elaine C Khoong , Ge Gao , Marine Carpuat , Niloufar Salehi

Gender-neutral translation (GNT) that avoids biased and undue binary assumptions is a pivotal challenge for the creation of more inclusive translation technologies. Advancements for this task in Machine Translation (MT), however, are…

Computation and Language · Computer Science 2024-02-12 Beatrice Savoldi , Andrea Piergentili , Dennis Fucci , Matteo Negri , Luisa Bentivogli

Machine translation (MT) systems translate text between different languages by automatically learning in-depth knowledge of bilingual lexicons, grammar and semantics from the training examples. Although neural machine translation (NMT) has…

Computation and Language · Computer Science 2020-04-29 Shilin He , Xing Wang , Shuming Shi , Michael R. Lyu , Zhaopeng Tu

Our ability to efficiently and accurately evaluate the quality of machine translation systems has been outrun by the effectiveness of current language models--which limits the potential for further improving these models on more challenging…

Computation and Language · Computer Science 2025-09-25 Syeda Jannatus Saba , Steven Skiena

Machine Translation (MT) Evaluation is an integral part of the MT development life cycle. Without analyzing the outputs of MT engines, it is impossible to evaluate the performance of an MT system. Through experiments, it has been identified…

Computation and Language · Computer Science 2025-10-08 Nisheeth Joshi , Pragya Katyayan , Palak Arora

In an attempt to improve overall translation quality, there has been an increasing focus on integrating more linguistic elements into Machine Translation (MT). While significant progress has been achieved, especially recently with neural…

Computation and Language · Computer Science 2018-10-09 Karin Sim Smith , Lucia Specia

Cross-lingual transfer is important for developing high-quality chatbots in multiple languages due to the strongly imbalanced distribution of language resources. A typical approach is to leverage off-the-shelf machine translation (MT)…

Computation and Language · Computer Science 2023-05-23 Lei Shen , Shuai Yu , Xiaoyu Shen

We perform neural machine translation of sentence fragments in order to create large amounts of training data for English grammatical error correction. Our method aims at simulating mistakes made by second language learners, and produces a…

Computation and Language · Computer Science 2021-04-21 Eetu Sjöblom , Mathias Creutz , Teemu Vahtola

Widely used learned metrics for machine translation evaluation, such as COMET and BLEURT, estimate the quality of a translation hypothesis by providing a single sentence-level score. As such, they offer little insight into translation…

Computation and Language · Computer Science 2023-10-17 Nuno M. Guerreiro , Ricardo Rei , Daan van Stigt , Luisa Coheur , Pierre Colombo , André F. T. Martins

The increasing volume of log data produced by software-intensive systems makes it impractical to analyze them manually. Many deep learning-based methods have been proposed for log-based anomaly detection. These methods face several…

Machine Learning · Computer Science 2023-09-06 Jiaxing Qi , Shaohan Huang , Zhongzhi Luan , Carol Fung , Hailong Yang , Depei Qian

Large language models have exhibited exceptional performance on various Natural Language Processing (NLP) tasks, leveraging techniques such as the pre-training, and instruction fine-tuning. Despite these advances, their effectiveness in…

Computation and Language · Computer Science 2023-06-19 Guangyu Wang , Guoxing Yang , Zongxin Du , Longjun Fan , Xiaohu Li

Recent advances in robot learning increasingly rely on LLM-based task planning, leveraging their ability to bridge natural language with executable actions. While prior works showcased great performances, the widespread adoption of these…

Robotics · Computer Science 2026-02-03 Riccardo Andrea Izzo , Gianluca Bardaro , Matteo Matteucci