English
Related papers

Related papers: ATGen: Adversarial Reinforcement Learning for Test…

200 papers

Large Language Models (LLMs) are used for many tasks, including those related to coding. An important aspect of being able to utilize LLMs is the ability to assess their fitness for specific usages. The common practice is to evaluate LLMs…

Artificial Intelligence · Computer Science 2024-07-30 Marcel Zalmanovici , Orna Raz , Eitan Farchi , Iftach Freund

Intelligent assistants powered by Large Language Models (LLMs) can generate program and test code with high accuracy, boosting developers' and testers' productivity. However, there is a lack of studies exploring LLMs for testing Web APIs,…

Software Engineering · Computer Science 2024-09-09 André Pereira , Bruno Lima , João Pascoal Faria

Large language models (LLMs) are increasingly deployed as educational agents for automatic short answer grading (ASAG) in real-world educational environments, significantly boosting assessment efficiency and scalability. However, when these…

Cryptography and Security · Computer Science 2026-05-25 Xueyi Li , Zhuoneng Zhou , Zitao Liu , Yongdong Wu

Generative Adversarial Networks (GANs) have shown great promise recently in image generation. Training GANs for language generation has proven to be more difficult, because of the non-differentiable nature of generating text with recurrent…

Computation and Language · Computer Science 2017-12-22 Ofir Press , Amir Bar , Ben Bogin , Jonathan Berant , Lior Wolf

Large language models (LLMs) increasingly solve complex reasoning tasks via long chain-of-thought, but their forward-only autoregressive generation process is fragile; early token errors can cascade, which creates a clear need for…

Computation and Language · Computer Science 2025-10-06 Jian Mu , Qixin Zhang , Zhiyong Wang , Menglin Yang , Shuang Qiu , Chengwei Qin , Zhongxiang Dai , Yao Shu

Recent advancements in large language models (LLMs) have sparked significant interest in the automatic generation of Register Transfer Level (RTL) designs, particularly using Verilog. Current research on this topic primarily focuses on…

Hardware Architecture · Computer Science 2025-04-22 Ning Wang , Bingkun Yao , Jie Zhou , Xi Wang , Zhe Jiang , Nan Guan

With the wide application of large language models (LLMs), the problems of bias and value inconsistency in sensitive domains have gradually emerged, especially in terms of race, society and politics. In this paper, we propose an adversarial…

Computation and Language · Computer Science 2026-01-23 Yuan Gao , Zhigang Liu , Xinyu Yao , Bo Chen , Xiaobing Zhao

Developing the logic necessary to solve mathematical problems or write mathematical proofs is one of the more difficult objectives for large language models (LLMS). Currently, the most popular methods in literature consists of fine-tuning…

Machine Learning · Computer Science 2025-02-11 Tianbo Yang , Mingqi Yan , Hongyi Zhao , Tianshuo Yang

Adversarial prompts generated using gradient-based methods exhibit outstanding performance in performing automatic jailbreak attacks against safety-aligned LLMs. Nevertheless, due to the discrete nature of texts, the input gradient of LLMs…

Cryptography and Security · Computer Science 2024-11-04 Qizhang Li , Yiwen Guo , Wangmeng Zuo , Hao Chen

Inferring the latent variable generating a given test sample is a challenging problem in Generative Adversarial Networks (GANs). In this paper, we propose InvGAN - a novel framework for solving the inference problem in GANs, which involves…

Machine Learning · Computer Science 2019-12-02 Wei-An Lin , Yogesh Balaji , Pouya Samangouei , Rama Chellappa

Adversarial purification is a defense mechanism for safeguarding classifiers against adversarial attacks without knowing the type of attacks or training of the classifier. These techniques characterize and eliminate adversarial…

Cryptography and Security · Computer Science 2024-02-13 Raha Moraffah , Shubh Khandelwal , Amrita Bhattacharjee , Huan Liu

Recent research has shown that Large Language Models (LLMs) are vulnerable to automated jailbreak attacks, where adversarial suffixes crafted by algorithms appended to harmful queries bypass safety alignment and trigger unintended…

Computation and Language · Computer Science 2025-11-10 Chung-En Sun , Xiaodong Liu , Weiwei Yang , Tsui-Wei Weng , Hao Cheng , Aidan San , Michel Galley , Jianfeng Gao

Dynamic adversarial question generation, where humans write examples to stump a model, aims to create examples that are realistic and informative. However, the advent of large language models (LLMs) has been a double-edged sword for human…

Computation and Language · Computer Science 2024-01-23 Yoo Yeon Sung , Ishani Mondal , Jordan Boyd-Graber

Retrieval-Augmented Generation (RAG) is a promising approach for mitigating the hallucination of large language models (LLMs). However, existing research lacks rigorous evaluation of the impact of retrieval-augmented generation on different…

Computation and Language · Computer Science 2023-12-21 Jiawei Chen , Hongyu Lin , Xianpei Han , Le Sun

Fine-tuning large language models (LLMs) for alignment typically relies on supervised fine-tuning or reinforcement learning from human feedback, both limited by the cost and scarcity of high-quality annotations. Recent self-play and…

Machine Learning · Computer Science 2026-02-03 Shiguang Wu , Yaqing Wang , Quanming Yao

Generative Adversarial Networks (GANs), as a framework for estimating generative models via an adversarial process, have attracted huge attention and have proven to be powerful in a variety of tasks. However, training GANs is well known for…

Machine Learning · Computer Science 2017-11-09 Zi-Yi Dou

Explainable fake news detection predicts the authenticity of news items with annotated explanations. Today, Large Language Models (LLMs) are known for their powerful natural language understanding and explanation generation abilities.…

Computation and Language · Computer Science 2024-12-25 Yifeng Wang , Zhouhong Gu , Siwei Zhang , Suhang Zheng , Tao Wang , Tianyu Li , Hongwei Feng , Yanghua Xiao

We study the robustness of reinforcement learning (RL) with adversarially perturbed state observations, which aligns with the setting of many adversarial attacks to deep reinforcement learning (DRL) and is also important for rolling out…

Machine Learning · Computer Science 2021-01-22 Huan Zhang , Hongge Chen , Duane Boning , Cho-Jui Hsieh

Large language models (LLMs) have shown impressive in-context learning (ICL) ability in code generation. LLMs take a prompt consisting of requirement-code examples and a new requirement as input, and output new programs. Existing studies…

Software Engineering · Computer Science 2023-10-17 Jia Li , Ge Li , Chongyang Tao , Jia Li , Huangzhao Zhang , Fang Liu , Zhi Jin

Retrieval-Augmented Generation allows to enhance Large Language Models with external knowledge. In response to the recent popularity of generative LLMs, many RAG approaches have been proposed, which involve an intricate number of different…

Computation and Language · Computer Science 2024-07-02 David Rau , Hervé Déjean , Nadezhda Chirkova , Thibault Formal , Shuai Wang , Vassilina Nikoulina , Stéphane Clinchant