English
Related papers

Related papers: Strong Copyright Protection for Language Models vi…

200 papers

Model fusion seeks to combine independently trained neural networks into a single model without retraining, but is complicated by representational divergence arising from permutation invariance, random initialization, and heterogeneous…

Machine Learning · Computer Science 2026-05-29 Phoomraphee Luenam , Andreas Spanopoulos , Amit Sant , Thomas Hofmann , Sotiris Anagnostidis , Sidak Pal Singh

Evaluating the degree of reproduction of copyright-protected content by language models (LMs) is of significant interest to the AI and legal communities. Although both literal and non-literal similarities are considered by courts when…

The fast development of large language models (LLMs) and popularization of cloud computing have led to increasing concerns on privacy safeguarding and data security of cross-cloud model deployment and training as the key challenges. We…

Cryptography and Security · Computer Science 2025-03-18 Ze Yang , Yihong Jin , Yihan Zhang , Juntian Liu , Xinhe Xu

Major data protection regulations all mention the "right to be forgotten," and that's what pushed federated unlearning (FU) techniques forward. But one stubborn issue remains: catastrophic forgetting--you erase the target knowledge, yet…

Machine Learning · Computer Science 2026-05-27 Hangyi Shen , Yizhi Pan , Tiansuo Li , Weiqi Jiang , Guanqun Sun

Attention-based recurrent neural encoder-decoder models present an elegant solution to the automatic speech recognition problem. This approach folds the acoustic model, pronunciation model, and language model into a single network and…

Audio and Speech Processing · Electrical Eng. & Systems 2018-11-08 Shubham Toshniwal , Anjuli Kannan , Chung-Cheng Chiu , Yonghui Wu , Tara N Sainath , Karen Livescu

Recent progress in diffusion models has profoundly enhanced the fidelity of image generation, but it has raised concerns about copyright infringements. While prior methods have introduced adversarial perturbations to prevent style…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Namhyuk Ahn , Wonhyuk Ahn , KiYoon Yoo , Daesik Kim , Seung-Hun Nam

The spread of various forms of offensive speech online is an important concern in social media. While platforms have been investing heavily in ways of coping with this problem, the question of privacy remains largely unaddressed. Models…

Computation and Language · Computer Science 2024-04-18 Marcos Zampieri , Damith Premasiri , Tharindu Ranasinghe

We focus on the problem of fusing two or more heterogeneous large language models (LLMs) to leverage their complementary strengths. One of the challenges of model fusion is high computational load, specifically in fine-tuning or aligning…

Computation and Language · Computer Science 2025-06-10 Cong Liu , Xiaojun Quan , Yan Pan , Liang Lin , Weigang Wu , Xu Chen

Neural Machine Translation (NMT) can be used to generate fluent output. As such, language models have been investigated for incorporation with NMT. In prior investigations, two models have been used: a translation model and a language…

Computation and Language · Computer Science 2019-09-12 Michiki Kurosawa , Mamoru Komachi

Scaling language models to longer contexts is essential for capturing rich dependencies across extended discourse. However, na\"ive context extension imposes significant computational and memory burdens, often resulting in inefficiencies…

Computation and Language · Computer Science 2026-02-03 Wenhao Li , Bangcheng Sun , Weihao Ye , Tianyi Zhang , Daohai Yu , Fei Chao , Rongrong Ji

Visual captioning aims to generate textual descriptions given images or videos. Traditionally, image captioning models are trained on human annotated datasets such as Flickr30k and MS-COCO, which are limited in size and diversity. This…

Computer Vision and Pattern Recognition · Computer Science 2021-03-01 Marimuthu Kalimuthu , Aditya Mogadala , Marius Mosbach , Dietrich Klakow

Image fusion aims to integrate complementary information from multiple input images acquired through various sources to synthesize a new fused image. Existing methods usually employ distinct constraint designs tailored to specific scenes,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Bing Cao , Xingxin Xu , Pengfei Zhu , Qilong Wang , Qinghua Hu

Large language models (LLMs) and generative AI have played a transformative role in computer research and applications. Controversy has arisen as to whether these models output copyrighted data, which can occur if the data the models are…

Machine Learning · Computer Science 2023-08-24 Timothy Chu , Zhao Song , Chiwun Yang

Advanced image fusion methods are devoted to generating the fusion results by aggregating the complementary information conveyed by the source images. However, the difference in the source-specific manifestation of the imaged scene content…

Computer Vision and Pattern Recognition · Computer Science 2024-02-09 Chunyang Cheng , Tianyang Xu , Xiao-Jun Wu , Hui Li , Xi Li , Zhangyong Tang , Josef Kittler

Currently, deep learning models are easily exposed to data leakage risks. As a distributed model, Split Learning thus emerged as a solution to address this issue. The model is splitted to avoid data uploading to the server and reduce…

Cryptography and Security · Computer Science 2025-03-10 Zhangting Lin , Mingfu Xue , Kewei Chen , Wenmao Liu , Xiang Gao , Leo Yu Zhang , Jian Wang , Yushu Zhang

In this paper, we propose a novel method for protecting convolutional neural network (CNN) models with a secret key set so that unauthorized users without the correct key set cannot access trained models. The method enables us to protect…

Computer Vision and Pattern Recognition · Computer Science 2021-06-01 AprilPyone MaungMaung , Hitoshi Kiya

Pre-trained Large Language Models (LLMs) have demonstrated remarkable capabilities but also pose risks by learning and generating copyrighted material, leading to significant legal and ethical concerns. In real-world scenarios, model owners…

Computation and Language · Computer Science 2025-02-12 Guangyao Dou , Zheyuan Liu , Qing Lyu , Kaize Ding , Eric Wong

Cross-lingual plagiarism (CLP) occurs when texts written in one language are translated into a different language and used without acknowledging the original sources. One of the most common methods for detecting CLP requires online machine…

Computation and Language · Computer Science 2018-01-04 Victor Thompson

Diffusion models have a tendency to exactly replicate their training data, especially when trained on small datasets. Most prior work has sought to mitigate this problem by imposing differential privacy constraints or masking parts of the…

Machine Learning · Computer Science 2024-09-12 Joshua Kazdan , Hao Sun , Jiaqi Han , Felix Petersen , Stefano Ermon

Memorization in large-scale text-to-image diffusion models poses significant security and intellectual property risks, enabling adversarial attribute extraction and the unauthorized reproduction of sensitive or proprietary features. While…

Machine Learning · Computer Science 2026-01-28 Divya Kothandaraman , Jaclyn Pytlarz