English
Related papers

Related papers: A Multi-input Multi-output Transformer-based Hybri…

200 papers

Recent large-scale natural language processing (NLP) systems use a pre-trained Large Language Model (LLM) on massive and diverse corpora as a headstart. In practice, the pre-trained model is adapted to a wide array of tasks via fine-tuning…

Computation and Language · Computer Science 2022-09-12 Jimit Majmudar , Christophe Dupuy , Charith Peris , Sami Smaili , Rahul Gupta , Richard Zemel

Classification of personal text messages has many useful applications in surveillance, e-commerce, and mental health care, to name a few. Giving applications access to personal texts can easily lead to (un)intentional privacy violations. We…

Cryptography and Security · Computer Science 2021-03-15 Devin Reich , Ariel Todoki , Rafael Dowsley , Martine De Cock , Anderson C. A. Nascimento

Natural language reflects our private lives and identities, making its privacy concerns as broad as those of real life. Language models lack the ability to understand the context and sensitivity of text, and tend to memorize phrases present…

Machine Learning · Statistics 2022-02-15 Hannah Brown , Katherine Lee , Fatemehsadat Mireshghallah , Reza Shokri , Florian Tramèr

In this paper, we propose a generative knowledge transfer technique that trains an RNN based language model (student network) using text and output probabilities generated from a previously trained RNN (teacher network). The text generation…

Machine Learning · Computer Science 2017-03-01 Sungho Shin , Kyuyeon Hwang , Wonyong Sung

The phenomenal growth on the internet has helped in empowering individual's expressions, but the misuse of freedom of expression has also led to the increase of various cyber crimes and anti-social activities. Hate speech is one such issue…

Computation and Language · Computer Science 2020-06-01 Prashant Kapil , Asif Ekbal , Dipankar Das

This paper describes a testing methodology for quantitatively assessing the risk that rare or unique training-data sequences are unintentionally memorized by generative sequence models---a common type of machine-learning model. Because such…

Machine Learning · Computer Science 2019-07-17 Nicholas Carlini , Chang Liu , Úlfar Erlingsson , Jernej Kos , Dawn Song

With the rapid development of mobile Internet technology and the widespread use of mobile devices, it becomes much easier for people to express their opinions on social media. The openness and convenience of social media platforms provide a…

Social and Information Networks · Computer Science 2020-06-11 Qi Huang , Junshuai Yu , Jia Wu , Bin Wang

The digital town hall of Twitter becomes a preferred medium of communication for individuals and organizations across the globe. Some of them reach audiences of millions, while others struggle to get noticed. Given the impact of social…

Social and Information Networks · Computer Science 2021-02-23 Damian Konrad Kowalczyk , Jan Larsen

Sarcasm Detection has enjoyed great interest from the research community, however the task of predicting sarcasm in a text remains an elusive problem for machines. Past studies mostly make use of twitter datasets collected using hashtag…

Machine Learning · Computer Science 2022-10-17 Rishabh Misra , Prahal Arora

Sentiment analysis is a crucial task in natural language processing (NLP) that enables the extraction of meaningful insights from textual data, particularly from dynamic platforms like Twitter and IMDB. This study explores a hybrid…

Computation and Language · Computer Science 2026-03-02 Aish Albladi , Md Kaosar Uddin , Minarul Islam , Cheryl Seals

When training a machine learning model, it is standard procedure for the researcher to have full knowledge of both the data and model. However, this engenders a lack of trust between data owners and data scientists. Data owners are…

Cryptography and Security · Computer Science 2020-09-24 Will Abramson , Adam James Hall , Pavlos Papadopoulos , Nikolaos Pitropakis , William J Buchanan

The openness feature of Twitter allows programs to generate and control Twitter accounts automatically via the Twitter API. These accounts, which are known as bots, can automatically perform actions such as tweeting, re-tweeting, following,…

Cryptography and Security · Computer Science 2021-09-09 Christopher Braker , Stavros Shiaeles , Gueltoum Bendiab , Nick Savage , Konstantinos Limniotis

As network data has become increasingly prevalent, a substantial amount of attention has been paid to the privacy issue in publishing network data. One of the critical challenges for data publishers is to preserve the topological structures…

Methodology · Statistics 2024-06-24 Yaoming Zhen , Shirong Xu , Junhui Wang

Large language models (LLMs) exhibit remarkable capabilities in understanding and generating natural language. However, these models can inadvertently memorize private information, posing significant privacy risks. This study addresses the…

Computation and Language · Computer Science 2024-09-17 Zhenhua Liu , Tong Zhu , Chuanyuan Tan , Wenliang Chen

The application of Differential Privacy to Natural Language Processing techniques has emerged in relevance in recent years, with an increasing number of studies published in established NLP outlets. In particular, the adaptation of…

Computation and Language · Computer Science 2024-04-05 Stephen Meisenbacher , Nihildev Nandakumar , Alexandra Klymenko , Florian Matthes

The fast development of large language models (LLMs) and popularization of cloud computing have led to increasing concerns on privacy safeguarding and data security of cross-cloud model deployment and training as the key challenges. We…

Cryptography and Security · Computer Science 2025-03-18 Ze Yang , Yihong Jin , Yihan Zhang , Juntian Liu , Xinhe Xu

Sentiment analysis is crucial for understanding public opinion and consumer behavior. Existing models face challenges with linguistic diversity, generalizability, and explainability. We propose TRABSA, a hybrid framework integrating…

Computation and Language · Computer Science 2024-11-05 Md Abrar Jahin , Md Sakib Hossain Shovon , M. F. Mridha , Md Rashedul Islam , Yutaka Watanobe

Graph convolutional networks (GCNs) are a powerful architecture for representation learning on documents that naturally occur as graphs, e.g., citation or social networks. However, sensitive personal information, such as documents with…

Social and Information Networks · Computer Science 2022-05-03 Timour Igamberdiev , Ivan Habernal

Social networking sites, blogs, and online articles are instant sources of news for internet users globally. However, in the absence of strict regulations mandating the genuineness of every text on social media, it is probable that some of…

Computation and Language · Computer Science 2022-12-08 Arjun Choudhry , Inder Khatri , Minni Jain , Dinesh Kumar Vishwakarma

Social media text data are often used to train Machine Learning (ML) models to identify users exhibiting high-risk mental health behaviors. However, sharing this sensitive data poses privacy risks and limits the growth of benchmark…

Machine Learning · Computer Science 2026-05-20 Nuredin Ali Abdelkadir , Anjali Ratnam , Zeerak Talat , Stevie Chancellor