English

Federated Learning of Socially Appropriate Agent Behaviours in Simulated Home Environments

Machine Learning 2024-03-13 v1 Artificial Intelligence Computers and Society Robotics

Abstract

As social robots become increasingly integrated into daily life, ensuring their behaviours align with social norms is crucial. For their widespread open-world application, it is important to explore Federated Learning (FL) settings where individual robots can learn about their unique environments while also learning from each others' experiences. In this paper, we present a novel FL benchmark that evaluates different strategies, using multi-label regression objectives, where each client individually learns to predict the social appropriateness of different robot actions while also sharing their learning with others. Furthermore, splitting the training data by different contexts such that each client incrementally learns across contexts, we present a novel Federated Continual Learning (FCL) benchmark that adapts FL-based methods to use state-of-the-art Continual Learning (CL) methods to continually learn socially appropriate agent behaviours under different contextual settings. Federated Averaging (FedAvg) of weights emerges as a robust FL strategy while rehearsal-based FCL enables incrementally learning the social appropriateness of robot actions, across contextual splits.

Keywords

Cite

@article{arxiv.2403.07586,
  title  = {Federated Learning of Socially Appropriate Agent Behaviours in Simulated Home Environments},
  author = {Saksham Checker and Nikhil Churamani and Hatice Gunes},
  journal= {arXiv preprint arXiv:2403.07586},
  year   = {2024}
}

Comments

Accepted at the Workshop on Lifelong Learning and Personalization in Long-Term Human-Robot Interaction (LEAP-HRI) at the 19th ACM/IEEE International Conference on Human-Robot Interaction (HRI), 2024