Visible to the public Federated Learning with Bayesian Differential Privacy

TitleFederated Learning with Bayesian Differential Privacy
Publication TypeConference Paper
Year of Publication2019
AuthorsTriastcyn, Aleksei, Faltings, Boi
Conference Name2019 IEEE International Conference on Big Data (Big Data)
KeywordsBayes methods, Bayesian differential privacy, Bayesian privacy accounting method, composability, Computational modeling, data privacy, Deep Learning, Differential privacy, federated learning, federated setting, formal privacy guarantees, Human Behavior, image classification, image classification tasks, learning (artificial intelligence), machine learning, privacy, privacy accounting, privacy budget, pubcrawl, Resiliency, Scalability, Servers, sharper privacy loss
AbstractWe consider the problem of reinforcing federated learning with formal privacy guarantees. We propose to employ Bayesian differential privacy, a relaxation of differential privacy for similarly distributed data, to provide sharper privacy loss bounds. We adapt the Bayesian privacy accounting method to the federated setting and suggest multiple improvements for more efficient privacy budgeting at different levels. Our experiments show significant advantage over the state-of-the-art differential privacy bounds for federated learning on image classification tasks, including a medical application, bringing the privacy budget below e = 1 at the client level, and below e = 0.1 at the instance level. Lower amounts of noise also benefit the model accuracy and reduce the number of communication rounds.
Citation Keytriastcyn_federated_2019