Skip to Main content Skip to Navigation
Conference papers

Compression Boosts Differentially Private Federated Learning

Raouf Kerkouche 1 Gergely Ács 2 Claude Castelluccia 1 Pierre Genevès 3
1 PRIVATICS - Privacy Models, Architectures and Tools for the Information Society
Inria Grenoble - Rhône-Alpes, CITI - CITI Centre of Innovation in Telecommunications and Integration of services
3 TYREX - Types and Reasoning for the Web
Inria Grenoble - Rhône-Alpes, LIG - Laboratoire d'Informatique de Grenoble
Abstract : Federated Learning allows distributed entities to train a common model collaboratively without sharing their own data. Although it prevents data collection and aggregation by exchanging only parameter updates, it remains vulnerable to various inference and reconstruction attacks where a malicious entity can learn private information about the participants’ training data from the captured gradients. Differential Privacy is used to obtain theoretically sound privacy guarantees against such inference attacks by noising the exchanged update vectors. However, the added noise is proportional to the model size which can be very large with modern neural networks. This can result in poor model quality. In this paper, compressive sensing is used to reduce the model size and hence increase model quality without sacrificing privacy. We show experimentally, using 2 datasets, that our privacy-preserving proposal can reduce the communication costs by up to 95% with only a negligible performance penalty compared to traditional non-private federated learning schemes.
Complete list of metadata

https://hal.archives-ouvertes.fr/hal-03066941
Contributor : Raouf Kerkouche <>
Submitted on : Tuesday, December 15, 2020 - 2:56:50 PM
Last modification on : Thursday, March 25, 2021 - 11:34:01 AM
Long-term archiving on: : Tuesday, March 16, 2021 - 7:48:07 PM

File

Compressive_sensing_for_federa...
Files produced by the author(s)

Identifiers

  • HAL Id : hal-03066941, version 1

Collections

Citation

Raouf Kerkouche, Gergely Ács, Claude Castelluccia, Pierre Genevès. Compression Boosts Differentially Private Federated Learning. EuroS&P 2021 - 6th IEEE European Symposium on Security and Privacy, Sep 2021, Vienna, Austria. pp.1-15. ⟨hal-03066941⟩

Share

Metrics

Record views

162

Files downloads

63