| Title |
Privacy-Preservation In Distributed Deep Neural Networks Via Encryption Of Selected Gradients |
| ID_Doc |
43156 |
| Authors |
Emmanuel A.-B.; Zhou S.; Liao Y.; Liu Q. |
| Year |
2020 |
| Published |
Proceedings - 2020 IEEE 22nd International Conference on High Performance Computing and Communications, IEEE 18th International Conference on Smart City and IEEE 6th International Conference on Data Science and Systems, HPCC-SmartCity-DSS 2020 |
| DOI |
http://dx.doi.org/10.1109/HPCC-SmartCity-DSS50907.2020.00107 |
| Abstract |
In this paper, privacy preservation in Distributed Deep Neural Networks (DDNN) is re-visited. We focus on the use of Homomorphic Encryption (HE) in the DDNN. Although HE provides some level of effective way to bring privacy to the DDNN, its use is usually associated with high overheads, especially communication cost between the Honest-but-Curious (HbC) cloud server and participants. To this end, we propose an alternative approach for privacy preservation in the DDNN. Ability to select and encrypt selected gradients homomorphically, is the main appeal of this paper and has proven to provide good privacy, reduce communication cost to a considerable level (ie. 0.04MB and 0.13MB when 1% and 10% of total gradients are selected, encrypted and shared respectively) whilst maintaining acceptable level of accuracy. A learning with error (LWE) based additive Homomorphic Encryption is used and comparison is made with closely related works to show how efficient our approach is. Furthermore, we propose the use of non-malleable code to protect the integrity of ciphertexts that are transmitted between participants and the HbC cloud server. This paper is the first to combine partial sharing and Homomorphic Encryption in the DDNN. © 2020 IEEE. |
| Author Keywords |
Additively Homomorphic Encryption; Distributed Deep Neural Networks; LWE-based encryption; Privacy |
