Secure Aggregation for Federated Learning: An ACM CCS 2017 Talk

Added:

The Privacy-Robustness Trade-off and Overhead of Secure Aggregation

While Secure Aggregation (SecAgg) protects user privacy by ensuring the central server only sees aggregated updates, it introduces a critical security vulnerability: susceptibility to poisoning attacks. Because individual updates are cryptographically masked, the server cannot inspect them to perform anomaly detection or filter out malicious contributions. Consequently, adversarial clients can inject poisoned data or backdoors into the global model undetected. Additionally, SecAgg imposes significant communication and computational overhead due to complex cryptographic operations, such as secret sharing and key agreement. This overhead can be prohibitive for resource-constrained edge and mobile devices, presenting a major bottleneck for practical, large-scale deployments.

Fundamentals of Federated Learning (FL), specifically how decentralized training works and the role of the central coordinating server.
Basic cryptographic concepts including secret sharing schemes (e.g., Shamir's Secret Sharing), symmetric encryption, and Diffie-Hellman key exchange.
An understanding of privacy risks in machine learning, specifically how gradient updates can leak sensitive user data to a curious server.
Basic distributed systems concepts, particularly client-server architecture and the practical challenges of network latency and device dropouts.
Combining Secure Aggregation with Differential Privacy (DP) to achieve mathematically rigorous privacy guarantees against reconstruction attacks.
Advanced and highly scalable Secure Aggregation protocols (such as SecAgg+ or FastSecAgg) that optimize communication overhead and computational complexity.
Robustness against malicious adversaries, focusing on Byzantine fault tolerance and detecting model poisoning attacks within secure communication channels.
Practical deployment of secure federated learning pipelines using production-grade frameworks like TensorFlow Federated (TFF), PySyft, or FATE.
4.5K views74likes22:27@associationofcomputingmach2690Original Release: 2018-02-08

This video introduces a practical secure aggregation protocol for federated learning that enables a server to compute the sum of client model updates without learning individual contributions, addressing privacy concerns in distributed machine learning. The protocol uses Diffie-Hellman key agreement to generate masking vectors between client pairs, combined with threshold secret sharing to handle client dropouts, achieving less than double the bandwidth overhead of naive approaches while maintaining security against honest-but-curious adversaries and tolerating up to one-third of clients dropping out.