Federated Learning & Differential Privacy for Mobile ML

Added:

The Resource-Utility-Privacy Trilemma in Mobile FL and DP

While Federated Learning (FL) and Differential Privacy (DP) are praised for protecting user data, critics highlight severe practical limitations known as the Resource-Utility-Privacy trilemma. To guarantee privacy, DP injects statistical noise, which often degrades model accuracy (utility) to unacceptable levels, especially in complex mobile applications. Additionally, FL demands significant communication bandwidth and local computation, causing rapid battery drain and high data costs on mobile devices. Researchers also point out that FL is not fully secure: it remains vulnerable to gradient reconstruction attacks that can expose raw user data, and model poisoning by malicious clients. As a result, alternative paradigms—such as centralized training within hardware-isolated Trusted Execution Environments (TEEs) or purely localized on-device learning—are argued to be more efficient and sometimes even more secure than the resource-heavy FL-DP framework.

Fundamental concepts of Machine Learning, including model training, gradient descent, and centralized data pipelines.
Basic understanding of mobile and edge computing limitations, such as bandwidth, battery consumption, and compute constraints.
Core principles of data security and privacy risks in traditional cloud-based machine learning (e.g., data leakage and centralized storage risks).
Elementary statistics and probability concepts, which are essential for understanding noise addition in privacy-preserving algorithms.
Advanced federated learning optimization algorithms, such as Federated Averaging (FedAvg), FedProx, and personalized federated learning.
Implementation of Secure Multi-Party Computation (SMPC) and Homomorphic Encryption as complementary cryptographic techniques to differential privacy.
Practical hands-on framework deployment using tools like TensorFlow Federated (TFF), PySyft, or Flower for mobile and IoT devices.
Analyzing threats and vulnerabilities in federated systems, such as model poisoning attacks, gradient leakage, and membership inference attacks.
17.1K views320likes31:29@DIMACS_CCICADAOriginal Release: 2018-06-25

Federated learning enables collaborative machine learning across decentralized mobile devices by having each device train a local model on its own data and only sharing aggregated updates with a central server, while differential privacy adds carefully calibrated noise to these updates to provide formal privacy guarantees, allowing organizations to improve models using distributed data without compromising individual user privacy.