Non-IID data

Data across clients is not independently and identically distributed; heterogeneity is a structural condition, not noise. Any architecture assuming IID data or uniform device availability will underperform in realistic settings, motivating clustering, personalisation and heterogeneity-aware methods.

Relates to: Federated learning, Kairouz: advances and open problems.