Non-IID data
Data across clients is not independently and identically distributed; heterogeneity is a structural condition, not noise. Any architecture assuming IID data or uniform device availability will underperform in realistic settings, motivating clustering, personalisation and heterogeneity-aware methods.
Relates to: Federated learning, Kairouz: advances and open problems.