Fig. 7: Test accuracy and communication cost as functions of the communication round.
From: Selective knowledge sharing for privacy-preserving federated distillation without a good teacher
Our Selective-FD method has a comparable accuracy as FedAvg in the MNIST and CIFAR-10 datasets but is inferior in Fashion MNIST. However, Selective-FD achieves a significant reduction in the communication overhead, which is because the cost of model sharing in FedAvg is much higher than knowledge sharing in our method.
