SRV_server's accuracy higher than SRV_server_best #218
-
Hi, I encountered a small problem while doing cross validate. |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment 1 reply
-
The "best" global model is chosen based on the average validation scores from each client. This score is computed before each local training to when the client receives the current global model. This means also we can only select the best global model of the previous round using |
Beta Was this translation helpful? Give feedback.
The "best" global model is chosen based on the average validation scores from each client. This score is computed before each local training to when the client receives the current global model. This means also we can only select the best global model of the previous round using
[InTimeModelSelectionHandler](https://github.com/NVIDIA/NVFlare/blob/main/nvflare/app_common/handlers/intime_model_selection_handler.py)
after the client sends their model updates and scores of the previous global model. Therefore, it could be that your training is still converging and the final global model (SRV_server) is better than the selected best model (SRV_server_best).