Evaluation

The models that make it to this stage are of high quality as indicated by performance on the validation data. During evaluation, the models are examined in more detail typically using an outsample of representative data previously unseen by the models. The behaviour of the model is observed by numerous stakeholders against key business objectives to determine whether all important issues have been addressed (eg does the model allow too many false negatives, which for a medical diagnostics system would be potentially intolerable). Decision documentation will be produced outlining reasons for accepting or rejecting further use of the model.