Model selection versus predictive assessment

Knowledge package outline

Topic

Experimentation scientific reasoning and research methods

Purpose

Separates choosing a model from testing its generalisation.

Package contents

Training-validation-test diagrams; selection bias; held-out scores.

Dependencies

Statistics; computation.