SelectionΒΆ
Note: Make sure to correct for multiple hypothesis testing
Model SelectionΒΆ
- Fit multiple models on the training data and eyeball dev data
- Use dev data for hyper parameter tuning of each model
- Use external validation data for model selection and obtain
- Combine the training and validation data. Refit on this set to obtain
- Assess the performance of on the test data
Finally, train on the entire data to obtain
Check the results on the self-hosted competition