Do a grid search and identify the hyper parameters. If you want to report the test score of the identified hyper parameters, you can either use the grid search reported metrics or do a train-test split and train with the identified hyper parameter and report the results of the test data.
You do CV to find hyper parameters or report test scores when the data is less. If you have enough data random shuffling and scoring the hyper parameters on test data is sufficient.
与恶龙缠斗过久,自身亦成为恶龙;凝视深渊过久,深渊将回以凝视…