I have a multi-label classification task I am solving. I have done hyperparameter tuning (with Keras Tuner) to determine the best configuration for my neural network.
Is it valid to do this (determine the best hyper-parameters) and then do cross-validation to get a more accurate test estimation of the dataset?
I don't see how this would be invalid, given that the cross-validation examples I have seen already have network architectures known a priori, presumably because this is what they chose or feel is the best way of proceeding.
**Data used is as follows: forFor hyperparameter tuning: all, all data is split in to traininto training and test setsets - the traintraining set is further split, when fitting the model, for a 10% validation set - the optimal model is then used to predict on the test set. for cross validation:
For k-fold cross-validation, all data (same as above) is used, but I just split to train(with sklearn) the data into training and test according to fold numberdatasets -(so no validation split is used on training, and performance is measured only on thedataset). The test set in orderis used to determine the model performance at each hiteration of k-fold cross-0 the model parameters used are those determined by hyperparameter tuning**validation.