I am reading the Wikipedia article on gradient boosting. There is written:

Unfortunately, choosing the best function $h$ at each step for an arbitrary loss function $L$ is a computationally infeasible optimization problem in general. Therefore, we restrict our approach to a simplified version of the problem.

How would the "best function" been constructed if there are no computationally limitations?

Because the wiki gives me the idea that the model could been better, but that compromises have been made.


Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.