Questions tagged [gradient-boosting]
For questions related to gradient boosting, which is a machine learning technique that can be used for regression and classification problems and which produces a prediction model in the form of an ensemble of other smaller prediction models (typically decision trees).
10
questions
2
votes
1answer
32 views
House price inflation modelling
I have a data set of house prices and their corresponding features (rooms, meter squared, etc). An additional feature is the sold date of the house. The aim is to create a model that can estimate the ...
1
vote
0answers
18 views
React on train-validation curve after trening
I have a regression task that I tray to solve with AI.
I have around 6M rows with about 30 columns. (originally there was 100, but I reduce it with drop feature importance)
I understand basic ...
3
votes
0answers
68 views
Can XGBoost solve XOR problem?
I've read that decision trees are able to solve XOR operation so I conclude that XGBoost algorithm can solve it as well.
But my tests on the datasets (datasets that should be highly "xor-ish"...
1
vote
1answer
68 views
Has “deep vs. wide” been resolved?
All else being equal, including total neuron count, I give the following definitions:
wide is a parallel ensemble, where good chunks of the neurons have the same inputs because the inputs are shared ...
3
votes
0answers
47 views
When do the ensemble methods beat neural networks?
In many applications and domains, computer vision, natural language processing, image segmentation, and many other tasks, neural networks (with a certain architecture) are considered to be by far the ...
5
votes
3answers
495 views
How do weak learners become strong in boosting?
Boosting refers to a family of algorithms which converts weak learners to strong learners. How does it happen?
2
votes
1answer
71 views
What are some applications where tree models perform better than neural networks?
Neural networks are known to be generally better modeling techniques as compared to tree-based models (such as decision trees). Are there any exceptions to this?
0
votes
0answers
90 views
GPU-training on Google Cloud Platform slower than CPU-training
I recently trained Kaggles "Advanced Housing Prices"-Competition using Catboost. For training i used a compute-instance on Google Cloud Platform (GCP) (CPU: Xeon Quad-Core, RAM: 15GB, GPU: ...
1
vote
0answers
25 views
How would the “best function” been constructed if there are no computationally limitations?
I am reading the Wikipedia article on gradient boosting. There is written:
Unfortunately, choosing the best function $h$ at each step for an arbitrary loss function $L$ is a computationally ...
2
votes
0answers
61 views
How can I use gradient boosting with multiple features?
I'm trying to use gradient boosting and I'm using sklearn's GradientBoostingClassifier class.
My problem is that I'm having a data frame with 5 columns and I want ...
