Questions tagged [gradient-boosting]
For questions related to gradient boosting, which is a machine learning technique that can be used for regression and classification problems and which produces a prediction model in the form of an ensemble of other smaller prediction models (typically decision trees).
10
questions
0
votes
1answer
44 views
Why is the exponential loss used in this case?
I am reading a paper "Tracking-by-Segmentation With Online Gradient Boosting Decision Tree". In Section 2.1, the paper says
I cannot understand the exponential loss function. In my opinion, ...
2
votes
1answer
35 views
House price inflation modelling
I have a data set of house prices and their corresponding features (rooms, meter squared, etc). An additional feature is the sold date of the house. The aim is to create a model that can estimate the ...
2
votes
0answers
19 views
React on train-validation curve after trening
I have a regression task that I tray to solve with AI.
I have around 6M rows with about 30 columns. (originally there was 100, but I reduce it with drop feature importance)
I understand basic ...
3
votes
0answers
78 views
Can XGBoost solve XOR problem?
I've read that decision trees are able to solve XOR operation so I conclude that XGBoost algorithm can solve it as well.
But my tests on the datasets (datasets that should be highly "xor-ish"...
1
vote
1answer
71 views
Has "deep vs. wide" been resolved?
All else being equal, including total neuron count, I give the following definitions:
wide is a parallel ensemble, where good chunks of the neurons have the same inputs because the inputs are shared ...
3
votes
0answers
50 views
When do the ensemble methods beat neural networks?
In many applications and domains, computer vision, natural language processing, image segmentation, and many other tasks, neural networks (with a certain architecture) are considered to be by far the ...
5
votes
3answers
508 views
How do weak learners become strong in boosting?
Boosting refers to a family of algorithms which converts weak learners to strong learners. How does it happen?
3
votes
1answer
73 views
What are some applications where tree models perform better than neural networks?
Neural networks are known to be generally better modeling techniques as compared to tree-based models (such as decision trees). Are there any exceptions to this?
1
vote
0answers
28 views
How would the "best function" been constructed if there are no computationally limitations?
I am reading the Wikipedia article on gradient boosting. There is written:
Unfortunately, choosing the best function $h$ at each step for an arbitrary loss function $L$ is a computationally ...
2
votes
0answers
64 views
How can I use gradient boosting with multiple features?
I'm trying to use gradient boosting and I'm using sklearn's GradientBoostingClassifier class.
My problem is that I'm having a data frame with 5 columns and I want ...
