2022 Developer Survey is open! Take survey.

Questions tagged [gradient-boosting]

For questions related to gradient boosting, which is a machine learning technique that can be used for regression and classification problems and which produces a prediction model in the form of an ensemble of other smaller prediction models (typically decision trees).

Filter by
Sorted by
Tagged with
2 votes
1 answer
90 views

Why is the exponential loss used in this case?

I am reading the paper Tracking-by-Segmentation With Online Gradient Boosting Decision Tree. In Section 2.1, the paper says Given training examples, $\left\{\left(\mathbf{x}_{i}, y_{i}\right) \mid \...
user avatar
2 votes
1 answer
41 views

House price inflation modelling

I have a data set of house prices and their corresponding features (rooms, meter squared, etc). An additional feature is the sold date of the house. The aim is to create a model that can estimate the ...
user avatar
1 vote
0 answers
19 views

React on train-validation curve after trening

I have a regression task that I tray to solve with AI. I have around 6M rows with about 30 columns. (originally there was 100, but I reduce it with drop feature importance) I understand basic ...
user avatar
3 votes
0 answers
91 views

Can XGBoost solve XOR problem?

I've read that decision trees are able to solve XOR operation so I conclude that XGBoost algorithm can solve it as well. But my tests on the datasets (datasets that should be highly "xor-ish"...
user avatar
  • 1,027
1 vote
1 answer
76 views

Has "deep vs. wide" been resolved?

All else being equal, including total neuron count, I give the following definitions: wide is a parallel ensemble, where good chunks of the neurons have the same inputs because the inputs are shared ...
user avatar
3 votes
0 answers
56 views

When do the ensemble methods beat neural networks?

In many applications and domains, computer vision, natural language processing, image segmentation, and many other tasks, neural networks (with a certain architecture) are considered to be by far the ...
user avatar
5 votes
3 answers
546 views

How do weak learners become strong in boosting?

Boosting refers to a family of algorithms which converts weak learners to strong learners. How does it happen?
user avatar
  • 93
2 votes
1 answer
75 views

What are some applications where tree models perform better than neural networks?

Neural networks are known to be generally better modeling techniques as compared to tree-based models (such as decision trees). Are there any exceptions to this?
user avatar
1 vote
0 answers
30 views

How would the "best function" been constructed if there are no computationally limitations?

I am reading the Wikipedia article on gradient boosting. There is written: Unfortunately, choosing the best function $h$ at each step for an arbitrary loss function $L$ is a computationally ...
user avatar
1 vote
0 answers
70 views

How can I use gradient boosting with multiple features?

I'm trying to use gradient boosting and I'm using sklearn's GradientBoostingClassifier class. My problem is that I'm having a data frame with 5 columns and I want ...
user avatar