Questions tagged [random-forests]

For questions related to the random forest (or random decision forests), which is an ensemble machine learning technique (that is, an ML technique that uses or combines different models).

Filter by
Sorted by
Tagged with
0 votes
1 answer
23 views

How do I know if my Random Forest Regressor Model is overfitted?

Im creating a Random Forest Regressor Model with a small dataset (30 data points). I tried with other models but RF was the best one, however, after applying GridSearchCv I got that the training set ...
user avatar
  • 3
1 vote
2 answers
78 views

Machine Learning Models for Longitudinal Data

Recently, I had the following question about supervised classification models (e.g. random forest) for longitudinal data. Suppose I have the following data about students passing a fitness test - the ...
user avatar
1 vote
1 answer
61 views

Random forests - are more estimators always better?

I'm learning about more advanced methods of hyperparameter optimization, such as the Bayesian methods in the scikit-optimize package. For those unfamiliar with the ...
user avatar
1 vote
0 answers
25 views

Derive information for sub-scoring from one scoring model

I am currently working in Python with a random forest algorithm to perform a scoring. My output is binary. The idea now is to derive sub-scores from the above model that give an opinion on different ...
user avatar
0 votes
0 answers
24 views

proof of convergence for the random forest algorithm

I am looking for the proof of convergence of the random forest algorithm. A cursory google search shows many, but I do not understand which version (original?) of the algorithm this is. Can you kindly ...
user avatar
  • 175
0 votes
1 answer
77 views

Reinforcing Learning when action has no effect on the environment

I am trying to get my head around a problem where the action by the agent can not change the environment. Without going into details, my problem is about error correction in an stochastic environment. ...
user avatar
0 votes
1 answer
22 views

What approach would work well for predicting earthquake intensity based on historical data?

My problem: I own warning system where I collect data from institutions and send them over through various ways to users. I would like to hear your advice on what approach I can use for solving my ...
user avatar
  • 5
1 vote
1 answer
33 views

How do I take the correct classification predictions of an ml algo (i.e. random forest/neural net) and sort the instances in each category?

I am trying to sort the instances within each of 5 classification categories in a dataset that has been put through both a random forest classifier and a neural network with 99% accuracy on each. ...
user avatar
  • 11
3 votes
0 answers
57 views

When do the ensemble methods beat neural networks?

In many applications and domains, computer vision, natural language processing, image segmentation, and many other tasks, neural networks (with a certain architecture) are considered to be by far the ...
user avatar
2 votes
1 answer
75 views

What are some applications where tree models perform better than neural networks?

Neural networks are known to be generally better modeling techniques as compared to tree-based models (such as decision trees). Are there any exceptions to this?
user avatar
1 vote
0 answers
45 views

Can I apply AdaBoost on a random forest?

I know the random forest is a bagging technique. But what if my random forest overfits on a dataset, so I reduce the depth of the decision tree and now it is underfitting. In this scenario, can I take ...
user avatar
1 vote
2 answers
1k views

Why are decision trees and random forests scale invariant?

Feature scaling, in general, is an important stage in the data preprocessing pipeline. Decision Tree and Random Forest algorithms, though, are scale-invariant - i.e. they work fine without feature ...
user avatar
2 votes
0 answers
78 views

How can I classify instances into two categories and then into sub-categories, when the number of features is high?

I'm working with a problem where I have a lot of variables for different cases of different users. Depending on the values of the different variables of a concrete user in a concrete case, the ...
user avatar
4 votes
2 answers
69 views

Oposite type of predictions for unbalanced dataset

I have a big dataset (28354359 rows) that has some blood values as features (11 features) and the label or outcome variable that tells whether a patient has a virus caused by a Neoplasm or not. The ...
user avatar
5 votes
1 answer
73 views

How could decision tree learning algorithms cope with imbalanced classes?

Decision trees and random forests may or not be more suited to solve supervised learning problems with imbalanced labels (or classes) in datasets. For example, see the article Using Random Forest to ...
user avatar
2 votes
1 answer
58 views

How can I determine the bias and variance of a random forrest?

On this website https://scikit-learn.org/stable/modules/learning_curve.html, the authors are speaking about variance and bias and they give a simple example of how works in a linear model. How can I ...
user avatar
0 votes
1 answer
80 views

How to interpret this learning curve plot

Bellow I have a Learning Curve plot How should I interpret this plot for my random forrest algorithm (the second one the most complex one)? Which one is the best?
user avatar
1 vote
1 answer
72 views

How should I interpret this validation plot?

Bellow I have a validation plot How should I interpret this validation plot? Is my data underfitting? What else can be seen from this? Which one is the best? What does it mean that the right line is ...
user avatar
10 votes
1 answer
3k views

Are decision tree learning algorithms deterministic?

Are decision tree learning algorithms deterministic? Given a fixed dataset, do they always produce a tree with the same structure? What about the random forest?
user avatar
  • 203
0 votes
1 answer
60 views

How many trees should be generated in a random forest?

What are ways of determining the number of trees to be generated in a random forest algorithm?
user avatar
  • 305
2 votes
3 answers
146 views

Why are tree-based models more widely used in Medical Diagnosis?

In Chapter 14.4 (p. 664) of the book Pattern Recognition and Machine Learning by Bishop, it is mentioned that tree-based models are more widely used in Medical Diagnosis. Apart from giving better ...
user avatar