All Questions
Tagged with hyperparameter-optimization bayesian-optimization
6 questions
0
votes
0
answers
20
views
Combination of components to maximize a multi-criteria objective function
I have been given a list of components, with various “contributions” (or weights) which put together in a weighted combination have a combined aggregate effect. I then have the task of suggesting ...
- 101
1
vote
1
answer
288
views
How can I interpret the value returned by score(X) method of sklearn.neighbors.KernelDensity?
For sklearn.neighbors.KernelDensity, its score(X) method according to the sklearn KDE documentation says:
Compute the log-...
- 235
4
votes
1
answer
183
views
Bayesian hyperparameter optimization, is it worth it?
In the Deep Learning book by Goodfellow et al., section 11.4.5 (p. 438), the following claims can be found:
Currently, we cannot unambiguously recommend Bayesian hyperparameter
optimization as an ...
- 183
2
votes
0
answers
27
views
Is it normal to see oscillations in tested hyperparameters during bayesian optimisation?
I've been trying out bayesian hyperparameter optimisation (with TPE) on a simple CNN applied to the MNIST handwritten digit dataset. I noticed that over iterations of the optimisation loop, the tested ...
- 1,369
6
votes
3
answers
3k
views
What is a "surrogate model"?
In the following paragraph from the book Automated Machine Learning: Methods, Systems, Challenges (by Frank Hutter et al.)
In this section we first give a brief introduction to Bayesian ...
- 163
1
vote
1
answer
400
views
Are there Python packages for recent Bayesian optimization methods? [closed]
I want to try and compare different optimization methods in some datasets. I know that in scikit-learn there are some corresponding functions for the grid and random search optimizations. However, I ...
- 153