3

I don't think people generally do use neural nets for grid world. As long as the state and action spaces are small enough, you should be able to store Q values in a table like you suggested. Neural nets come in handy when the state space is very large (or even continuous), so you can't afford to store a table of Q values. Also, neural nets have the ability ...


3

In general, it is definetely very computationally expensive, so the exhaustive search is not perfromed in pratice, however, there are some recent approaches for determining, whether the architecture is fine, without performing the training - by looking at the covariance matrix after forwarding the data, for example, in a recent paper - https://arxiv.org/abs/...


1

From what I understood, you want to be able to determine whether the input to your classifier is a valid picture or not. Where: Valid picture: image of a person wearing or not wearing a seatbelt Not valid picture: unrelated images (say a kitchen picture) or noise, or a black image (no input at all) For that you could build a Bayesian model from your ...


1

Assuming that you have access to the training data set, you could use an autoencoder network to predict what features f4, f5, f6 'could be' for the test data set. The way to do this is to train the autoencoder on the training data set with features f1, f2, f3 as inputs, and then use f1,f2,f3,f4,f5,f6 as the output of the network. The autoencoder then ...


1

Data management and bandwidth are key issues for interconnecting multiple GPUs. These are such big issues that it is hard to think about other challenges like neural network architecture, metrics, etc. The key to success for interconnecting multiple GPUs on a single computer is NVIDIA's NVLink: NVLink is a wire-based communications protocol for near-range ...


1

Maybe LabelImg is what you are looking for? LabelImg is a graphical image annotation tool and label object bounding boxes in images. If not, maybe you can find other options for your problem on this summary of computer vision tools.


Only top voted, non community-wiki answers of a minimum length are eligible