5

Neuroevolution Through Augmenting Topologies or NEAT may be what you are referring to. The original paper by Kenneth O. Stanley is here NEAT combines a neural network and a genetic algorithm. Instead of using back propagation or gradient descent to "train" your network, NEAT creates a population of very simple neural networks (no connections) and evolves ...


3

"Artificial Intelligence: A Modern Approach" (AIMA) by Russel and Norvig is a general introductory book on AI. That means it not only covers sub-symbolic AI (like machine learning) but also symbolic AI. Therefore, it can "only" give you an overview of each topic (I put only in quotation marks since it is actually quite ambitious to cover all topics of AI in ...


3

tl;dr I'd say your model has 8 layers (5 conv, 3 dense), however a lot of people count layers in other ways. From what I've seen this is by far the most conventional way for counting layers. Justification This is an interesting question because its quite subjective. In most cases only the convolutional and dense layers would count from your network. Bach ...


3

Let's define your problem from another point of view. Let's say that in this RL problem you have two agents (agent1 and agent2) that compete with each other in order to accomplish their own goal, i.e., wining connect4 game. Therefore, we could say that from agent1's point of view, he is player1 and the player2 is agent2. The same way, from agent2's point of ...


3

What you are calling 'analyzing the surroundings' is generally referred to as perception. Self-driving cars sense their surroundings using cameras, radars, lidars often combining or fusing more than one sensor to paint a picture of the environment. A lot of algorithms get used for fusing the sensor data and then deriving an understanding of the surrounding. ...


2

Self-driving cars use a combination of both supervised as well as reinforcement learning. Huge amounts of sensor data are recorded in real-time. This data can be used to train all sorts of supervised classifiers, e.g. for predicting rain or switching on lights. You can also set up a model to predict pedestrians and other cars. This is supervised learning. ...


2

I haven't read any relevant paper about this, but I have seen some implementations based on what you are describing, arbitrarily called DGNN (Dynamic Growing Neural Network). Hope this term can help your search.


2

Overview As it has already been observed, your main problem, beside the training related issues like fixing the learning rate, is you have basically no chance to learn such a big model woth such a small dataset ... from scratch So focusing on the real problem, here are some techniques you could use dataset augmentation transfer learning from a ...


2

Try lowering the learning rate. Such a loss curve can be indicative of a high learning rate. Due to a high learning rate the algorithm can take large steps in the direction of the gradient and miss the local minima. Then it will try to come back to the minima in the next step and overshoot it again. You may also try switching to a momentum-based GD ...


2

In Don't Decay the Learning Rate, Increase the Batch Size, Smith et al. train ResNet-50 on ImageNet to 76.1% with only 2500 updates. Has anyone done it in less? In The Impact of Neural Network Overparameterization on Gradient Confusion and Stochastic Gradient Descent Sankararaman et al. present the concept of gradient confusion which slows convergence, and ...


2

In this case, you have an ontology and want to learn the ontology. There are many researches in this topic that you can find. However, the data could be the most challenging part. Some of the researches: Ontology learning for the Semantic Web Ontology Learning Also, as these are some frameworks to ontology learning, you can use deep networks such as RNN‌ ...


2

I try to answer the things I know for sure: One effect of bigger images is the increasing computation time due to more pixels (input to your training) 4.Grayscaling reduces the information, which might decrease training time, but also model performance (accuracy, precision, recall). What I have seen is that grayscaling is used in for example face detection ...


2

Is a 3d convolution a good idea? Is 256 filters a good idea? Are the filters (4,4,2) and (2,2,1) suitable? It's not so much that answers are subjective, but you are performing an experiment, and this should be driven by results. If you can find something published about a similar environment that might help you narrow down your choices. That said, ...


2

Neither of the above mentioned methods could be a potent indicator of the performance of a model. A simple way to train the model just enough so that it generalizes well on unknown datasets would be to monitor the validation loss. Training should be stopped once the validation loss progressively starts increasing over multiple epochs. Beyond this point, ...


1

AI is supposed to do anything human or traditional computer can do, that is what we expect AI to be. Technically you would need AGI (Artifical General Intelligence) to do anything a human can do. This is not a technology that exists, but a goal of some AI research to perform more and more general tasks. So 'generating random value' is also a task ...


1

Vanishing Gradients can be detected from the kernel weights distribution. All you have to look for is whether the weights are dying down to 0. If only 25% of your kernel weights are changing that does not imply vanishing gradient, it might be a factor but there can be a variety of reasons. Starting from poor data, loss function used to the optimizer, etc. ...


1

Here's a link to some benchmarks that should give you some insights. In my experience (I've used systems with both 1080s and V100s) I've found that as of about a year ago, a lot of the common tools couldn't use the V100s well. Until we started doing some manual optimization, the 1080s were comparable if not better on common tasks. Of course, once we put ...


1

Both of them using the end-to-end approach for speech recognition. However, because of the code complexity in DeepSpeech, you can't tune the model for your work. Kaldi could be configured in a different manner and you have access to the details of the models and indeed it is a modular tool. I think Kaldi could be a better tool academically and also ...


1

Can you use them commercially? Yes. Is Google able to sue you any time they want? Yes. Will they do that... Probably not. Google isn't a known patent bully, I would give them the benefit of the doubt in this kind of situation and say, unless you start really giving them real trouble, they wouldn't do anything. Some companies/people know an idea can ...


1

The first neural network machine was the stochastic neural analog reinforcement calculator (SNARC), built in the 1950s. As you can see, it's pretty old. After that, there were several advances regarding backpropagation and the vanishing gradient problem. However, the ideas itself are not novel. Simply put, we have the data and processing power today that we ...


1

You need to perform Hyperparameter Tuning to identify - Number of hidden layers. Number of neurons in each of the hidden layers. Dropout The activation function you use in each of your hidden layers. There parameters are only related to how you build your model. There are others that relate to training like batch size, number of epochs and so on. Your ...


1

Nicola Bernini's answer is quite comprehensive. Here are my insights. First of all, think whether you really need neural networks to solve your problem. Think whether traditional computer vision operations like edge detection/ region-based methods help you to solve your problem (OpenCV can help you here). Think about your data again. In case you decide to ...


1

Data scaling or normalization is a process of making model data in a standard format so that the training is improved, accurate, and faster. So you just have to scale the data once. Doesn't matter what scaler you are using. Just make sure to initialize the scaler with the training data and then use the same parameters to scale the test data. The z-score ...


1

General structure of an Artificial Neural Network Input Layer + Hidden Layers + Output Layer If there are more hidden layers in the artificial neural network, then the neural network is called as Deep Neural network. How many exactly constitute a deep neural network is a point of debate, but in general, the more the hidden layers, the deep is the neural ...


1

Neural networks are easily fooled, provided you know how to fool them. Consider a linear network with an input layer and an output layer, which has an error function E (we don't need hidden layers to show how to fool a network). For a given input image x, E measures the (squared) difference between the network's output y and the desired (correct) output. ...


1

Fuzzy Logic is a way of dealing with uncertainties, which is something that computers don't do naturally which human do very well. The way we instantly think of dealing with things and the way that computers tend to deal with certain things is 'True' or 'False', or '1 or '0'. For example, you might classify someone is alive as alive ('True') or has passed ...


Only top voted, non community-wiki answers of a minimum length are eligible