# Questions tagged [neural-networks]

For questions about a artificial networks, such as MLPs, CNNs, RNNs, LSTM, and GRU networks, their variants or any other AI system components that qualify as a neural networks in that they are, in part, inspired by biological neural networks.

2,071 questions
Filter by
Sorted by
Tagged with
116 views

### What are the typical sizes of practical/commercial artificial neural networks?

I'm interested in artificial neural networks (ANN) and I wonder how big ANNs in practical use are, for example, Tesla Autopilot, Google Translate, and others. The only thing I found about Tesla is ...
14 views

### Tensforflow schedule - does not change boundaries [closed]

I'm trying to manipulate the learning rate with tf PiecewiseConstantDecay. I can easily check if the algorithm switches learning rate values, because one rate is extremely low 1e-20 !! However, NO ...
28 views

### what are recirculation neural networks? [closed]

I want to know about re circulation neural networks. Are they even real or hypothetical? I tried to gather information but I didnt succeed. Resources for further reading will be appreciated.
27 views

### Is there literature on Neural Network with activation functions of bounded domain?

I think to have found a somewhat interesting connection between neural networks and another area of mathematics. However, it requires the activation functions in the network to have a bounded - ...
27 views

### Neural Network for Picking Parameters of a Nonlinear Function to Data Points

I'm trying to make a neural network in pytorch that picks the parameters of a nonlinear function, the radius and (x,y) center of a circle in the example below, based on a sample of values from the ...
39 views

### In practice, are perceptrons typically implemented as objects?

I'm fairly new to ANNs. I know the general structure, the math, and the algorithms behind them. I figured the logical next step on my journey to fully understanding them would to be implement one ...
21 views

### train and validation in a multi model pipeline

I have a pipeline which contains two NN blocks one after the other (the second gets as input the first output). I was wondering how to train and validate the two blocks. Split to train, val and test. ...
49 views

### How to build a word recognizer with text as images using CNN? [closed]

I am new to machine learning. I tried to use this CNN model, which was originally used for handwritten character recognition, for handwritten word recognition, but it is not working. Can anyone share ...
50 views

### Is a genetic algorithm efficient for a snake game?

I am working on a DIY project in which I want to be able to train a neural network to play Snake. Is a genetic algorithm an efficient way of training a network for this application? For a GA, what ...
77 views

### Why do we use the softmax instead of no activation function?

Why do we use the softmax activation function on the last layer? Suppose $i$ is the index that has the highest value (in the case when we don't use softmax at all). If we use softmax and take $i$th ...
25 views

### How to prove that a regularisation method simplified a neural network?

There are a few ways to regularise a neural network, for example dropout or the L1. Now, both these methods, and possibly most other regularisation methods, tend to remove from, or simplify the neural ...
56 views

### What could be a good way to visualise the feature extraction process with MobileNet?

I am trying to create a visualisation for how transfer learning (feature extraction in particular) works with MobileNet. With the ml5.js library, you can extract a ...
27 views

### Why are weights not initialized with mean=1?

I wonder why weights are initialized with zero-mean. It is one of the reasons, why deep architectures cannot be trained without skip connections. Without the skip connections, the zero initialization ...
44 views

### How do transformers understand data and answer custom questions?

I recently heard of GPT-3 and I don't understand how the attention models and transformers encoders and decoders work. I heard that GPT-3 can make a website from a description and write perfectly ...
33 views