Questions tagged [architecture]

For questions related to the architecture of AI models, e.g. the architecture of neural networks.

Filter by
Sorted by
Tagged with
4
votes
2answers
238 views

Are Neural Net architectures accidental discoveries?

Recently, I have been learning about new neural networks, which are used for specialised purposes, like speech recognition, image recognition, etc. The more I discover the more I get amazed by the ...
10
votes
4answers
2k views

Should neural nets be deeper the more complex the learning problem is?

I know it's not an exact science. But would you say that generally for more complicated tasks, deeper nets are required?
10
votes
1answer
925 views

Why is the merged neural network of AlphaGo Zero more efficient than two separate neural networks?

AlphaGo Zero contains several improvements compared to its predecessors. Architectural details of Alpha Go Zero can be seen in this cheat sheet. One of those improvements is using a single neural ...
6
votes
1answer
197 views

Are there well-established ways of mixing different inputs (e.g. image and numbers)?

I am interested in the possibility of having extra input along with the main data. For instance, a medical application that would rely mostly on an image: how could one also account for sex, age, etc.?...
2
votes
3answers
126 views

Why does a neuron in a multi-layer network need several input connections?

For example, if I have the following architecture: Each neuron in the hidden layer has a connection from each one in the input layer. 3 x 1 Input Matrix and a 4 x 3 weight matrix (for the ...