Questions tagged [architecture]
For questions about AI architecture specifically. (For general software architecture questions, use the "software-architecture" tag.
10
questions with no upvoted or accepted answers
5
votes
1answer
37 views
Why do very deep non resnet architectures perform worse compared to shallower ones for the same iteration? Shouldn't they just train slower?
My understanding of the vanishing gradient problem in deep networks is that as backprop progresses through the layers the gradients become small, and thus training progresses slower. I'm having a hard ...
4
votes
0answers
29 views
Get the position of an object, out of an image
I have some images with a fixed background and a single object on them which is placed, in each image, at a different position on that background. I want to find a way to extract, in an unsupervised ...
2
votes
0answers
18 views
Multi-field text input for LSTM
I'm using LSTM to categorize medium-sized pieces of text. Each item to be categorized has several free-form text fields, in addition to several categorical fields. What is the best approach to using ...
2
votes
0answers
17 views
Is Hebbian learning the progenitor of AI?
Hebb's postulate attempts to explain associative learning via the processes of sampling (using sensors), emitting responses and receiving feedback. This is a form of control orientated architecture ...
1
vote
0answers
21 views
Architecture and Use of Different Algorithms for Health Goal Feedback
I wanted to get some opinions from the community for a certain problem that I will be approaching.
The problem is to provide feedback to a user based on a image of the upper male torso. The image ...
1
vote
0answers
70 views
Algorithms that connect neurons to previous layers as well as next
Are there any algorithms, or any evidence to decide or to suggest it would be better to connect a neuron node in a layer l, in a neural network to particular nodes ...
0
votes
0answers
26 views
Neural Network training on one example to try overfitting leads to strange predictions
tldr; if I train the network on 1 training example, the outcome sometimes makes no sense at all, sometimes is as expected. If I train it on more examples and higher iterations, the network, which ...
0
votes
0answers
42 views
Is there data available about successful neural network architectures?
I am curious to if there is data available for MLP architectures in use today, their initial architecture, the steps that were taken to improve the architecture to an acceptable state and what the ...
0
votes
0answers
13 views
AlphaZero value at root node not being affected by training
I have written my own AlphaZero implementation and started training it recently.
Problem is, I am 99% sure there is a mistake and I do not know how to tackle this, since I cannot explain it. I am new ...
0
votes
1answer
28 views
Tweaking a CNN for large number of input channels
I am using a CNN for function approximation using geospatial data.
The input of the function I am trying to approximate consists of all the spatial distances between N location on a grid and all the ...
