Questions tagged [architecture]

For questions related to the architecture of AI models, e.g. the architecture of neural networks.

Filter by
Sorted by
Tagged with
2
votes
2answers
2k views

What is the exact output of the Inception ResNet V2's feature extraction layer?

I am working with the Inception ResNet V2 model, pre-trained with ImageNet, for face recognition. However, I'm so confused about what the exact output of the feature extraction layer (i.e. the layer ...
3
votes
1answer
136 views

What is the input to AlphaGo's neural network?

I have been reading an article on AlphaGo and one sentence confused me a little bit, because I'm not sure what it exactly means. The article says: AlphaGo Zero only uses the black and white stones ...
1
vote
0answers
24 views

Architecture and Use of Different Algorithms for Health Goal Feedback

I wanted to get some opinions from the community for a certain problem that I will be approaching. The problem is to provide feedback to a user based on a image of the upper male torso. The image ...
2
votes
0answers
41 views

Multi-field text input for LSTM

I'm using LSTM to categorize medium-sized pieces of text. Each item to be categorized has several free-form text fields, in addition to several categorical fields. What is the best approach to using ...
17
votes
2answers
396 views

Are Modular Neural Networks more effective than large, monolithic networks at any tasks?

Modular/Multiple Neural networks (MNNs) revolve around training smaller, independent networks that can feed into each other or another higher network. In principle, the hierarchical organization ...
3
votes
1answer
161 views

Neural network architecture for comparison

When someone wants to compare 2 inputs, the most widespread idea is to use a Siamese architecture. Siamese architecture is a very high level idea, and can be customized based on the problem we are ...
2
votes
0answers
24 views

Is Hebbian learning the progenitor of AI?

Hebb's postulate attempts to explain associative learning via the processes of sampling (using sensors), emitting responses and receiving feedback. This is a form of control orientated architecture ...
2
votes
2answers
216 views

How does Tara AI work?

Cisco and other companies are using Tara AI—a matching tool that connects IT projects with freelancers who have the exact skills required to complete them. Looking for an explanation of how Tara AI ...
1
vote
2answers
168 views

Are artificial networks based on the perceptron design inherently limiting?

At the time when the basic building blocks of machine learning (the perceptron layer and the convolution kernel) were invented, the model of the neuron in the brain taught at the university level was ...
1
vote
1answer
105 views

How do the current input and the output of the previous time step get combined in an LSTM?

I am currently looking into LSTMs. I found this nice blog post, which is already very helpful, but still, there are things I don't understand, mostly because of the collapsed layers. The input $X_t$,...
4
votes
2answers
248 views

Are Neural Net architectures accidental discoveries?

Recently, I have been learning about new neural networks, which are used for specialised purposes, like speech recognition, image recognition, etc. The more I discover the more I get amazed by the ...
1
vote
2answers
490 views

How to teach a model-based reflex agent for doing some task using machine learning methods?

I would like to know how to teach an agent for performing prediction of the severity of disease and also for alerting patients using machine learning methods. I found the model-based reflex agent can ...
0
votes
1answer
671 views

How can I create my own Google duplex?

I am trying to create my own variant of Google duplex however, it won't make calls but just have a real time conversation. My question is, where and how to start? How do I train my model with real ...
3
votes
6answers
3k views

What is the difference between AI architecture and AI model?

What is the difference between AI architecture and AI models? Are both of them the same? If not, please distinguish both of them and give example of each.
1
vote
0answers
79 views

Algorithms that connect neurons to previous layers as well as next

Are there any algorithms, or any evidence to decide or to suggest it would be better to connect a neuron node in a layer l, in a neural network to particular nodes ...
10
votes
1answer
929 views

Why is the merged neural network of AlphaGo Zero more efficient than two separate neural networks?

AlphaGo Zero contains several improvements compared to its predecessors. Architectural details of Alpha Go Zero can be seen in this cheat sheet. One of those improvements is using a single neural ...
3
votes
1answer
241 views

What type of reinforcement learning can I do restricted to ~200MB on an average smartphone?

This concerns a set of finite, non-trivial, combinatorial games [M] in the form of an app. A sample game can be found here. Because this is a mass market product, we can't take up too much space, ...
3
votes
1answer
122 views

What linear rectifier is better?

What rectifier is better in general case of Convolutional Neural Network and how about empirical rules to use each type? ReLU PReLU RReLU ELU Leacky ReLU
4
votes
2answers
235 views

Are there any learning algorithms as powerful as "deep" architectures?

This article suggests that deep learning is not designed to produce the universal algorithm and cannot be used to create such a complex systems. First of all it requires huge amounts of computing ...

1
2