Questions tagged [ai-design]
For questions related to the design of AI agents, algorithms, or models. If your question is about designing neural networks, reward functions, or fitness functions, you can use the associated more specific tags "neural-network-design", "reward-design" and "fitness-design", respectively.
14
questions
5
votes
2
answers
823
views
Why do we need both the validation set and test set?
I know that this has been asked a hundred times before, however, I was not able to find a question (and an answer) which actually answered what I wanted to know, respectively, which explained it in a ...
- 173
4
votes
2
answers
322
views
Are Neural Net architectures accidental discoveries?
Recently, I have been learning about new neural networks, which are used for specialized purposes, like speech recognition, image recognition, etc. The more I discover the more I get amazed by the ...
user9947
5
votes
1
answer
1k
views
How to define an action space when an agent can take multiple sub-actions in a step?
I'm attempting to design an action space in OpenAI's gym and hitting the following roadblock. I've looked at this post which is closely related but subtly different.
The environment I'm writing needs ...
21
votes
2
answers
16k
views
How to define states in reinforcement learning?
I am studying reinforcement learning and the variants of it. I am starting to get an understanding of how the algorithms work and how they apply to an MDP.
What I don't understand is the process of ...
- 313
14
votes
2
answers
569
views
How should I encode the structure of a neural network into a genome?
For a deterministic problem space, I need to find a neural network with the optimal node and link structure. I want to use a genetic algorithm to simulate many neural networks to find the best network ...
- 2,895
10
votes
1
answer
5k
views
What are ontologies in AI?
What exactly are ontologies in AI? How should I write them and why are they important?
- 243
9
votes
3
answers
3k
views
How should I represent the input to a neural network for the games of tic-tac-toe, checkers or chess?
I've been reading a lot about TD-Gammon recently as I'm exploring options for AI in a video game I'm making. The video game is a turn-based positional sort of game, i.e. a "units", or game ...
- 210
5
votes
2
answers
753
views
Should I repeat lengthy deep learning experiments to average results ? How to decide how many times to repeat?
I am doing my MSc thesis on deep learning. My model takes many hours to train. Part of what I do is trying different parameters and settings hoping that they will achieve different results. But I ...
- 221
5
votes
3
answers
290
views
Given enough computational resources, do we currently have any algorithms which could achieve AI?
Hypothetically, assume that you have access to infinite computing power. Do we have designs for any brute-force algorithms that can find an AI capable of passing traditional tests (e.g. Turing, ...
- 712
4
votes
2
answers
357
views
When we are working on an AI project, does the context (academia, industry or competition) make the process different?
When we are working on an AI project, does the domain/context (academia, industry, or competition) make the process different?
For example, I see in the competition most participants even winners use ...
- 2,789
4
votes
1
answer
937
views
How should I define the action space for a card game like Magic: The Gathering?
I'm trying to learn about reinforcement learning techniques. I have little background in machine learning from university, but never more than using a CNN on the MNIST database.
My first project was ...
- 43
3
votes
0
answers
251
views
What can be considered a deep recurrent neural network?
In the paper Deep Recurrent Q-Learning for Partially Observable MDPs, the DRQN is described as DQN with the first post-convolutional fully-connected layer replaced by a recurrent LSTM.
I have DQN ...
- 61
3
votes
1
answer
741
views
What are the (general) sizes of AlphaGo and Deep Blue?
I'm trying to get a gauge on just how big the programs and databases are these automata. I understand that this is a changing number, particularly in regard to Machine Learning.
Q: How large was ...
- 6,237
2
votes
1
answer
1k
views
How to train a reinforcement learning agent from raw pixels?
How would you train a reinforcement learning agent from raw pixels?
For example, if you have 3 stacked images to sense motion, then how would you pass them to neural networks to output Q-learning ...
- 862