Questions tagged [ai-design]

For questions related to the design of AI agents, algorithms, or models. If your question is about designing neural networks, reward functions, or fitness functions, you can use the associated more specific tags "neural-network-design", "reward-design" and "fitness-design", respectively.

Filter by
Sorted by
Tagged with
5 votes
2 answers
823 views

Why do we need both the validation set and test set?

I know that this has been asked a hundred times before, however, I was not able to find a question (and an answer) which actually answered what I wanted to know, respectively, which explained it in a ...
Golo Roden's user avatar
4 votes
2 answers
322 views

Are Neural Net architectures accidental discoveries?

Recently, I have been learning about new neural networks, which are used for specialized purposes, like speech recognition, image recognition, etc. The more I discover the more I get amazed by the ...
user avatar
5 votes
1 answer
1k views

How to define an action space when an agent can take multiple sub-actions in a step?

I'm attempting to design an action space in OpenAI's gym and hitting the following roadblock. I've looked at this post which is closely related but subtly different. The environment I'm writing needs ...
Seyed Moein Ayyoubzadeh's user avatar
21 votes
2 answers
16k views

How to define states in reinforcement learning?

I am studying reinforcement learning and the variants of it. I am starting to get an understanding of how the algorithms work and how they apply to an MDP. What I don't understand is the process of ...
Andy's user avatar
  • 313
14 votes
2 answers
569 views

How should I encode the structure of a neural network into a genome?

For a deterministic problem space, I need to find a neural network with the optimal node and link structure. I want to use a genetic algorithm to simulate many neural networks to find the best network ...
Mithical's user avatar
  • 2,895
10 votes
1 answer
5k views

What are ontologies in AI?

What exactly are ontologies in AI? How should I write them and why are they important?
oren revenge's user avatar
9 votes
3 answers
3k views

How should I represent the input to a neural network for the games of tic-tac-toe, checkers or chess?

I've been reading a lot about TD-Gammon recently as I'm exploring options for AI in a video game I'm making. The video game is a turn-based positional sort of game, i.e. a "units", or game ...
NeomerArcana's user avatar
5 votes
2 answers
753 views

Should I repeat lengthy deep learning experiments to average results ? How to decide how many times to repeat?

I am doing my MSc thesis on deep learning. My model takes many hours to train. Part of what I do is trying different parameters and settings hoping that they will achieve different results. But I ...
Manveru's user avatar
  • 221
5 votes
3 answers
290 views

Given enough computational resources, do we currently have any algorithms which could achieve AI?

Hypothetically, assume that you have access to infinite computing power. Do we have designs for any brute-force algorithms that can find an AI capable of passing traditional tests (e.g. Turing, ...
Tim Atkinson's user avatar
4 votes
2 answers
357 views

When we are working on an AI project, does the context (academia, industry or competition) make the process different?

When we are working on an AI project, does the domain/context (academia, industry, or competition) make the process different? For example, I see in the competition most participants even winners use ...
malioboro's user avatar
  • 2,789
4 votes
1 answer
937 views

How should I define the action space for a card game like Magic: The Gathering?

I'm trying to learn about reinforcement learning techniques. I have little background in machine learning from university, but never more than using a CNN on the MNIST database. My first project was ...
Why Not's user avatar
  • 43
3 votes
0 answers
251 views

What can be considered a deep recurrent neural network?

In the paper Deep Recurrent Q-Learning for Partially Observable MDPs, the DRQN is described as DQN with the first post-convolutional fully-connected layer replaced by a recurrent LSTM. I have DQN ...
Savco's user avatar
  • 61
3 votes
1 answer
741 views

What are the (general) sizes of AlphaGo and Deep Blue?

I'm trying to get a gauge on just how big the programs and databases are these automata. I understand that this is a changing number, particularly in regard to Machine Learning. Q: How large was ...
DukeZhou's user avatar
  • 6,237
2 votes
1 answer
1k views

How to train a reinforcement learning agent from raw pixels?

How would you train a reinforcement learning agent from raw pixels? For example, if you have 3 stacked images to sense motion, then how would you pass them to neural networks to output Q-learning ...
dato nefaridze's user avatar