Questions tagged [game-ai]
For questions related to game design involving AI.
240
questions
3
votes
0
answers
475
views
How to encode Azul game state as NN input
Question to NN practicioners. I'd like to encode Azul board game state as an input to NN, let's focus on 2-player variant for a while.
There are 5 round "Factories" on the table (7 on picture, ignore ...
- 131
2
votes
1
answer
1k
views
DQN Breakout adding an extra negative reward to help training?
I'm trying to train a DQN, so I'm using OpenAI gym and Breakout (Breakout-v0).
I have altered the reward supplied by the environment: If the episode is not completed fully, the agent gets a -10 ...
- 27k
0
votes
1
answer
584
views
Is it possible to use a feed-forward neural network to predict the actions in reinforcement learning?
I have done a lot of research on the internet about Reinforcement Learning and I found encountered methods of Reinforcement Learning: Q-Learning and Deep Q-Learning. And I have developed a vague idea ...
- 38.2k
3
votes
1
answer
49
views
Is it meaningful to give more weight to the result of monte carlo search with less turn win?
I'm programming on Connect6 with MCTS.
Monte Carlo Tree Search is based on random moves. It counts up the number of wins in certain moves. (Whether it wins in 3 turns or 30 turns)
Is the move with ...
CommunityBot
- 1
4
votes
2
answers
2k
views
What layers to use in a Neural Network for card game
I am currently writing an engine to play a card game and I would like for an ANN to learn how to play the game. The game is currently playable, and I believe for this game a deep-recurrent-Q-network ...
CommunityBot
- 1
0
votes
1
answer
500
views
How do I know how changes in the weights are changing the reward in Reinforcement Learning
I already know the basics of the basic of Machine Learning. E.g.: Backpropagation, Convolution, etc.
First of let me explain Reinforcement learning to make sure I grasped the concept correctly.
In ...
- 1,183
0
votes
0
answers
240
views
Checkers AI game engines
I have coded an AI checkers game but would like to see how good it is. Some people have informed me to use the Chinook AI opensource code. But I am having trouble trying to integrate that software ...
- 457
4
votes
1
answer
1k
views
Transposition table is only used for roughly 17% of the nodes - is this expected?
I'm making a Connect Four game using the typical minimax + alpha-beta pruning algorithms. I just implemented a Transposition Table, but my tests tell me the TT only helps 17% of the time. By this I ...
- 9,824
2
votes
1
answer
945
views
Creating a self learning Mario Kart game AI?
I will be undertaking a project over the next year to create a self learning AI to play a racing game, currently the game will be Mario Kart 64.
I have a few questions which will hopefully help me ...
- 27k
2
votes
1
answer
287
views
Using a DQN with a variable amount of Valid Moves per turn for a Board Game [duplicate]
I have created a game on an 8x8 grid and there are 4 pieces which can move essentially like checkers pieces (Forward left or Forward right only). I have implemented a DQN in order to pull this off.
...
- 2,649
1
vote
1
answer
788
views
Connect 4 minimax does not make the best move
I'm trying to implement an algorithm that would choose the optimal next move for the game of Connect 4. As I just want to make sure that the basic minimax works correctly, I am actually testing it ...
CommunityBot
- 1
10
votes
3
answers
2k
views
Why does Monte Carlo work when a real opponent's behavior may not be random
I am learning about Monte Carlo algorithms and struggling to understand the following:
If simulations are based on random moves, how can the modeling of the opponent's behavior work well?
For ...
- 9,824
1
vote
1
answer
942
views
Does a solution for Wumpus World with neural networks exist?
The Wumpus World proposed in book of Stuart Russel and Peter Norvig, is a game which happens on a 4x4 board and the objective is to grab the gold and avoiding the threats that can kill you. The rules ...
- 9,097
2
votes
0
answers
155
views
Mapping Actions to the Output Layer in Keras Model for a Board Game
I have created a game based on this game here. I am attempting to use Deep Q Learning to do this, and this is my first foray into Neural networks (please be gentle!!)
I am trying to create a NN that ...
- 41
0
votes
1
answer
101
views
Should Q values be changing within an epoch/episode or should they change after one episode/epoch?
I am trying to use Deep-Q learning environment to learn Super Mario Bros. The implementation is on Github.
I have a neural network that Q values update within an episode for a very small learning ...
- 91
1
vote
3
answers
506
views
Can genetic algorithms be used to learn to play multiple games of the same type?
Is it possible for a genetic algorithm + Neural Network that is used to learn to play one game such as a platform game able to be applied to another different game of the same genre.
So for example, ...
- 9,824
3
votes
1
answer
253
views
What type of reinforcement learning can I do restricted to ~200MB on an average smartphone?
This concerns a set of finite, non-trivial, combinatorial games [M] in the form of an app. A sample game can be found here.
Because this is a mass market product, we can't take up too much space, ...
CommunityBot
- 1
3
votes
2
answers
229
views
Can a game AI learn the concept of acceleration?
If the game had a variable speed and was essential in evolution/gaining score(IDK AI terminologies). Would the AI be able to figure out when to slow down and speed up?
If it is able to solve the ...
- 27k
5
votes
1
answer
135
views
Can you analyse a neural network to determine good states?
I've developed a neural network that can play a card game. I now want to use it to create decks for the game. My first thought would be to run a lot of games with random decks and use some ...
- 9,824
4
votes
1
answer
666
views
Representing inputs and outputs for a card game neural network
I'm attempting to create an AI for a card game using reinforcement learning. The basics of the game are that you can have (theoretically) up to 35 cards in your hand, you can also have to up to 35 ...
- 9,097
2
votes
1
answer
603
views
Genetic Algorithm - creatures in 2d world are not learning
Goal -
I am trying to implement a genetic algorithm to optimise the fitness of a
species of creatures in a simulated two-dimensional world. The world contains edible foods, placed at random, and a ...
- 9,097
1
vote
1
answer
536
views
Why was Go a harder game for an AI to master than Chess?
AI became superior to the best human players in chess around 20 years ago (when the 2nd Deep Blue match concluded). However, it took until 2016 for an AI to beat the Go world chess champion, and this ...
- 27k
2
votes
1
answer
294
views
How to use Machine Learning with simple games?
I built a simple HTML game. In this game the goal is to click when the blue ball is above the red ball. If you hit, you get 1 point, if you miss, you lose 1 point. With each hit, the blue ball moves ...
- 27k
1
vote
1
answer
225
views
Which edges of this tree will be pruned by Alpha-beta pruning?
So I know that 'h' and 'f' will be pruned, but I'm not sure about 'k' and 'l'.
When we visit 'j', technically there is no need for us to visit 'k' and 'l' because there are 2 options:
one or two of ...
CommunityBot
- 1
2
votes
1
answer
1k
views
How to use DQN to handle an imperfect but complete information game?
I'm currently having troubles to win against a random bot playing the Schieber Jass game. It is a imperfect card information game. (famous in switzerland https://www.schieber.ch/)
The environement I'...
- 81
2
votes
1
answer
427
views
Is there any way, in which we can monitor what's going on the screen in android to generate a model from it?
I've been working on a project (Android Game), in which the player has to confront with some obstacles/enemies whom he has to destroy. So, is there a way in which we can monitor how the user of the ...
CommunityBot
- 1
0
votes
1
answer
72
views
Teaching a NN to manipulate pseudoRNG over a long time scale?
For speedrunning purposes, I am trying to train a neural network to identify human-executable ways to manipulate pseudo-RNG (in Pokemon Red, for the interested). The game runs at sixty frames per ...
- 5,292
2
votes
5
answers
248
views
Is it fair to compare AlphaGo with a Human player?
A human player plays limited games compared to a system that undergoes millions of iterations. Is it really fair to compare AlphaGo with the world #1 player when we know experience increases with the ...
- 1,235
1
vote
1
answer
170
views
How to estimate the AI player's strength in multiplayer game?
I have implemented multiple MCTS based AI players for the Love Letter game (rules). It is a 2-4 players zero sum card game where players make alternating moves. I am struggling with how to properly ...
CommunityBot
- 1
5
votes
2
answers
2k
views
What type of neural network would be most feasible for playing a realtime game?
For implementing a neural network algorithm that can play air hockey, I had two ideas for input, and I'm trying to figure out which design would be most viable.
The output must be two analog values ...
- 145
1
vote
1
answer
676
views
What was the average decision speed pf Alpha Zero in the recent Stockfish match?
The match got a lot of press, and I doubt anyone is surprised that Alpha Zero crushed Stockfish.
See: AlphaZero Destroys Stockfish in 100 Game Match
To me, what's really salient is that "much like ...
CommunityBot
- 1
3
votes
1
answer
918
views
Goal oriented Action Planning with multiple Agents
I'm a little bit stuck:
I implemented an AI with GOAP (Goal oriented Action Planning, http://alumni.media.mit.edu/~jorkin/gdc2006_orkin_jeff_fear.pdf) for a simulation game. That works fine.
Now I ...
- 146
1
vote
0
answers
712
views
How to teach an AI to race optimally in a racing game?
I play a racing game called Need For Madness ( some gameplay: https://www.youtube.com/watch?v=NC5uFZ-t0A8 ). NFM is a racing game, where the player can choose different cars and race and crash the ...
- 6,207
1
vote
0
answers
53
views
Mini (local) NN for Mobile?
I'm working on architecture for a game AI where, due to the nature of the game, the classical approach seems likely be sufficient to beat most humans--the endgame is tractable and traditional game-...
- 6,207
1
vote
0
answers
199
views
Help with implementing Q-learning for a feedfoward network playing a video game
I want to train a feedforward neural network to play a video game called Puyo Puyo 2, using reinforcement learning. More specifically, I'm trying Q-learning but I'm open to better alternatives.
In ...
- 6,207
1
vote
1
answer
118
views
How can an AI make tactical manoeuvres?
I'm working on a multi-player game that involves a board/map where there are walls, cover or open ground. The players then take turns moving units around and undertaking discrete actions, like move, ...
CommunityBot
- 1
2
votes
0
answers
88
views
Making behavior tree execute action for specific time?
Say I need to make an action such as "Walk" perform for 2 seconds using a behavior tree which has access to a timer.
The timer can do the following:
start, time (get value of timer), and reset.
If ...
- 21
4
votes
1
answer
2k
views
How much memory does the Deepstack poker program require?
I was reading a little bit about the Deepstack poker program:
DeepStack the first computer program to outplay human professionals at heads-up no-limit Texas hold'em poker
DeepStack: Expert-Level ...
- 6,207
4
votes
2
answers
486
views
How to define or represent evil in logic
Is there any well defined method to define or represent evil in abstract logic, binary or AI form?
Video games method of representing evil is relative to the player context (thus subjective, and not ...
CommunityBot
- 1
9
votes
2
answers
2k
views
What's the difference between Starcraft and Dota from an AI perspective?
So, Deepmind is pushing for a human level Starcraft bot and Open AI just created a human level 1vs1 Dota bot.
Unfortunately, I've no clue what that signifies because I've never played Starcraft nor ...
- 2,051