Questions tagged [game-ai]
For questions related to game design involving AI.
19
questions
17
votes
3
answers
10k
views
How do I choose the best algorithm for a board game like checkers?
How do I choose the best algorithm for a board game like checkers?
So far, I have considered only three algorithms, namely, minimax, alpha-beta pruning, and Monte Carlo tree search (MCTS). Apparently,...
- 457
10
votes
1
answer
1k
views
Is AlphaZero an example of an AGI?
From DeepMind's research paper on arxiv.org:
In this paper, we apply a similar but fully generic algorithm, which
we call AlphaZero, to the games of chess and shogi as well as Go,
without any ...
- 413
9
votes
3
answers
3k
views
How can you represent the state and action spaces for a card game in the case of a variable number of cards and actions?
I know how a machine can learn to play Atari games (Breakout): Playing Atari with Reinforcement Learning. With the same technique, it is even possible to play FPS games (Doom): Playing FPS Games with ...
- 191
3
votes
2
answers
887
views
How can both agents know the terminal reward in self-play reinforcement learning?
There seems to be a major difference in how the terminal reward is received/handled in self-play RL vs "normal" RL, which confuses me.
I implemented TicTacToe the normal way, where a single ...
- 81
15
votes
3
answers
3k
views
Does Monte Carlo tree search qualify as machine learning?
To the best of my understanding, the Monte Carlo tree search (MCTS) algorithm is an alternative to minimax for searching a tree of nodes. It works by choosing a move (generally, the one with the ...
9
votes
1
answer
1k
views
Should I use neural networks or genetic algorithms to solve Gomoku?
Currently, I'm doing a project that's about creating an AI to play the game Gomoku (it's like tic tac toe, but played on a 1515 board and requires 5 in a row to win). I have already successfully ...
- 93
8
votes
2
answers
2k
views
What's the difference between Starcraft and Dota from an AI perspective?
So, Deepmind is pushing for a human level Starcraft bot and Open AI just created a human level 1vs1 Dota bot.
Unfortunately, I've no clue what that signifies because I've never played Starcraft nor ...
- 4,127
7
votes
1
answer
537
views
When does the selection phase exactly end in MCTS?
All sources I can find provide a similar explanation to each phase.
In the Selection Phase, we start at the root and choose child nodes until reaching a leaf. Once the leaf is reached (assuming the ...
- 173
7
votes
1
answer
1k
views
Any interesting ways to combine Monte Carlo tree search with the minimax algorithm?
I've been working on a game-playing engine for about half a year now, and it uses the well known algorithms. These include minimax with alpha-beta pruning, iterative deepening, transposition tables, ...
6
votes
4
answers
5k
views
What else can boost iterative deepening with alpha-beta pruning?
I read about minimax, then alpha-beta pruning, and then about iterative deepening. Iterative deepening coupled with alpha-beta pruning proves to quite efficient as compared to alpha-beta alone.
I have ...
- 161
6
votes
1
answer
493
views
How should the racing agent take into account the velocity of the vehicle, given the images with a speedometer?
I'm developing a game AI, which tries to master racing simulations. I already trained a CNN (AlexNet) on in-game footage of me playing the game and the pressed keys as the target. As the CNN is only ...
- 103
5
votes
1
answer
712
views
How can I apply reinforcement learning to solve this asteroid game?
Introduction
An attractive asteroid game was described in the paper Learning Policies for Embodied Virtual Agents through Demonstration (2017, Jonathan Dinerstein et al.):
In our first experiment, ...
- 558
4
votes
1
answer
316
views
What is the state-space complexity of Spades?
AI reached super-human level in many complex games, including imperfect information games such as six-player no-limit Texas hold’em poker. However, it still did not reached that level in Trick-taking ...
- 405
3
votes
3
answers
517
views
AI in dota2 vs AI in starcraft
I am just curious what AI would be harder to create from a strictly engineering point of view. AI which would win 1vs 1 game with the best player in starcraft or AI which would control a team the ...
3
votes
1
answer
1k
views
How do I write a good evaluation function for a board game?
I'm currently writing the Alpha-Beta pruning algorithm for a board game. Now I need to come up with a good evaluation function. The game is a bit like snakes and ladders (you have to finish the race ...
- 119
2
votes
1
answer
733
views
Why isn't my Q-Learning agent able to play tic-tac-toe?
I tried to build a Q-learning agent which you can play tic tac toe against after training.
Unfortunately, the agent performs pretty poorly. He tries to win but does not try to make me 'not winning' ...
- 23
1
vote
0
answers
151
views
Monte Carlo Exploring Starts broke for 2048 game AI
I implemented a MCES for 2048 (the game), with a quality function implemented as a neural net of a single layer.
The starts are created with 6 cells filled with values between 64 and 1024, two cells ...
- 187
1
vote
1
answer
650
views
What was the average decision speed pf Alpha Zero in the recent Stockfish match?
The match got a lot of press, and I doubt anyone is surprised that Alpha Zero crushed Stockfish.
See: AlphaZero Destroys Stockfish in 100 Game Match
To me, what's really salient is that "much like ...
- 6,177
1
vote
0
answers
268
views
What is the size of 6-players no limit Texas holdem Poker?
What is the number of game states/information sets in 6-players, no limit, Texas Holdem?
A year ago, Pluribus reached a super-human level in 6-players no limit Holdem Poker. I am interested in the ...
- 405