Questions tagged [game-ai]

For questions related to game design involving AI.

Filter by
Sorted by
Tagged with
19 votes
3 answers
11k views

How do I choose the best algorithm for a board game like checkers?

How do I choose the best algorithm for a board game like checkers? So far, I have considered only three algorithms, namely, minimax, alpha-beta pruning, and Monte Carlo tree search (MCTS). Apparently,...
JoeyB's user avatar
  • 477
10 votes
1 answer
2k views

Is AlphaZero an example of an AGI?

From DeepMind's research paper on arxiv.org: In this paper, we apply a similar but fully generic algorithm, which we call AlphaZero, to the games of chess and shogi as well as Go, without any ...
Siddhartha's user avatar
10 votes
3 answers
3k views

How can you represent the state and action spaces for a card game in the case of a variable number of cards and actions?

I know how a machine can learn to play Atari games (Breakout): Playing Atari with Reinforcement Learning. With the same technique, it is even possible to play FPS games (Doom): Playing FPS Games with ...
Stefe Klauou's user avatar
3 votes
2 answers
974 views

How can both agents know the terminal reward in self-play reinforcement learning?

There seems to be a major difference in how the terminal reward is received/handled in self-play RL vs "normal" RL, which confuses me. I implemented TicTacToe the normal way, where a single ...
user3877351's user avatar
15 votes
3 answers
4k views

Does Monte Carlo tree search qualify as machine learning?

To the best of my understanding, the Monte Carlo tree search (MCTS) algorithm is an alternative to minimax for searching a tree of nodes. It works by choosing a move (generally, the one with the ...
Inertial Ignorance's user avatar
9 votes
2 answers
2k views

What's the difference between Starcraft and Dota from an AI perspective?

So, Deepmind is pushing for a human level Starcraft bot and Open AI just created a human level 1vs1 Dota bot. Unfortunately, I've no clue what that signifies because I've never played Starcraft nor ...
BlindKungFuMaster's user avatar
9 votes
1 answer
2k views

Should I use neural networks or genetic algorithms to solve Gomoku?

Currently, I'm doing a project that's about creating an AI to play the game Gomoku (it's like tic tac toe, but played on a 1515 board and requires 5 in a row to win). I have already successfully ...
Conway's user avatar
  • 93
8 votes
1 answer
2k views

Any interesting ways to combine Monte Carlo tree search with the minimax algorithm?

I've been working on a game-playing engine for about half a year now, and it uses the well known algorithms. These include minimax with alpha-beta pruning, iterative deepening, transposition tables, ...
Inertial Ignorance's user avatar
7 votes
1 answer
635 views

When does the selection phase exactly end in MCTS?

All sources I can find provide a similar explanation to each phase. In the Selection Phase, we start at the root and choose child nodes until reaching a leaf. Once the leaf is reached (assuming the ...
Ralff's user avatar
  • 173
6 votes
1 answer
499 views

How should the racing agent take into account the velocity of the vehicle, given the images with a speedometer?

I'm developing a game AI, which tries to master racing simulations. I already trained a CNN (AlexNet) on in-game footage of me playing the game and the pressed keys as the target. As the CNN is only ...
TheJD's user avatar
  • 103
6 votes
4 answers
6k views

What else can boost iterative deepening with alpha-beta pruning?

I read about minimax, then alpha-beta pruning, and then about iterative deepening. Iterative deepening coupled with alpha-beta pruning proves to quite efficient as compared to alpha-beta alone. I have ...
Suhail Gupta's user avatar
5 votes
1 answer
767 views

How can I apply reinforcement learning to solve this asteroid game?

Introduction An attractive asteroid game was described in the paper Learning Policies for Embodied Virtual Agents through Demonstration (2017, Jonathan Dinerstein et al.): In our first experiment, ...
GIA's user avatar
  • 568
4 votes
1 answer
399 views

What is the state-space complexity of Spades?

AI reached super-human level in many complex games, including imperfect information games such as six-player no-limit Texas hold’em poker. However, it still did not reached that level in Trick-taking ...
Cohensius's user avatar
  • 413
3 votes
1 answer
1k views

How do I write a good evaluation function for a board game?

I'm currently writing the Alpha-Beta pruning algorithm for a board game. Now I need to come up with a good evaluation function. The game is a bit like snakes and ladders (you have to finish the race ...
po0l's user avatar
  • 119
3 votes
3 answers
551 views

AI in dota2 vs AI in starcraft

I am just curious what AI would be harder to create from a strictly engineering point of view. AI which would win 1vs 1 game with the best player in starcraft or AI which would control a team the ...
Ignacy Ślusarczyk's user avatar
2 votes
1 answer
839 views

Why isn't my Q-Learning agent able to play tic-tac-toe?

I tried to build a Q-learning agent which you can play tic tac toe against after training. Unfortunately, the agent performs pretty poorly. He tries to win but does not try to make me 'not winning' ...
SHA256man's user avatar
1 vote
1 answer
738 views

What was the average decision speed pf Alpha Zero in the recent Stockfish match?

The match got a lot of press, and I doubt anyone is surprised that Alpha Zero crushed Stockfish. See: AlphaZero Destroys Stockfish in 100 Game Match To me, what's really salient is that "much like ...
DukeZhou's user avatar
  • 6,237
1 vote
0 answers
450 views

What is the size of 6-players no limit Texas holdem Poker?

What is the number of game states/information sets in 6-players, no limit, Texas Holdem? A year ago, Pluribus reached a super-human level in 6-players no limit Holdem Poker. I am interested in the ...
Cohensius's user avatar
  • 413
1 vote
0 answers
180 views

Monte Carlo Exploring Starts broke for 2048 game AI

I implemented a MCES for 2048 (the game), with a quality function implemented as a neural net of a single layer. The starts are created with 6 cells filled with values between 64 and 1024, two cells ...
EmmanuelMess's user avatar
0 votes
5 answers
1k views

Can an AI learn how to play chess without instructions?

Can an AI learn to play chess if you give it nothing but "the goal is to win" as starting criteria? If not, what is the minimum information the AI would need to be "seeded" with in order to learn to ...
TheAutomaton's user avatar