Questions tagged [game-ai]
For questions related to game design involving AI.
How do I choose the best algorithm for a board game like checkers?
How do I choose the best algorithm for a board game like checkers? So far, I have considered only three algorithms, namely, minimax, alpha-beta pruning, and Monte Carlo tree search (MCTS). Apparently,...
Is AlphaZero an example of an AGI?
From DeepMind's research paper on arxiv.org: In this paper, we apply a similar but fully generic algorithm, which we call AlphaZero, to the games of chess and shogi as well as Go, without any ...
How can you represent the state and action spaces for a card game in the case of a variable number of cards and actions?
I know how a machine can learn to play Atari games (Breakout): Playing Atari with Reinforcement Learning. With the same technique, it is even possible to play FPS games (Doom): Playing FPS Games with ...
How can both agents know the terminal reward in self-play reinforcement learning?
There seems to be a major difference in how the terminal reward is received/handled in self-play RL vs "normal" RL, which confuses me. I implemented TicTacToe the normal way, where a single ...
Does Monte Carlo tree search qualify as machine learning?
To the best of my understanding, the Monte Carlo tree search (MCTS) algorithm is an alternative to minimax for searching a tree of nodes. It works by choosing a move (generally, the one with the ...
Should I use neural networks or genetic algorithms to solve Gomoku?
Currently, I'm doing a project that's about creating an AI to play the game Gomoku (it's like tic tac toe, but played on a 1515 board and requires 5 in a row to win). I have already successfully ...
What's the difference between Starcraft and Dota from an AI perspective?
So, Deepmind is pushing for a human level Starcraft bot and Open AI just created a human level 1vs1 Dota bot. Unfortunately, I've no clue what that signifies because I've never played Starcraft nor ...
When does the selection phase exactly end in MCTS?
All sources I can find provide a similar explanation to each phase. In the Selection Phase, we start at the root and choose child nodes until reaching a leaf. Once the leaf is reached (assuming the ...
Any interesting ways to combine Monte Carlo tree search with the minimax algorithm?
I've been working on a game-playing engine for about half a year now, and it uses the well known algorithms. These include minimax with alpha-beta pruning, iterative deepening, transposition tables, ...
What else can boost iterative deepening with alpha-beta pruning?
I read about minimax, then alpha-beta pruning, and then about iterative deepening. Iterative deepening coupled with alpha-beta pruning proves to quite efficient as compared to alpha-beta alone. I have ...
How should the racing agent take into account the velocity of the vehicle, given the images with a speedometer?
I'm developing a game AI, which tries to master racing simulations. I already trained a CNN (AlexNet) on in-game footage of me playing the game and the pressed keys as the target. As the CNN is only ...
How can I apply reinforcement learning to solve this asteroid game?
Introduction An attractive asteroid game was described in the paper Learning Policies for Embodied Virtual Agents through Demonstration (2017, Jonathan Dinerstein et al.): In our first experiment, ...
What is the state-space complexity of Spades?
AI reached super-human level in many complex games, including imperfect information games such as six-player no-limit Texas hold’em poker. However, it still did not reached that level in Trick-taking ...
AI in dota2 vs AI in starcraft
I am just curious what AI would be harder to create from a strictly engineering point of view. AI which would win 1vs 1 game with the best player in starcraft or AI which would control a team the ...
How do I write a good evaluation function for a board game?
I'm currently writing the Alpha-Beta pruning algorithm for a board game. Now I need to come up with a good evaluation function. The game is a bit like snakes and ladders (you have to finish the race ...
Why isn't my Q-Learning agent able to play tic-tac-toe?
I tried to build a Q-learning agent which you can play tic tac toe against after training. Unfortunately, the agent performs pretty poorly. He tries to win but does not try to make me 'not winning' ...
Monte Carlo Exploring Starts broke for 2048 game AI
I implemented a MCES for 2048 (the game), with a quality function implemented as a neural net of a single layer. The starts are created with 6 cells filled with values between 64 and 1024, two cells ...
What was the average decision speed pf Alpha Zero in the recent Stockfish match?
The match got a lot of press, and I doubt anyone is surprised that Alpha Zero crushed Stockfish. See: AlphaZero Destroys Stockfish in 100 Game Match To me, what's really salient is that "much like ...
What is the size of 6-players no limit Texas holdem Poker?
What is the number of game states/information sets in 6-players, no limit, Texas Holdem? A year ago, Pluribus reached a super-human level in 6-players no limit Holdem Poker. I am interested in the ...