Questions tagged [game-ai]
For questions related to game design involving AI.
240
questions
9
votes
5
answers
3k
views
What are examples of approaches to create an AI for a fighting robot in an MMO game?
I have an MMO game where I have players. I wanted to invent something new to the game, and add player-bots to make the game be single-playable as well. The AI I want to add is simply only for fighting ...
- 38.2k
4
votes
1
answer
466
views
How do I use a genetic algorithm to generate the scores of an evaluation function for alpha-beta pruning?
I have created a Gomoku (5 in a row) AI using Alpha-Beta Pruning. It makes moves on a not-so-stupid level. First, let me vaguely describe the evaluation function of the Alpha-Beta algorithm.
When it ...
- 38.2k
5
votes
1
answer
115
views
Why didn't champion of the Go game manage to win the last game against AlphaGo, after winning the 4th one?
In the documentary about the match, it is said that after losing the 4th game, AlphaGo came back stronger and started to play in a weird way (not human-like) and it was pretty impossible to be beaten. ...
- 38.2k
17
votes
1
answer
3k
views
How does "Monte-Carlo search" work?
I have heard about this concept in a Reddit post about AlphaGo. I have tried to go through the paper and the article, but could not really make sense of the algorithm.
So, can someone give an easy-to-...
- 38.2k
-1
votes
1
answer
192
views
Do I need a large pool of training data to train a bot to play the 'pegging' game in the cribbage card game
The game of cribbage https://en.wikipedia.org/wiki/Cribbage is a two-player card game played over a series of deal with the goal to reach 121 points.
The game's elements are:
the discard. There are ...
CommunityBot
- 1
2
votes
1
answer
116
views
How can I improve the performance of my approach to solving a 1-player version of the card game "The Game" by Steffen Benndorf?
I would like to create an AI for the 1 player version of the card game called "The Game" by Steffen Benndorf (rules here: https://nsv.de/wp-content/uploads/2018/05/the-game-english.pdf).
The ...
- 38.2k
5
votes
1
answer
2k
views
How to handle varying types and length of inputs in a feedforward neural network?
After learning the basics of neural networks and coding one working with the MNIST dataset, I wanted to go to the next step by making one which is able to play a game. I wanted to make it work on a ...
- 38.2k
1
vote
0
answers
60
views
How to teach Machine Learning Agent to destroy replicating objects in a puzzle game?
I have an unusual but very interesting problem. I have a game that is very similar to Toon Blast (a puzzle mobile game). It's based on a Match-2 mechanic in which you can destroy 2 or more connected ...
- 38.2k
10
votes
1
answer
1k
views
Is AlphaZero an example of an AGI?
From DeepMind's research paper on arxiv.org:
In this paper, we apply a similar but fully generic algorithm, which
we call AlphaZero, to the games of chess and shogi as well as Go,
without any ...
- 38.2k
4
votes
0
answers
175
views
Can AlexNet be changed to produce floating-point outputs in the range $[-1, 1]$, and, if not, which model should I use?
I'm developing a game AI, which tries to master racing simulation. I already trained a CNN (AlexNet) on in-game footage of me playing the game and the pressed keys as the target.
I had two main issues ...
- 38.2k
6
votes
1
answer
495
views
How should the racing agent take into account the velocity of the vehicle, given the images with a speedometer?
I'm developing a game AI, which tries to master racing simulations. I already trained a CNN (AlexNet) on in-game footage of me playing the game and the pressed keys as the target. As the CNN is only ...
- 38.2k
2
votes
1
answer
152
views
Are strong Chess AI's local on mobile devices? [closed]
Just wondering about the architecture of strong Chess AI in a mobile, because networking is generally assumed by mobile developers, but not guaranteed.
- 38.2k
1
vote
1
answer
1k
views
How should I define the reward function for a stock trading-like game?
Problem setting
Consider a game like trading a stock
At each step, the agent can buy / sell a stock.
Trade is a pair of ...
- 38.2k
2
votes
1
answer
168
views
Which value to propagate in Monte Carlo Tree Search in a non-zero-sum game?
Usually, when I read about Monte Carlo Tree Search, values between 0 and 1 (or values between -1 and 1) are backpropagated, depending on whether the simulation was a win or loss.
Now, suppose you have ...
- 38.2k
1
vote
1
answer
130
views
How is the probability transition matrix populated in the Markov process (chain) for a board game?
Following on from my other (answered) question:
With regards to the Markov process (chain), if an environment is a board game and its states are the various position the game pieces may be in, how ...
CommunityBot
- 1
1
vote
2
answers
326
views
Would AlphaZero work just with a value network?
There is a nice post about the intuition why AlphaZero works.
One of the advantages of using a policy network in the games where a perfect simulator is available (such as chess) is to save computation ...
- 3,531
2
votes
0
answers
57
views
What AI algorithm could I use to trap an agent in a game?
Imagine a game with grid size 10x10, there is a good guy and a bad guy and obstacles in the grid, i.e. essentially a maze. The goal of the bad guy is to find the good guy and trap him by erecting ...
- 38.2k
4
votes
1
answer
323
views
Which algorithm can I use to minimise the number of wins of 2 weapons that fight each other in a game?
I have a game that involves 2 weapons, which fight against each other. Each weapon has 5 features/statistics, which have certain range. I can simulate the game $N$ times with randomly initialised ...
- 38.2k
2
votes
0
answers
31
views
Demonstration of AI-powered Mario collecting lots of coins?
As part of a talk I'm giving, I'd like to show one of the many videos on YouTube where an AI is playing Mario, such as this one. What bothers me though is that the AI is trying to complete the level ...
- 261
3
votes
0
answers
181
views
How to handle cycles in minimax algorithm
For example, I am implementing AI for turn based game and have enough computational resources for build full game tree. My problem is the game can be infinite if both players will repeat moves and my ...
- 1
18
votes
5
answers
18k
views
How can I design and train a neural network to play a card game (similar to Magic: The Gathering)?
Introduction
I am currently writing an engine to play a card game, as there is no engine yet for this particular game.
About the game
The game is similar to Magic: The Gathering. There is a commander, ...
0
votes
1
answer
96
views
Is my single layer perceptron getting biased input some way or the other?
I was working a little bit on a school project my team and I decided to do for submission in the year-end. It's a small game which I call 'Quattro', and its rules are as follows:
The game is played ...
- 842
1
vote
2
answers
475
views
How does one handle different player turns in MCTS?
Suppose we have a two player game like Tic Tac Toe where the two players take turns to play their moves. It is my understanding that in the game tree that MCTS builds, consecutive levels in the tree ...
- 159
1
vote
0
answers
277
views
Why doesn't this Monte Carlo Tree Search algorithm work properly?
PROBLEM
I'm writing a Monte-Carlo tree search algorithm to play chess in Python. I replaced the simulation stage with a custom evaluation function. My code looks perfect but for some reason acts ...
0
votes
1
answer
158
views
How to approach a two-agent two-step action game?
A simple two-player sniper game:
Each player has 9 houses that he can reside in. So 18 houses in total. The houses can be considered in a row: e.g. 1-9 for player A, and 10-18 for player B.
Each ...
- 61
4
votes
1
answer
504
views
How do we find the length (depth) of the game tic-tac-toe in adversarial search?
When we perform the tic-tac-toe game using adversarial search, I know how to make a tree. Is there a way to find the depth of the tree, and which level is the last level?
- 38.2k
1
vote
0
answers
40
views
Why is the number of examined nodes $ O(b^{3d/4})$ in $\alpha$-$\beta$ pruning?
I'm taking a course 'Introduction to AI' and, in one of the tutorials, it was written that when pruning the game tree using $\alpha$-$\beta$ boundaries, the number of nodes that will be developed, ...
- 38.2k
2
votes
1
answer
126
views
What research has been done in the domain of “general game playing”?
I have come across this domain via this Wikipedia article: General game playing
So, where are we when it comes to general game playing AI? (The wiki article doesn't mention the recent advances and the ...
- 38.2k
2
votes
1
answer
527
views
How to encode card game state into neural network input
I'm trying create neural network to predict moves in a card game. I am looking for recommendations on encoding the game state to my input layer. It's a complex turn based collectible card game (...
- 405
4
votes
2
answers
471
views
How is the AI in 3d games implemented?
A few days ago, I started looking a bit more into AI and learning about the way it works, and it is very interesting, but I can't find a clear answer on how the artificial intelligence is implemented ...
- 27k
1
vote
1
answer
288
views
Find the expected reward in an expectimax-based dice rolling game?
I have this question that I'm kinda stuck on.
It's a game scenario in which we set up an expectimax tree. In the game, you have 3 dice with sides 1-4 that you roll at the beginning. Then, depending on ...
- 405
4
votes
1
answer
331
views
What is the state-space complexity of Spades?
AI reached super-human level in many complex games, including imperfect information games such as six-player no-limit Texas hold’em poker. However, it still did not reached that level in Trick-taking ...
- 405
0
votes
0
answers
37
views
Incorrect node expansion in game board with A* search
I have the following game board below, and we're using A* search to find the optimal path from the agent to the key. There are 8 directions. Up, down, left, right have a cost of 1, and diagonal ...
- 21
1
vote
2
answers
2k
views
Minimax combined with machine learning to determine if a path should be explored
I have an idea for a new type of AI for two-player games with alternating turns, like chess, checkers, connect four, and so on.
A little background: Traditionally engines for such games have used the ...
CommunityBot
- 1
2
votes
0
answers
154
views
Is this a good approach to evaluate the game state with a neural network?
I've written a Monte Carlo Tree Search player for the game of Castle (AKA Shithead, Shed, Palace...). I have set this MCTS player to play against a basic rule-based AI for ~30000 games and collected ~...
- 38.2k
1
vote
1
answer
71
views
Embedding Isolation game states into key values for RL
I'm trying to think of how I can embed a game's state into a unique key value. The game I'm specifically working with is Isolation: https://en.wikipedia.org/wiki/Isolation_(board_game). The game state ...
- 27k
1
vote
1
answer
1k
views
How to design a good evaluation function for a go-like game?
I am trying to find a good evaluation function for a game with:
A 7x7 tile board
2 players, given an equal number(>=3 currently undetermined) of stones placed randomly on the tiles
A turn is ...
- 38.2k
3
votes
1
answer
1k
views
How do I write a good evaluation function for a board game?
I'm currently writing the Alpha-Beta pruning algorithm for a board game. Now I need to come up with a good evaluation function. The game is a bit like snakes and ladders (you have to finish the race ...
- 38.2k
1
vote
1
answer
755
views
Is it standard to say that an evaluation function estimates the “goodness” of a position?
Wikipedia states that:
An evaluation function, also known as a heuristic evaluation function or static evaluation function, is a function used by game-playing computer programs to estimate the value ...
- 38.2k
5
votes
1
answer
601
views
Can games be solved without an evaluation function?
Fundamentally, a game-playing AI must solve the problem of choosing the best action from a set of possible actions.
Most existing game AI's, such as AlphaGo, do this by using an evaluation function, ...
- 38.2k
1
vote
3
answers
2k
views
What sort of game problems can neural networks trained/evolved with evolutionary algorithms solve, and how are they typically implemented?
I'm interested mostly in the application of AI in gaming; in case this adjusts the way you answer, but general answers are more than welcome as well.
I was reading up on Neural Networks and combining ...
- 38.2k
6
votes
4
answers
5k
views
What else can boost iterative deepening with alpha-beta pruning?
I read about minimax, then alpha-beta pruning, and then about iterative deepening. Iterative deepening coupled with alpha-beta pruning proves to quite efficient as compared to alpha-beta alone.
I have ...
- 38.2k
3
votes
2
answers
469
views
Is a good evaluation function as good as any of the extensions of alpha-beta pruning?
I would like to know if having a really good evaluation function is as good as using any of the extensions of alpha-beta pruning, such as killer moves or quiescence search?
- 38.2k
6
votes
1
answer
993
views
What are good learning strategies for Deep Q-Network with opponents?
I am trying to find out what are some good learning strategies for Deep Q-Network with opponents. Let's consider the well-known game Tic-Tac-Toe as an example:
How should an opponent be implemented ...
- 38.2k
9
votes
1
answer
1k
views
Should I use neural networks or genetic algorithms to solve Gomoku?
Currently, I'm doing a project that's about creating an AI to play the game Gomoku (it's like tic tac toe, but played on a 1515 board and requires 5 in a row to win). I have already successfully ...
- 38.2k
0
votes
2
answers
85
views
What is the meaning of the terms in this evaluation function for chess?
I'm trying to improve my evaluation and I saw this here
...
- 1,411
2
votes
1
answer
225
views
Have machine learning techniques been used to play outdoor games, like cricket or badminton?
Have machine learning techniques been used to play outdoor games, like cricket or badminton?
- 38.2k
6
votes
1
answer
5k
views
Why most imperfect information games usually use non machine learning AI?
To provide a bit of context, I'm a software engineer & game enthusiast (card games, especially). The thing is I've always been interested in AI oriented to games. In college, I programmed my own ...
- 38.2k
1
vote
2
answers
2k
views
How can I use a 2-dimensional feature matrix as the input to a neural network?
How can I use a 2-dimensional feature matrix, rather than a feature vector, as the input to a neural network?
For a WWII naval wargame, I have sorted out the features of interest to approximate the ...
- 38.2k
2
votes
2
answers
584
views
How can I design a reinforcement learning model for a game with multiple complex actions taken at a time?
I have a steady hex-map and turn-based wargame featuring WWII carrier battles.
On a given turn, a player may choose to perform a large number of actions. Actions can be of many different types, and ...
- 38.2k