Questions tagged [game-ai]

For questions related to game design involving AI.

Filter by
Sorted by
Tagged with
20
votes
4answers
6k views

How to handle invalid moves in reinforcement learning?

I want to create an AI which can play five-in-a-row/gomoku. As I mentioned in the title, I want to use reinforcement learning for this. I use policy gradient method, namely REINFORCE, with baseline. ...
13
votes
2answers
1k views

Input/output encoding for a neural network to learn a grid-based game

I am writing a simple toy game with the intent of training a deep neural network on top of it. The games rules are roughly the following: The game has a board made up of hexagonal cells. Both players ...
12
votes
5answers
5k views

How do I choose which algorithm is best for something like a checkers board game?

I am currently new to artificial intelligence but I am very intrigued by it. I am currently researching three algorithms, namely: Minimax, Alpha-beta pruning and Monte Carlo tree search. As you may ...
11
votes
3answers
7k views

How to train a neural network for a round based board game?

I'm wondering how to train a neural network for a round based board game like, tic-tac-toe, chess, risk or any other round based game. Getting the next move by inference seems to be pretty straight ...
11
votes
2answers
838 views

Is AlphaZero an example of an AGI?

From DeepMind's research paper on arxiv.org: In this paper, we apply a similar but fully generic algorithm, which we call AlphaZero, to the games of chess and shogi as well as Go, without any ...
10
votes
4answers
358 views

Can a neural network work out the concept of distance?

Imagine a game where it is a black screen apart from a red pixel and a blue pixel. Given this game to a human, they will first see that pressing the arrow keys will move the red pixel. The next thing ...
9
votes
1answer
1k views

A few doubts regarding the application of reinforcement learning to games like chess

I invented a chess-like board game. I built an engine so that it can play autonomously. The engine is basically a decision tree. It's composed by: A search function that at each node finds all ...
8
votes
2answers
436 views

Does Monte Carlo Search (specifically used by AlphaZero) Qualify as Machine Learning?

To the best of my understanding, Monte Carlo Search is an alternative method to Minimax for searching a tree of nodes. It works by choosing a move (generally the one with the highest chance of being ...
7
votes
2answers
2k views

What's the difference between Starcraft and Dota from an AI perspective?

So, Deepmind is pushing for a human level Starcraft bot and Open AI just created a human level 1vs1 Dota bot. Unfortunately, I've no clue what that signifies because I've never played Starcraft nor ...
6
votes
1answer
823 views

Is the new Alpha Go implementation using Generative Adversarial Networks?

I read through the publication Mastering the game of Go without Human Knowledge. It doesn't seem to use GANs, just a new form of search and reinforcement learning.
6
votes
3answers
883 views

Why does Monte Carlo work when a real opponent's behavior may not be random

I am learning about Monte Carlo algorithms and struggling to understand the following: If simulations are based on random moves, how can the modeling of the opponent's behavior work well? For ...
6
votes
2answers
129 views

Evolving network in game

So I wrote simple feed forward neural network that plays tic-tac-toe: 9 neurons in input layers: 1 - my sign, -1 - opponent's sign, 0 - empty; 9 neurons in hidden layer: value calculated using Relu; ...
6
votes
2answers
397 views

Reinforcement Learning in Commercial Strategy Games

I'm a professional game developer investigating the potential for using reinforcement learning to build strategy game AI opponents that have more creative behavior compared to traditional techniques ...
6
votes
1answer
180 views

Issue with simple game AI

A few months ago I made a simple game that is similar to the dinosaur game in Google Chrome - you jump over obstacles, or don't jump over levitating obstacles, and jump to collect bitcoins, which can ...
5
votes
1answer
105 views

Can this tic tac toe program be considered AI?

I coded a tic tac toe program, but I don't know if I can call it artificial intelligence. Here's what I did. There is a random player, which always makes random valid moves. And then there is the ...
5
votes
2answers
116 views

What are the most compact Real Time-Strategy Games?

There was a recent informal question on chat about RTS games suitable for AI benchmarks, and I thought it would be useful to ask a question about them in relation to AI research. Compact is defined ...
5
votes
1answer
102 views

Can you analyse a neural network to determine good states?

I've developed a neural network that can play a card game. I now want to use it to create decks for the game. My first thought would be to run a lot of games with random decks and use some ...
5
votes
1answer
58 views

Why didn't champion of the Go game manage to win the last game against AlphaGo, after winning the 4th one?

In the documentary about the match, it is said that after losing the 4th game, AlphaGo came back stronger and started to play in a weird way (not human-like) and it was pretty impossible to be beaten. ...
5
votes
1answer
68 views

Understanding the expansion phase in Monte Carlo Tree Search

All sources I can find provide a similar explanation to each phase. In the Selection Phase, we start at the root and choose child nodes until reaching a leaf. Once the leaf is reached (assuming the ...
5
votes
1answer
79 views

What is the appropriate approach to playing a game with incomplete state information?

I have a steady hex-map and turn-based war game featuring WWII carrier battles. I would like to improve the fixed policy for the AI using reinforcement learning. I have some beginner's questions, ...
5
votes
2answers
368 views

More effective way to improve the heuristics of an AI… evolution or testing between thousands of pre-determined sets of heuristics?

I'm making a Connect Four game where my engine uses Minimax with Alpha-Beta pruning to search. Since Alpha-Beta pruning is much more effective when it looks at the best moves first (since then it can ...
5
votes
1answer
394 views

Game AI - Fast python OCR or cropped image input

I'm developing a Game AI which tries to master racing simulations. I already trained a CNN (alexnet) on ingame footage of me playing the game and the pressed keys as the target. As the CNN is only ...
4
votes
2answers
692 views

How do I create an ai for a two players board game?

Brief idea I want to create an artificial intelligence to compete against other players in a board game. Game explanation I have a board game similar to 'snakes and ladders'. You have to get to a ...
4
votes
1answer
1k views

How much memory does the Deepstack poker program require?

I was reading a little bit about the Deepstack poker program: DeepStack the first computer program to outplay human professionals at heads-up no-limit Texas hold'em poker DeepStack: Expert-Level ...
4
votes
1answer
350 views

Algorithms for games with very high branching factors (Connect6)

Connect6 is an example of a game with a very high branching factor. It is about 45 thousand, dwarfing even the impressive Go. What algorithms can you use on games with such high branching factors? I ...
4
votes
3answers
411 views

How to define or represent evil in logic

Is there any well defined method to define or represent evil in abstract logic, binary or AI form? Video games method of representing evil is relative to the player context (thus subjective, and not ...
4
votes
2answers
172 views

Neural Network with varying inputs (for a game ai)

I want to create a simple game which basically consists of 2d circles shooting smaller circles at each other (to make hitbox detection easier for the start). My goal is to create an ai which adapts ...
4
votes
1answer
2k views

Why most imperfect information games usually use non machine learning AI?

To provide a bit of context, I'm a software engineer & game enthusiast (card games specially). The thing is I've always been interested in AI oriented to games. In college, I programmed my own ...
4
votes
1answer
74 views

How does Hearthstone AI deal with random events

I want to learn a lot about the AI of CCG, such as Hearthstone. And now I have known one of the main algorithms that used in this kind of games, MCTS. It analyses the most promising moves, and expands ...
4
votes
1answer
109 views

Algorithm For Making Balanced Weapons In A Game?

I am trying to make balanced weapon pairs. So there are five stats per weapon, and I am simulating a number of combats (1000) with different stats randomized, and counting the win, lose, and draw of ...
4
votes
3answers
2k views

What else can boost iterative deepening with alpha beta pruning?

I read about minimax, then alpha-beta pruning and then about iterative deepening. Iterative deepening coupled with alpha-beta pruning proves to quite efficient as compared alpha-beta alone. I have ...
4
votes
2answers
235 views

Inconsistency in TD-Leaf algorithm in KnightCap chess engine

Notice that, in the following formula, at the very right, the term multiplied with $\lambda$ is $d_i$ $$ w := w + \alpha \sum_{i=1}^{N-1} \nabla r(x_i^l, w) \Big \lfloor \sum_{j=i}^{N-1} \lambda^{j-i}...
4
votes
1answer
417 views

Alpha-beta pruning algorithms optimizations

I know that they are quite alot of optimizations for alpha-beta pruning but what does it mean exactly: 1) Does it mean that these optimized algorithms are to be integrated into the alpha-beta ...
4
votes
4answers
216 views

What if there's a game where all the AI people actually lived?

Imagine the fictitious scenario in a role playing game (RPG) where the non-playing characters (NPCs) within the RPG are conscious of their own surrounding and consider the developer to be god. The ...
4
votes
1answer
274 views

Representing inputs and outputs for a card game neural network

I'm attempting to create an AI for a card game using reinforcement learning. The basics of the game are that you can have (theoretically) up to 35 cards in your hand, you can also have to up to 35 ...
4
votes
1answer
228 views

Fitness Function altenatives in Genetic Algorithms for game AI

I have created a Gomoku(5 in a row) AI using Alpha-Beta Pruning. It makes moves on a not-so-stupid level. First, let me vaguely describe the grading function of the Alpha-Beta algorithm. When it ...
4
votes
0answers
82 views

Old video games intelligence

Around 2000, existed popular fights videogames. There, if you made the same kick movement for several running times, the CPU normally defended and caught your strategy. This is the case in Tekken 3 ie....
4
votes
1answer
58 views

How do we find the length (depth) of the game tic-tac-toe in adversarial search?

When we perform the tic-tac-toe game using adversarial search I know how make a tree. Is there a way to find the depth of the tree; which level is the last level?
4
votes
2answers
699 views

How to go forward with creating an artifically intelligent aimbot for a game like CS:GO

Artificial Intelligence can be realized as a full autonomous or as a semi-autonomous system. A full autonomous system takes the human operator out of the loop, his hands are away from keyboard and he ...
4
votes
0answers
2k views

Is this a good way to represent Connect 4 to a Neural Network?

I'm attempting to make a bot for the Connect 4 competition on http://riddles.io My bot isn't horrible, like it's getting up the ladder, but it cannot compete with the winning bots. I'm using a ...
4
votes
0answers
141 views

Game AI - Modify image classification model for analog output

I'm developing a Game AI which tries to master racing simulation. I already trained a CNN (alexnet) on ingame footage of me playing the game and the pressed keys as the target. I had two main issues ...
3
votes
2answers
157 views

Is an evaluation function as good as an optimization function

I have been so for self-learning basic A.I concepts and would like to know if having a really good evaluation function as good as any of alpha-beta pruning optimization functions such as killer moves, ...
3
votes
3answers
96 views

How to calculate the optimal placements for settlements in Catan without an ML algorithm?

Is it possible to calculate the best possible placements for settlements in Catan without using an ML algorithm? While it is trivial to simply add up the numbers surrounding the settlement (highest ...
3
votes
2answers
208 views

Can a game AI learn the concept of acceleration?

If the game had a variable speed and was essential in evolution/gaining score(IDK AI terminologies). Would the AI be able to figure out when to slow down and speed up? If it is able to solve the ...
3
votes
2answers
411 views

Creating a self learning Mario Kart game AI?

I will be undertaking a project over the next year to create a self learning AI to play a racing game, currently the game will be Mario Kart 64. I have a few questions which will hopefully help me ...
3
votes
2answers
93 views

How can a neural network learn to play sudoku?

I'm just beginning to understand neural networks and I've performed a couple of successful tests with numerical series where the NN was trained to find the odd one or a missing value. It all works ...
3
votes
3answers
394 views

AI in dota2 vs AI in starcraft

I am just curious what AI would be harder to create from a strictly engineering point of view. AI which would win 1vs 1 game with the best player in starcraft or AI which would control a team the ...
3
votes
1answer
91 views

How do I solve the problem of positioning 11 pieces into a 8x8 puzzle?

I was trying to figure out how to create a solver to the puzzle of putting 11 pieces in a board (8 x 8). I created the game in http://www.xams.com.br/quebra. It is possible to turn the piece 90 ...
3
votes
2answers
1k views

What type of neural network would be most feasible for playing a realtime game?

For implementing a neural network algorithm that can play air hockey, I had two ideas for input, and I'm trying to figure out which design would be most viable. The output must be two analog values ...
3
votes
1answer
749 views

How do I apply reinforcement learning to a game with infinitely many actions?

I am trying to figure out how to use a reinforcement learning algorithm, if possible, as a "black box" to play a game. In this game, a player has to avoid flying birds. If he wants to move, he has to ...