Questions tagged [game-ai]

For questions related to game design involving AI.

Filter by
Sorted by
Tagged with
2
votes
0answers
24 views

Minimax evaluation function for games with score instead of loss/draw/win result

I am trying to create minimax evaluation function for the Ms Pacman game. The goal of the player is to maximize score. I have some idea about the features that I would like to use in my evaluation ...
0
votes
0answers
12 views

Evaluating different board states with a minimax AI algorithm python

I am working on writing a connect 4 game as well as a minimax algorithm to play against. I am currently writing and implementing the minimax algorithm. Right now I am just trying to print out all ...
1
vote
0answers
32 views

How to teach Machine Learning Agent to destroy replicating objects in a puzzle game?

I have an unusual but very interesting problem. I have a game that is very similar to Toon Blast (a puzzle mobile game). It's based on a Match-2 mechanic in which you can destroy 2 or more connected ...
0
votes
0answers
19 views

Generate gaming sequences of inputs like how GANs do for art

I need some insight on a subject given the fact that I'm not a researcher, but I am a software engineer. I want to build a model that would recommend (or generate) different paths (play sequences) in ...
2
votes
1answer
33 views

Which value to propagate in Monte Carlo Tree Search in a non-zero-sum game?

Usually, when I read about Monte Carlo Tree Search, values between 0 and 1 (or values between -1 and 1) are backpropagated, depending on whether the simulation was a win or loss. Now, suppose you have ...
1
vote
2answers
110 views

Would AlphaZero work just with a value network?

There is a nice post about the intuition why AlphaZero works. One of the advantages of using a policy network in the games where a perfect simulator is available (such as chess) is to save computation ...
2
votes
0answers
35 views

What AI algorithm could I use to trap an agent in a game?

Imagine a game with grid size 10x10, there is a good guy and a bad guy and obstacles in the grid, i.e. essentially a maze. The goal of the bad guy is to find the good guy and trap him by erecting ...
0
votes
1answer
75 views

How should I define the reward function for a stock trading-like game?

Problem setting Consider a game like trading a stock At each step, the agent can buy / sell a stock. Trade is a pair of ...
2
votes
0answers
21 views

Demonstration of AI-powered Mario collecting lots of coins?

As part of a talk I'm giving, I'd like to show one of the many videos on YouTube where an AI is playing Mario, such as this one. What bothers me though is that the AI is trying to complete the level ...
0
votes
1answer
66 views

Is my single layer perceptron getting biased input some way or the other?

I was working a little bit on a school project my team and I decided to do for submission in the year-end. It's a small game which I call 'Quattro', and its rules are as follows: The game is played ...
1
vote
1answer
25 views

How to embed game grid state with walls as an input to neural network

I've read most of the posts on here regarding this subject, however most of them deal with gameboards where there are two different categories of single pieces on a board without walls etc. My game ...
1
vote
2answers
87 views

How does one handle different player turns in MCTS?

Suppose we have a two player game like Tic Tac Toe where the two players take turns to play their moves. It is my understanding that in the game tree that MCTS builds, consecutive levels in the tree ...
1
vote
0answers
49 views

Why doesn't this Monte Carlo Tree Search algorithm work properly?

PROBLEM I'm writing a Monte-Carlo tree search algorithm to play chess in Python. I replaced the simulation stage with a custom evaluation function. My code looks perfect but for some reason acts ...
1
vote
0answers
28 views

Scrabble rack observation with MuZero

Currently I'm trying to implement Scrabble with MuZero. The $15 \times 15$ game board observation (as input) is of size $27 \times15 \times15$ (26 letters + 1 wildcard) with a value of 0 or 1. However ...
0
votes
1answer
39 views

How to approach a two-agent two-step action game?

A simple two-player sniper game: Each player has 9 houses that he can reside in. So 18 houses in total. The houses can be considered in a row: e.g. 1-9 for player A, and 10-18 for player B. Each ...
3
votes
0answers
68 views

How to handle cycles in minimax algorithm

For example, I am implementing AI for turn based game and have enough computational resources for build full game tree. My problem is the game can be infinite if both players will repeat moves and my ...
1
vote
0answers
36 views

Why is the number of examined nodes $ O(b^{3d/4})$ in $\alpha$-$\beta$ pruning?

I'm taking a course 'Introduction to AI' and, in one of the tutorials, it was written that when pruning the game tree using $\alpha$-$\beta$ boundaries, the number of nodes that will be developed, ...
0
votes
0answers
85 views

Computation of the counterfactual regret in CFR algorithm

I'm currently trying to understand the counterfactual regret minimization algorithm as presented in this document: http://modelai.gettysburg.edu/2013/cfr/cfr.pdf. I think I have a good understanding ...
4
votes
2answers
161 views

How is the AI in 3d games implemented?

A few days ago, I started looking a bit more into AI and learning about the way it works, and it is very interesting, but I can't find a clear answer on how the artificial intelligence is implemented ...
1
vote
0answers
79 views

What is the size of 6-players no limit Texas holdem Poker?

What is the number of game states/information sets in 6-players, no limit, Texas Holdem? A year ago, Pularius reached a super-human level in 6-players no limit Holdem Poker. I am interested in the ...
1
vote
1answer
186 views

Determining minimal state representation for maze game

I came across this question set. It asks following question: Let’s revisit our bug friends from assignment 2. To recap, you control one or more insects in a rectangular maze-like environment with ...
1
vote
1answer
115 views

Find the expected reward in an expectimax-based dice rolling game?

I have this question that I'm kinda stuck on. It's a game scenario in which we set up an expectimax tree. In the game, you have 3 dice with sides 1-4 that you roll at the beginning. Then, depending on ...
4
votes
1answer
430 views

Is it practical to train AlphaZero or MuZero (for indie games) on a personal computer?

Is it practical/affordable to train an AlphaZero/MuZero engine using a residential gaming PC, or would it take thousands of years of training for the AI to learn enough to challenge humans? I'm having ...
0
votes
0answers
32 views

Incorrect node expansion in game board with A* search

I have the following game board below, and we're using A* search to find the optimal path from the agent to the key. There are 8 directions. Up, down, left, right have a cost of 1, and diagonal ...
1
vote
1answer
37 views

Embedding Isolation game states into key values for RL

I'm trying to think of how I can embed a game's state into a unique key value. The game I'm specifically working with is Isolation: https://en.wikipedia.org/wiki/Isolation_(board_game). The game state ...
0
votes
2answers
63 views

What is the meaning of the terms in this evaluation function for chess?

I'm trying to improve my evaluation and I saw this here ...
4
votes
1answer
166 views

What is the state-space complexity of Spades?

AI reached super-human level in many complex games, including imperfect information games such as six-player no-limit Texas hold’em poker. However, it still did not reached that level in Trick-taking ...
3
votes
1answer
193 views

Strategy for playing a board game with Minimax algorithm

I want to build a player for the following game: You have a board where position 1 is your player, position 2 is the rival ...
2
votes
2answers
458 views

Is it possible to integrate the GPT-3 by OpenAPI inside Unity3D or any game-engine?

My company has full access to beta testing for GPT-3. We wanted to try it for some games or game mechanics within Unity3D. Is it possible to use it for dialogues or with unity scripts? The Documents ...
0
votes
1answer
34 views

What is a good way of identifying volatile positions for a checkers game?

I am implementing an AI for a mobile checkers game, and have used alpha-beta pruning with Minimax. Now I have the problem of horizontal effect, and need to do Quiesence search to avoid that. Any ...
2
votes
1answer
92 views

How can I improve the performance of my approach to solving a 1-player version of the card game "The Game" by Steffen Benndorf?

I would like to create an AI for the 1 player version of the card game called "The Game" by Steffen Benndorf (rules here: https://nsv.de/wp-content/uploads/2018/05/the-game-english.pdf). The ...
2
votes
1answer
70 views

How to define Agar.io state and action space?

I am trying to implement an AI bot for my Agar.io clone using deep neural network. However, I am struggling with the state and action space of the AI bot. Because the bot can take real number for ...
2
votes
2answers
84 views

What happens when an opponent a neural network is playing with does not obey the rules of the game (i.e. cheats)?

For example, if AlphaZero plays with an opponent who has a right to move chess figures any way she wants, or make more than 1 move in a turn? Will a neural network adapt to that, as it adapted to an ...
3
votes
1answer
185 views

How to find the optimal pokemon team

Pokemon is a game where 2 players each select 6 Pokemon (a team) at the beginning of the game without knowing the other player's team. Every Pokemon has one or two types. Every type is either weak, ...
0
votes
0answers
48 views

Are there any python implementations of GGP games or how to use game logic written in GDL in python?

I'm writing a General Game Playing (GGP) AI in python. I'd like to test it on some GGP games. So are there any python implementations of GGP games? I found in http://games.ggp.org/base games written ...
2
votes
1answer
50 views

How much can/should the non-player character know about the game's world?

I'm about to write a non-player character (NPC). I wonder how much the AI should know about the game's world. So, my question isn't about the amount of training data the AI has to collect. I'm ...
2
votes
0answers
133 views

Use of virtual worlds (e.g. Second Life) for training Artificial General Intelligence agents?

There is emerging effort for Third Wave Artificial Intelligence (Artificial General Intelligence) (http://hlc.doc.ic.ac.uk/3AI_HLC_2019.html and https://www.darpa.mil/work-with-us/ai-next-campaign) ...
6
votes
5answers
365 views

Examples of single player games that use modern ML techniques in the AI?

Are there any examples of single player games that use modern ML technique in its games? By this I mean AI that plays with or against the human player, and not just play the game by itself (like Atari)...
0
votes
1answer
56 views

Were AI strategies identified at go or starcraft games and how?

When an AI is trained to play an opposing game, such as chess or go, it can become very strong. I have read in an article (non-scientific) the claim that AI strategies were identified by scientists ...
4
votes
1answer
535 views

Why is tic-tac-toe considered a non-deterministic environment?

I have been reading about deterministic and stochastic environments, when I came up with an article that states that tic-tac-toe is a non-deterministic environment. But why is that? An action will ...
-1
votes
1answer
112 views

Do I need a large pool of training data to train a bot to play the 'pegging' game in the cribbage card game

The game of cribbage https://en.wikipedia.org/wiki/Cribbage is a two-player card game played over a series of deal with the goal to reach 121 points. The game's elements are: the discard. There are ...
1
vote
0answers
117 views

Monte Carlo Exploring Starts broke for 2048 game AI

I implemented a MCES for 2048 (the game), with a quality function implemented as a neural net of a single layer. The starts are created with 6 cells filled with values between 64 and 1024, two cells ...
3
votes
1answer
134 views

q learning appears to converge but does not always win against random tic tac toe player

q learning is defined as: Here is my implementation of q learning of the tic tac toe problem: ...
1
vote
0answers
56 views

What would be the good choice of algorithm to use for character action selection in an RPG, implemented in Python?

I have developed an RPG in likeness to the features showcased in the Final Fantasy series; multiple character classes which utilise unique action sets, sequential turn-based combat, front/back row ...
1
vote
1answer
323 views

How can I model and solve the Knight Tour problem with reinforcement learning?

I've read about the Knight Tour problem. And I wanted to try to solve it with a reinforcement learning algorithm with OpenAI's gym. So, I want to make a bot that can move on the chess table like the ...
1
vote
0answers
29 views

How are AI's strategies discovered from chess and starcraft games?

Chess and starcraft games have been played by AI and sometimes won. Artificial intelligence had for these games a complex set of rules, database and decision-making tools to decide which actions it ...
3
votes
1answer
207 views

How should I design the reward function for racing game (where the goal is to reach finishing line before the opponent)?

I'm building an agent for a racing game. In this game, there is a randomized map where there are speed boosts for the player to pick up and obstacles that act to slow the player down. The goal of the ...
1
vote
0answers
126 views

How do i start building an autoclick bot for pubg mobile?

I want to make a bot which clicks the fire button on the mobile screen upon seeing an enemies head. In pubg mobile which is an android game you have to control the fire button and the aim along with ...
1
vote
0answers
30 views

What should be a good playing strategy in this 2-player simultaneous game?

This is a bot making problem from here. I am detailing the problem. The picture above shows the initial configuration of the game. P1 represents player1 and P2 represents player2. A scotch bottle is ...
2
votes
0answers
185 views

MCTS RAVE performing badly in Board Game AI

I'm using Monte Carlo Tree Search with UCT selection to try and build an AI player for a complex multiplayer board game. My regular UCT MCTS seems to be working fine, winning with random and basic ...

1
2 3 4 5