Questions tagged [game-ai]

For questions related to game design involving AI.

Filter by
Sorted by
Tagged with
0 votes
0 answers
22 views

At what point is AI go-playing expected to plateau?

Are we seeing constant improvements in AIs ability to beat itself at Go, and if so, is it completely unknown when AI may play Go so well that there is no room for improvement, approaching the limit of ...
2 votes
2 answers
69 views

How should I train the players in the game of tag?

I have a simple game of tag, where red player tries to catch the blue player. Red player wins if it catches the blue player in under 10 seconds, but if not, then blue wins. My goal is to teach the ...
  • 143
1 vote
0 answers
26 views

What is the depth reached by chess-AI agents on a regular computer?

I'm looking for some reference for the number of lookahead steps typically used by chess agents (Stockfish / Leela Chess Zero / others?) From a quick search, I found that the answer depends on: ...
  • 405
1 vote
1 answer
69 views

Train Deep Q-Learning Network on a game without source code

So I have some games that I like, and I'd like to create a net that can play them, just for fun. But I don't have their source code, so I can't just pull the information I want and create a state from ...
  • 13
1 vote
1 answer
102 views

MCTS with multi actions

I know that MCTS usually is meant for games where each player plays turn by turn and the canonical form of the board is passed through the tree but is it possible for one player to make multiple moves ...
0 votes
0 answers
71 views

Find evils with AI (social deduction games)

I’ve been playing a game called Town of Salem lately. The goal of the game is for the town to find and lynch all evils in the town. To lynch someone, they must be voted up to the gallows first. This ...
  • 101
0 votes
0 answers
86 views

Agent communication in multi agent system

My task is to compare different ways of communication between two(or more) intelligent agents and decide which has the best performance. I've done my research, and it appears that there are two ways ...
  • 1
1 vote
0 answers
32 views

Help with model architecture for a racing game

I’m working on a model for a racing game using pytorch. The model gets frame from the game as input and produces a controller state as output. The dataset consists of frames from the game and ...
  • 11
0 votes
1 answer
55 views

Could a good poker-playing AI be made that didn't look at its own cards?

A bit ago, I found out that researchers had taught a machine to play Texas Hold'Em at a level that beat most champions. However, that AI had access to the information of what cards it was dealt. So I ...
1 vote
0 answers
218 views

How should I choose the depth for minimax if I have a strict time constraint?

I am working on a controller that plays Ms. Pac-Man using a minimax algorithm. The controller has a limited time amount in which it can choose a move on each round, otherwise when the time runs out ...
1 vote
1 answer
110 views

Which RL algorithm should I use to learn an optimal weight vector?

What is the best practice in order to learn the optimal weight vector $W^*$? By optimal I mean the weights that will produce the agent with the highest win-rate. I have an agent that plays a ...
  • 405
0 votes
0 answers
28 views

Can you save actions from a player into a NEAT config and create a sort of child of that player to then train against?

The question I have is more from interest, as I have seen a few things on the internet about people training an AI using footage of real people playing games. I was wondering if you could train it ...
1 vote
1 answer
115 views

Do I need to create one or many neural networks to play Risk? [closed]

I have a school project to develop an AI model that plays the Risk board game as optimally as possible. Now, I have made the environment of Risk in Python and I narrowed down my possible machine ...
  • 13
0 votes
0 answers
35 views

Encoding Actions with Parameters in Neural Network Output

I have a task which I would like to teach an AI to perform. The input to the task will a screenshot of the screen and the output at any given time step is one of the following actions: ...
0 votes
0 answers
144 views

How do you determine the optimal policy?

I am following some Grid world examples to understand reinforcement learning. I have a deterministic grid (part of which I have reconstructed below). I am trying to understand how the optimal policy ...
  • 1
0 votes
0 answers
24 views

How are previous values updated when performing value iteration?

I have been trying to understand how you determine the value for each square in a grid world and I have seen/watched a few different examples to try and apply it to my own grid and I find myself ...
  • 1
2 votes
2 answers
468 views

What is the Bellman equation for V(s) in the case of a deterministic environment?

I am currently trying to practice reinforcement learning for an agent on a grid. The grid is deterministic. Since the grid is deterministic, to calculate the value for each grid square from the reward ...
  • 145
1 vote
0 answers
68 views

Is there a benefit to starting with MCTS and switching to minimax as the branching factor decreases?

I've invented a deterministic, perfect-information game with a fairly large branching factor (~150) which tapers out dramatically after the midgame (~30 at worst). I need a strong AI. My understanding ...
1 vote
0 answers
35 views

What are the best practices of adding noise to game-playing bots?

I write bots that play card games. From time to time, I add noise to their decisions, mainly for two reasons: Reduce predictability: In games with hidden information the optimal play is a mix between ...
  • 405
1 vote
0 answers
62 views

Detecting cheats visually using AI

I really like to play my favorite 3D shooter game online. Unfortunately, it is really old and cheat protection isn't really common there, but cheaters are! It is very frustrating, because it really ...
  • 11
0 votes
1 answer
60 views

Deep RL reward design for neuron centerline extraction task

As part of a bigger scope project, I'm training a RL agent that attempts to reconstruct, pixel by pixel, the trajectory of a neuron on a segmented image. To give a better insight on the task that I'm ...
2 votes
0 answers
249 views

Minimax evaluation function for games with score instead of loss/draw/win result

I am trying to create minimax evaluation function for the Ms Pacman game. The goal of the player is to maximize score. I have some idea about the features that I would like to use in my evaluation ...
  • 159
1 vote
0 answers
50 views

How to teach Machine Learning Agent to destroy replicating objects in a puzzle game?

I have an unusual but very interesting problem. I have a game that is very similar to Toon Blast (a puzzle mobile game). It's based on a Match-2 mechanic in which you can destroy 2 or more connected ...
  • 153
2 votes
1 answer
140 views

Which value to propagate in Monte Carlo Tree Search in a non-zero-sum game?

Usually, when I read about Monte Carlo Tree Search, values between 0 and 1 (or values between -1 and 1) are backpropagated, depending on whether the simulation was a win or loss. Now, suppose you have ...
  • 121
1 vote
2 answers
266 views

Would AlphaZero work just with a value network?

There is a nice post about the intuition why AlphaZero works. One of the advantages of using a policy network in the games where a perfect simulator is available (such as chess) is to save computation ...
  • 159
2 votes
0 answers
50 views

What AI algorithm could I use to trap an agent in a game?

Imagine a game with grid size 10x10, there is a good guy and a bad guy and obstacles in the grid, i.e. essentially a maze. The goal of the bad guy is to find the good guy and trap him by erecting ...
1 vote
1 answer
725 views

How should I define the reward function for a stock trading-like game?

Problem setting Consider a game like trading a stock At each step, the agent can buy / sell a stock. Trade is a pair of ...
2 votes
0 answers
28 views

Demonstration of AI-powered Mario collecting lots of coins?

As part of a talk I'm giving, I'd like to show one of the many videos on YouTube where an AI is playing Mario, such as this one. What bothers me though is that the AI is trying to complete the level ...
0 votes
1 answer
85 views

Is my single layer perceptron getting biased input some way or the other?

I was working a little bit on a school project my team and I decided to do for submission in the year-end. It's a small game which I call 'Quattro', and its rules are as follows: The game is played ...
  • 185
2 votes
1 answer
91 views

How to embed game grid state with walls as an input to neural network

I've read most of the posts on here regarding this subject, however most of them deal with gameboards where there are two different categories of single pieces on a board without walls etc. My game ...
1 vote
2 answers
342 views

How does one handle different player turns in MCTS?

Suppose we have a two player game like Tic Tac Toe where the two players take turns to play their moves. It is my understanding that in the game tree that MCTS builds, consecutive levels in the tree ...
  • 59
1 vote
0 answers
261 views

Why doesn't this Monte Carlo Tree Search algorithm work properly?

PROBLEM I'm writing a Monte-Carlo tree search algorithm to play chess in Python. I replaced the simulation stage with a custom evaluation function. My code looks perfect but for some reason acts ...
1 vote
1 answer
67 views

Scrabble rack observation with MuZero

Currently I'm trying to implement Scrabble with MuZero. The $15 \times 15$ game board observation (as input) is of size $27 \times15 \times15$ (26 letters + 1 wildcard) with a value of 0 or 1. However ...
0 votes
1 answer
122 views

How to approach a two-agent two-step action game?

A simple two-player sniper game: Each player has 9 houses that he can reside in. So 18 houses in total. The houses can be considered in a row: e.g. 1-9 for player A, and 10-18 for player B. Each ...
3 votes
0 answers
149 views

How to handle cycles in minimax algorithm

For example, I am implementing AI for turn based game and have enough computational resources for build full game tree. My problem is the game can be infinite if both players will repeat moves and my ...
1 vote
0 answers
39 views

Why is the number of examined nodes $ O(b^{3d/4})$ in $\alpha$-$\beta$ pruning?

I'm taking a course 'Introduction to AI' and, in one of the tutorials, it was written that when pruning the game tree using $\alpha$-$\beta$ boundaries, the number of nodes that will be developed, ...
4 votes
2 answers
367 views

How is the AI in 3d games implemented?

A few days ago, I started looking a bit more into AI and learning about the way it works, and it is very interesting, but I can't find a clear answer on how the artificial intelligence is implemented ...
  • 43
1 vote
0 answers
239 views

What is the size of 6-players no limit Texas holdem Poker?

What is the number of game states/information sets in 6-players, no limit, Texas Holdem? A year ago, Pluribus reached a super-human level in 6-players no limit Holdem Poker. I am interested in the ...
  • 405
1 vote
1 answer
837 views

Determining minimal state representation for maze game

I came across this question set. It asks following question: Let’s revisit our bug friends from assignment 2. To recap, you control one or more insects in a rectangular maze-like environment with ...
1 vote
1 answer
228 views

Find the expected reward in an expectimax-based dice rolling game?

I have this question that I'm kinda stuck on. It's a game scenario in which we set up an expectimax tree. In the game, you have 3 dice with sides 1-4 that you roll at the beginning. Then, depending on ...
  • 21
5 votes
2 answers
937 views

Is it practical to train AlphaZero or MuZero (for indie games) on a personal computer?

Is it practical/affordable to train an AlphaZero/MuZero engine using a residential gaming PC, or would it take thousands of years of training for the AI to learn enough to challenge humans? I'm having ...
  • 53
0 votes
0 answers
34 views

Incorrect node expansion in game board with A* search

I have the following game board below, and we're using A* search to find the optimal path from the agent to the key. There are 8 directions. Up, down, left, right have a cost of 1, and diagonal ...
  • 21
1 vote
1 answer
67 views

Embedding Isolation game states into key values for RL

I'm trying to think of how I can embed a game's state into a unique key value. The game I'm specifically working with is Isolation: https://en.wikipedia.org/wiki/Isolation_(board_game). The game state ...
0 votes
2 answers
78 views

What is the meaning of the terms in this evaluation function for chess?

I'm trying to improve my evaluation and I saw this here ...
4 votes
1 answer
295 views

What is the state-space complexity of Spades?

AI reached super-human level in many complex games, including imperfect information games such as six-player no-limit Texas hold’em poker. However, it still did not reached that level in Trick-taking ...
  • 405
3 votes
1 answer
307 views

Strategy for playing a board game with Minimax algorithm

I want to build a player for the following game: You have a board where position 1 is your player, position 2 is the rival ...
  • 81
2 votes
2 answers
1k views

Is it possible to integrate the GPT-3 by OpenAPI inside Unity3D or any game-engine?

My company has full access to beta testing for GPT-3. We wanted to try it for some games or game mechanics within Unity3D. Is it possible to use it for dialogues or with unity scripts? The Documents ...
0 votes
1 answer
120 views

What is a good way of identifying volatile positions for a checkers game?

I am implementing an AI for a mobile checkers game, and have used alpha-beta pruning with Minimax. Now I have the problem of horizontal effect, and need to do Quiesence search to avoid that. Any ...
2 votes
1 answer
115 views

How can I improve the performance of my approach to solving a 1-player version of the card game "The Game" by Steffen Benndorf?

I would like to create an AI for the 1 player version of the card game called "The Game" by Steffen Benndorf (rules here: https://nsv.de/wp-content/uploads/2018/05/the-game-english.pdf). The ...
  • 123
2 votes
1 answer
118 views

How to define Agar.io state and action space?

I am trying to implement an AI bot for my Agar.io clone using deep neural network. However, I am struggling with the state and action space of the AI bot. Because the bot can take real number for ...

1
2 3 4 5