# Questions tagged [game-ai]

249 questions
Filter by
Sorted by
Tagged with
1 vote
37 views

### How do I make an artificial intelligence for a game played on a continuous board?

There is a lot of introductory literature about artificial intelligence for time and space discrete games, like chess. A few fundamental methods are offered: Minimax to depth $n$ with an evaluation ...
51 views

### How to select an equilibrium among the landscape of Nash equilibria in poker?

Reading some articles on counterfactual regret minimization solutions of HULHE and HUNLHE poker published in the last decades -like 1, 2- i was wondering what can be said about the different Nash ...
• 101
166 views

### Can I use Alpha-Beta Pruning for real life game simulation?

I had an idea to use the this algorithm to simulate real life game scenarios where a player could train and retrain their mistake and be ready for when that situation happens again in real life. This ...
1 vote
87 views

### RL agent for autonomous vehicle is able to follow the road but can't avoid crashing at all (Highway-Env / Racetrack Env.)

I coded some deep RL algorithms (DQN and SAC) with tf2/keras to solve an environment where a vehicle needs to follow the track and avoid crashing into one other vehicle (there is only one other ...
1k views

### Neural network for game

There is a game for two, which is an NxN field (always the same size). Players take turns. The first player's goal is to connect the two points (not necessarily at the corners) given on this field. ...
129 views

### How can we create an encoding scheme that captures these relationships between the suits of cards in poker?

In poker, a standard deck of 52 cards is used. Each card has one of 13 ranks, ranging from Ace to Deuce, and one of 4 suits: Spades, Hearts, Diamonds, or Clubs. The rank of a card is crucial. For ...
• 303
1 vote
59 views

### Do "procedurally generated" images use a set of base images to generate new images (as AI generated images do)?

I am new here, and apologize if this question is off-topic. I know that AI generated images are based on a set or database of real images created by real artists. In game development, I have heard of ...
73 views

### How to use deep learning to train an AI to play a two-player tactic game like rock-papers-scissors?

I want to try to train an AI model that can play a simple two-player tactic game. The game is not rock-papers-scissors, but have similar properties. Firstly, two players present their moves ...
362 views

### Modern reinforcement learning for video game NPCs

Recently, I have been reading about the 1996 artificial life game 'Creatures'. The game features NPCs called 'Norns' that use reinforcement learning to learn continuously through interactions with the ...
• 53
1 vote
79 views

### How to Represent Boardless Board Game as Input to RL Model?

I am currently doing my thesis project by creating an Imitation Learning (IL) agent that learns to play the board game Hive, which lacks a traditional 2D board. Pieces are placed relative to one ...
400 views

### Implementing an RL agent on a variable action space

I've been trying to design and implement a DQN agent as an AI opponent option for a math game I've been working on. The game is a turn-based grid game, where players alternate making moves and ...
• 21
184 views

### How do you define an action space for a card game with an unlimited and variable hand size?

I'm new to the world of AI and have been primarily reading through the documentation for OpenAI's Gym/Gymnasium in hopes of training an AI to play a board game. One piece of information I haven't been ...
1 vote
78 views

### Can humans surpass AI in game-playing?

In the realm of game-playing, such as in the cases of AlphaGo and Deep Blue, can humans ultimately surpass AI in skill? Despite the current dominance of machine learning, what factors may contribute ...
• 947
1 vote
187 views

### The neural network for a board game with somewhat imperfect information

I am a Software Engineer and I implemented online a pretty complex board game. Some key rules of the game. You have some cards in the hand and you can choose different turns. Build a card of certain ...
1 vote
112 views

### Do the mathematics of Go imply an AI could solve it, or does a complexity bound imply AI skill will plateau?

Based on the mathematics of Go and the machine learning algorithms used to play it, is there a mathematical limit as to how much of the game-tree space even an AI could learn, because of the inherent ...
220 views

### How should I train the players in the game of tag?

I have a simple game of tag, where red player tries to catch the blue player. Red player wins if it catches the blue player in under 10 seconds, but if not, then blue wins. My goal is to teach the ...
• 143
1 vote
49 views

### What is the depth reached by chess-AI agents on a regular computer?

I'm looking for some reference for the number of lookahead steps typically used by chess agents (Stockfish / Leela Chess Zero / others?) From a quick search, I found that the answer depends on: ...
• 413
1 vote
323 views

### Train Deep Q-Learning Network on a game without source code

So I have some games that I like, and I'd like to create a net that can play them, just for fun. But I don't have their source code, so I can't just pull the information I want and create a state from ...
• 13
1 vote
503 views

### MCTS with multi actions

I know that MCTS usually is meant for games where each player plays turn by turn and the canonical form of the board is passed through the tree but is it possible for one player to make multiple moves ...
• 125
195 views

### Find evils with AI (social deduction games)

I’ve been playing a game called Town of Salem lately. The goal of the game is for the town to find and lynch all evils in the town. To lynch someone, they must be voted up to the gallows first. This ...
• 101
1 vote
45 views

### Help with model architecture for a racing game

I’m working on a model for a racing game using pytorch. The model gets frame from the game as input and produces a controller state as output. The dataset consists of frames from the game and ...
• 11
79 views

### Could a good poker-playing AI be made that didn't look at its own cards?

A bit ago, I found out that researchers had taught a machine to play Texas Hold'Em at a level that beat most champions. However, that AI had access to the information of what cards it was dealt. So I ...
• 101
1 vote
385 views

### How should I choose the depth for minimax if I have a strict time constraint?

I am working on a controller that plays Ms. Pac-Man using a minimax algorithm. The controller has a limited time amount in which it can choose a move on each round, otherwise when the time runs out ...
• 21
1 vote
204 views

### Which RL algorithm should I use to learn an optimal weight vector?

What is the best practice in order to learn the optimal weight vector $W^*$? By optimal I mean the weights that will produce the agent with the highest win-rate. I have an agent that plays a ...
• 413
1 vote
429 views

### Do I need to create one or many neural networks to play Risk? [closed]

I have a school project to develop an AI model that plays the Risk board game as optimally as possible. Now, I have made the environment of Risk in Python and I narrowed down my possible machine ...
• 13
77 views

### Encoding Actions with Parameters in Neural Network Output

I have a task which I would like to teach an AI to perform. The input to the task will a screenshot of the screen and the output at any given time step is one of the following actions: ...
1k views

### What is the Bellman equation for V(s) in the case of a deterministic environment?

I am currently trying to practice reinforcement learning for an agent on a grid. The grid is deterministic. Since the grid is deterministic, to calculate the value for each grid square from the reward ...
• 145
1 vote
208 views

### Is there a benefit to starting with MCTS and switching to minimax as the branching factor decreases?

I've invented a deterministic, perfect-information game with a fairly large branching factor (~150) which tapers out dramatically after the midgame (~30 at worst). I need a strong AI. My understanding ...
1 vote
36 views

### What are the best practices of adding noise to game-playing bots?

I write bots that play card games. From time to time, I add noise to their decisions, mainly for two reasons: Reduce predictability: In games with hidden information the optimal play is a mix between ...
• 413
1 vote
186 views

### Detecting cheats visually using AI

I really like to play my favorite 3D shooter game online. Unfortunately, it is really old and cheat protection isn't really common there, but cheaters are! It is very frustrating, because it really ...
• 111
73 views

### Deep RL reward design for neuron centerline extraction task

As part of a bigger scope project, I'm training a RL agent that attempts to reconstruct, pixel by pixel, the trajectory of a neuron on a segmented image. To give a better insight on the task that I'm ...
496 views

### Minimax evaluation function for games with score instead of loss/draw/win result

I am trying to create minimax evaluation function for the Ms Pacman game. The goal of the player is to maximize score. I have some idea about the features that I would like to use in my evaluation ...
• 191
1 vote
80 views

### How to teach Machine Learning Agent to destroy replicating objects in a puzzle game?

I have an unusual but very interesting problem. I have a game that is very similar to Toon Blast (a puzzle mobile game). It's based on a Match-2 mechanic in which you can destroy 2 or more connected ...
• 153
350 views

### Which value to propagate in Monte Carlo Tree Search in a non-zero-sum game?

Usually, when I read about Monte Carlo Tree Search, values between 0 and 1 (or values between -1 and 1) are backpropagated, depending on whether the simulation was a win or loss. Now, suppose you have ...
• 121
1 vote
708 views

### Would AlphaZero work just with a value network?

There is a nice post about the intuition why AlphaZero works. One of the advantages of using a policy network in the games where a perfect simulator is available (such as chess) is to save computation ...
• 191
66 views

### What AI algorithm could I use to trap an agent in a game?

Imagine a game with grid size 10x10, there is a good guy and a bad guy and obstacles in the grid, i.e. essentially a maze. The goal of the bad guy is to find the good guy and trap him by erecting ...
1 vote
2k views

### How should I define the reward function for a stock trading-like game?

Problem setting Consider a game like trading a stock At each step, the agent can buy / sell a stock. Trade is a pair of ...
• 155
34 views

### Demonstration of AI-powered Mario collecting lots of coins?

As part of a talk I'm giving, I'd like to show one of the many videos on YouTube where an AI is playing Mario, such as this one. What bothers me though is that the AI is trying to complete the level ...
• 261
155 views

### Is my single layer perceptron getting biased input some way or the other?

I was working a little bit on a school project my team and I decided to do for submission in the year-end. It's a small game which I call 'Quattro', and its rules are as follows: The game is played ...
• 177
200 views

### How to embed game grid state with walls as an input to neural network

I've read most of the posts on here regarding this subject, however most of them deal with gameboards where there are two different categories of single pieces on a board without walls etc. My game ...
1 vote
1k views

### How does one handle different player turns in MCTS?

Suppose we have a two player game like Tic Tac Toe where the two players take turns to play their moves. It is my understanding that in the game tree that MCTS builds, consecutive levels in the tree ...
• 159
1 vote
359 views

### Why doesn't this Monte Carlo Tree Search algorithm work properly?

PROBLEM I'm writing a Monte-Carlo tree search algorithm to play chess in Python. I replaced the simulation stage with a custom evaluation function. My code looks perfect but for some reason acts ...
1 vote
108 views

### Scrabble rack observation with MuZero

Currently I'm trying to implement Scrabble with MuZero. The $15 \times 15$ game board observation (as input) is of size $27 \times15 \times15$ (26 letters + 1 wildcard) with a value of 0 or 1. However ...
241 views

### How to approach a two-agent two-step action game?

A simple two-player sniper game: Each player has 9 houses that he can reside in. So 18 houses in total. The houses can be considered in a row: e.g. 1-9 for player A, and 10-18 for player B. Each ...
• 103
251 views

### How to handle cycles in minimax algorithm

For example, I am implementing AI for turn based game and have enough computational resources for build full game tree. My problem is the game can be infinite if both players will repeat moves and my ...
1 vote
46 views

### Why is the number of examined nodes $O(b^{3d/4})$ in $\alpha$-$\beta$ pruning?

I'm taking a course 'Introduction to AI' and, in one of the tutorials, it was written that when pruning the game tree using $\alpha$-$\beta$ boundaries, the number of nodes that will be developed, ...
• 131
682 views

### How is the AI in 3d games implemented?

A few days ago, I started looking a bit more into AI and learning about the way it works, and it is very interesting, but I can't find a clear answer on how the artificial intelligence is implemented ...
• 43
1 vote
535 views

### What is the size of 6-players no limit Texas holdem Poker?

What is the number of game states/information sets in 6-players, no limit, Texas Holdem? A year ago, Pluribus reached a super-human level in 6-players no limit Holdem Poker. I am interested in the ...
• 413
1 vote
2k views

### Determining minimal state representation for maze game

I came across this question set. It asks following question: Let’s revisit our bug friends from assignment 2. To recap, you control one or more insects in a rectangular maze-like environment with ...
• 151
1 vote