Questions tagged [game-ai]
For questions related to game design involving AI.
62
questions with no upvoted or accepted answers
7
votes
1
answer
205
views
How could an AI detect whether an enemy in a game can be blocked off/trapped?
Imagine a game played on a 10x10 grid system where a player can move up down left or right and imagine there are two players on this grid: An enemy and you. In this game, there are walls on the grid ...
- 71
4
votes
0
answers
202
views
How to handle cycles in minimax algorithm
For example, I am implementing AI for turn based game and have enough computational resources for build full game tree. My problem is the game can be infinite if both players will repeat moves and my ...
4
votes
0
answers
3k
views
Is this a good way to represent Connect 4 to a Neural Network?
I'm attempting to make a bot for the Connect 4 competition on http://riddles.io
My bot isn't horrible, like it's getting up the ladder, but it cannot compete with the winning bots.
I'm using a ...
- 210
4
votes
0
answers
179
views
Can AlexNet be changed to produce floating-point outputs in the range $[-1, 1]$, and, if not, which model should I use?
I'm developing a game AI, which tries to master racing simulation. I already trained a CNN (AlexNet) on in-game footage of me playing the game and the pressed keys as the target.
I had two main issues ...
- 103
3
votes
0
answers
1k
views
Why isn't there a model playing FPS like CoD or Battlefield already existing?
Assuming we had an unlimited time to train a model and a very powerful machine to use our model in real-time (hello quantum computer), I'd like to know why no one could achieve to build an AI able to ...
- 131
3
votes
0
answers
286
views
Deep Q-Network (DQN) to learn the game 2048
I am trying to build a Deep Q-Network (DQN) agent that can learn to play the game 2048. I am orientating myself on other programs and articles that are based on the game snake and it worked well (...
- 31
3
votes
0
answers
76
views
Negative counterfactual regret
I am reading the paper Regret Minimization in Games with Incomplete
Information on CFR algorithm.
On page 4, the paper defines $R^{T,+}_{i,\text{imm}}=\max\{R^{T}_{i,\text{imm}}, 0\}$ after equation (...
- 131
3
votes
0
answers
491
views
How to encode Azul game state as NN input
Question to NN practicioners. I'd like to encode Azul board game state as an input to NN, let's focus on 2-player variant for a while.
There are 5 round "Factories" on the table (7 on picture, ignore ...
- 131
2
votes
0
answers
75
views
How can we create an encoding scheme that captures these relationships between the suits of cards in poker?
In poker, a standard deck of 52 cards is used. Each card has one of 13 ranks, ranging from Ace to Deuce, and one of 4 suits: Spades, Hearts, Diamonds, or Clubs.
The rank of a card is crucial. For ...
- 193
2
votes
0
answers
389
views
Minimax evaluation function for games with score instead of loss/draw/win result
I am trying to create minimax evaluation function for the Ms Pacman game. The goal of the player is to maximize score.
I have some idea about the features that I would like to use in my evaluation ...
- 159
2
votes
0
answers
63
views
What AI algorithm could I use to trap an agent in a game?
Imagine a game with grid size 10x10, there is a good guy and a bad guy and obstacles in the grid, i.e. essentially a maze. The goal of the bad guy is to find the good guy and trap him by erecting ...
2
votes
0
answers
31
views
Demonstration of AI-powered Mario collecting lots of coins?
As part of a talk I'm giving, I'd like to show one of the many videos on YouTube where an AI is playing Mario, such as this one. What bothers me though is that the AI is trying to complete the level ...
- 261
2
votes
1
answer
160
views
How to embed game grid state with walls as an input to neural network
I've read most of the posts on here regarding this subject, however most of them deal with gameboards where there are two different categories of single pieces on a board without walls etc.
My game ...
2
votes
1
answer
489
views
MCTS RAVE performing badly in Board Game AI
I'm using Monte Carlo Tree Search with UCT selection to try and build an AI player for a complex multiplayer board game. My regular UCT MCTS seems to be working fine, winning with random and basic ...
- 21
2
votes
0
answers
167
views
Is this a good approach to evaluate the game state with a neural network?
I've written a Monte Carlo Tree Search player for the game of Castle (AKA Shithead, Shed, Palace...). I have set this MCTS player to play against a basic rule-based AI for ~30000 games and collected ~...
- 31
2
votes
0
answers
115
views
Using ML for Enemy Generation in Video Games
I am attempting to make a 2-D platformer game where the player traverses through an evil factory that is producing killer robots. The robots spawn at multiple specific locations in each level and ...
2
votes
0
answers
82
views
Best AI Approach for 2D to-down space shooter
I am building a 2d top-down space game, which involves several objects, such as asteroids, drones, spaceships, space litter and power-ups.
It follows the rules of space gravity, with speed and ...
- 21
2
votes
0
answers
60
views
What are the main technologies needed to build an AI for Warcraft 3's mod DotA?
What are the main technologies needed to build an AI for Warcraft 3's mod Defense of the Ancients (DotA)? Maybe I can take inspiration from OpenAI's work.
2
votes
0
answers
103
views
Will the RL agent implemented as a neural network fine-tune itself?
Normally, when you develop a neural network, train it for object recognition (on normal objects like bike, car, plane, dog, cloud, etc.), and it turns out to perform very well, you would like to fine-...
- 141
2
votes
0
answers
59
views
How should I build an AI that quickly detects falling game assets on screen?
I want to build an AI that plays a simple android game.
The game is just a one at a time object falling, some times at an angle. The AI needs to recognize the object and to decide whether to swipe ...
- 21
2
votes
0
answers
397
views
Implementing AI/ML for the card game "Cheat"
Background info
In Python, I've implemented a rudimentary engine to play "Cheat", supporting both bots and a human or only bots. When only bots are playing, the game is simulated.
When placing cards,...
- 21
2
votes
0
answers
162
views
Mapping Actions to the Output Layer in Keras Model for a Board Game
I have created a game based on this game here. I am attempting to use Deep Q Learning to do this, and this is my first foray into Neural networks (please be gentle!!)
I am trying to create a NN that ...
- 51
2
votes
0
answers
96
views
Making behavior tree execute action for specific time?
Say I need to make an action such as "Walk" perform for 2 seconds using a behavior tree which has access to a timer.
The timer can do the following:
start, time (get value of timer), and reset.
If ...
- 21
1
vote
2
answers
47
views
How to Represent Boardless Board Game as Input to RL Model?
I am currently doing my thesis project by creating an Imitation Learning (IL) agent that learns to play the board game Hive, which lacks a traditional 2D board. Pieces are placed relative to one ...
1
vote
0
answers
46
views
What is the depth reached by chess-AI agents on a regular computer?
I'm looking for some reference for the number of lookahead steps typically used by chess agents (Stockfish / Leela Chess Zero / others?)
From a quick search, I found that the answer depends on:
...
- 413
1
vote
0
answers
43
views
Help with model architecture for a racing game
I’m working on a model for a racing game using pytorch. The model gets frame from the game as input and produces a controller state as output. The dataset consists of frames from the game and ...
- 11
1
vote
0
answers
333
views
How should I choose the depth for minimax if I have a strict time constraint?
I am working on a controller that plays Ms. Pac-Man using a minimax algorithm. The controller has a limited time amount in which it can choose a move on each round, otherwise when the time runs out ...
- 21
1
vote
0
answers
141
views
Is there a benefit to starting with MCTS and switching to minimax as the branching factor decreases?
I've invented a deterministic, perfect-information game with a fairly large branching factor (~150) which tapers out dramatically after the midgame (~30 at worst). I need a strong AI. My understanding ...
- 111
1
vote
0
answers
36
views
What are the best practices of adding noise to game-playing bots?
I write bots that play card games. From time to time, I add noise to their decisions, mainly for two reasons:
Reduce predictability: In games with hidden information the optimal play is a mix between ...
- 413
1
vote
0
answers
99
views
Detecting cheats visually using AI
I really like to play my favorite 3D shooter game online. Unfortunately, it is really old and cheat protection isn't really common there, but cheaters are! It is very frustrating, because it really ...
- 111
1
vote
0
answers
63
views
How to teach Machine Learning Agent to destroy replicating objects in a puzzle game?
I have an unusual but very interesting problem. I have a game that is very similar to Toon Blast (a puzzle mobile game). It's based on a Match-2 mechanic in which you can destroy 2 or more connected ...
- 153
1
vote
0
answers
315
views
Why doesn't this Monte Carlo Tree Search algorithm work properly?
PROBLEM
I'm writing a Monte-Carlo tree search algorithm to play chess in Python. I replaced the simulation stage with a custom evaluation function. My code looks perfect but for some reason acts ...
1
vote
0
answers
44
views
Why is the number of examined nodes $ O(b^{3d/4})$ in $\alpha$-$\beta$ pruning?
I'm taking a course 'Introduction to AI' and, in one of the tutorials, it was written that when pruning the game tree using $\alpha$-$\beta$ boundaries, the number of nodes that will be developed, ...
- 131
1
vote
0
answers
410
views
What is the size of 6-players no limit Texas holdem Poker?
What is the number of game states/information sets in 6-players, no limit, Texas Holdem?
A year ago, Pluribus reached a super-human level in 6-players no limit Holdem Poker. I am interested in the ...
- 413
1
vote
1
answer
2k
views
Determining minimal state representation for maze game
I came across this question set. It asks following question:
Let’s revisit our bug friends from assignment 2. To recap, you control one or more insects in a rectangular maze-like environment with ...
- 141
1
vote
0
answers
172
views
Monte Carlo Exploring Starts broke for 2048 game AI
I implemented a MCES for 2048 (the game), with a quality function implemented as a neural net of a single layer.
The starts are created with 6 cells filled with values between 64 and 1024, two cells ...
- 207
1
vote
0
answers
73
views
What would be the good choice of algorithm to use for character action selection in an RPG, implemented in Python?
I have developed an RPG in likeness to the features showcased in the Final Fantasy series; multiple character classes which utilise unique action sets, sequential turn-based combat, front/back row ...
- 11
1
vote
0
answers
209
views
How do i start building an autoclick bot for pubg mobile?
I want to make a bot which clicks the fire button on the mobile screen upon seeing an enemies head.
In pubg mobile which is an android game you have to control the fire button and the aim along with ...
- 11
1
vote
0
answers
42
views
What should be a good playing strategy in this 2-player simultaneous game?
This is a bot making problem from here.
I am detailing the problem.
The picture above shows the initial configuration of the game. P1 represents player1 and P2 represents player2. A scotch bottle is ...
- 11
1
vote
0
answers
130
views
Can I use deepfake to rotoscope for animation?
I'm a big fan of animation and have kept an eye on the deepfake's ability to replicate full body motion.
So I ask
Is there a deepfake software available I can use to gather animation from a video?
...
- 11
1
vote
0
answers
85
views
What AI technologies were used in earlier versions of StarCraft?
I remember back in the 2000s, it was, and still is possible to play against computers in StarCraft BroodWar. They were not as good as pro players, but still reasonably smart.
What AI technologies ...
- 111
1
vote
0
answers
60
views
Unique game problem (ML, DP, PP etc)
Looking for a solution to my below game problem. I believe it to require some sort of reinforcement learning, dynamic programming, or probabilistic programming solution, but am unsure... This is my ...
- 111
1
vote
0
answers
63
views
Action spaces for an RTS game
I think reinforcement learning would be a good fit for this problem, but I am not sure of how to deal with a seemingly infinite number of actions. In the beginning of each game (generic RTS game), the ...
- 111
1
vote
0
answers
226
views
Understanding alpha-beta pruning for simplified NIM
This is a simple version of NIM: Two players alternately remove one, two or three coins from a stack initially containing 5 coins. The player who picks up the last coin loses.
What does alpha-beta ...
- 11
1
vote
0
answers
45
views
Game-based or nasty chatbot for Facebook Messenger or Skype
Are there chatbots for Facebook Messenger or Skype available which are game-based, i.e. with which it is possible to play a short funny game? It should be possible to play the game for at least 10 ...
- 131
1
vote
0
answers
61
views
What to study for this simple poker game?
I'm a programmer with a background in mathematics, but I have no experience whatsoever with artificial intelligence/neural networks. I'd like to study it as a hobby, and my goal for now is to solve ...
- 11
1
vote
2
answers
112
views
Developing character tactics via repeated trials
Let's assume a common game scenario of several characters in a combat arena. Each character has different strengths and weaknesses. The arena has traps and tools. Suppose the characters had only very ...
- 121
1
vote
0
answers
730
views
How to teach an AI to race optimally in a racing game?
I play a racing game called Need For Madness ( some gameplay: https://www.youtube.com/watch?v=NC5uFZ-t0A8 ). NFM is a racing game, where the player can choose different cars and race and crash the ...
1
vote
0
answers
55
views
Mini (local) NN for Mobile?
I'm working on architecture for a game AI where, due to the nature of the game, the classical approach seems likely be sufficient to beat most humans--the endgame is tractable and traditional game-...
- 6,237
1
vote
0
answers
207
views
Help with implementing Q-learning for a feedfoward network playing a video game
I want to train a feedforward neural network to play a video game called Puyo Puyo 2, using reinforcement learning. More specifically, I'm trying Q-learning but I'm open to better alternatives.
In ...
- 21