Questions tagged [game-ai]

For questions related to game design involving AI.

63 questions with no upvoted or accepted answers
Filter by
Sorted by
Tagged with
6 votes
1 answer
181 views

How could an AI detect whether an enemy in a game can be blocked off/trapped?

Imagine a game played on a 10x10 grid system where a player can move up down left or right and imagine there are two players on this grid: An enemy and you. In this game, there are walls on the grid ...
  • 61
4 votes
0 answers
3k views

Is this a good way to represent Connect 4 to a Neural Network?

I'm attempting to make a bot for the Connect 4 competition on http://riddles.io My bot isn't horrible, like it's getting up the ladder, but it cannot compete with the winning bots. I'm using a ...
4 votes
0 answers
172 views

Can AlexNet be changed to produce floating-point outputs in the range $[-1, 1]$, and, if not, which model should I use?

I'm developing a game AI, which tries to master racing simulation. I already trained a CNN (AlexNet) on in-game footage of me playing the game and the pressed keys as the target. I had two main issues ...
  • 103
3 votes
0 answers
164 views

How to handle cycles in minimax algorithm

For example, I am implementing AI for turn based game and have enough computational resources for build full game tree. My problem is the game can be infinite if both players will repeat moves and my ...
3 votes
0 answers
888 views

Why isn't there a model playing FPS like CoD or Battlefield already existing?

Assuming we had an unlimited time to train a model and a very powerful machine to use our model in real-time (hello quantum computer), I'd like to know why no one could achieve to build an AI able to ...
  • 131
3 votes
0 answers
261 views

Deep Q-Network (DQN) to learn the game 2048

I am trying to build a Deep Q-Network (DQN) agent that can learn to play the game 2048. I am orientating myself on other programs and articles that are based on the game snake and it worked well (...
  • 31
3 votes
0 answers
71 views

Negative counterfactual regret

I am reading the paper Regret Minimization in Games with Incomplete Information on CFR algorithm. On page 4, the paper defines $R^{T,+}_{i,\text{imm}}=\max\{R^{T}_{i,\text{imm}}, 0\}$ after equation (...
  • 131
3 votes
0 answers
458 views

How to encode Azul game state as NN input

Question to NN practicioners. I'd like to encode Azul board game state as an input to NN, let's focus on 2-player variant for a while. There are 5 round "Factories" on the table (7 on picture, ignore ...
  • 131
2 votes
0 answers
271 views

Minimax evaluation function for games with score instead of loss/draw/win result

I am trying to create minimax evaluation function for the Ms Pacman game. The goal of the player is to maximize score. I have some idea about the features that I would like to use in my evaluation ...
  • 159
2 votes
0 answers
53 views

What AI algorithm could I use to trap an agent in a game?

Imagine a game with grid size 10x10, there is a good guy and a bad guy and obstacles in the grid, i.e. essentially a maze. The goal of the bad guy is to find the good guy and trap him by erecting ...
2 votes
0 answers
29 views

Demonstration of AI-powered Mario collecting lots of coins?

As part of a talk I'm giving, I'd like to show one of the many videos on YouTube where an AI is playing Mario, such as this one. What bothers me though is that the AI is trying to complete the level ...
2 votes
1 answer
114 views

How to embed game grid state with walls as an input to neural network

I've read most of the posts on here regarding this subject, however most of them deal with gameboards where there are two different categories of single pieces on a board without walls etc. My game ...
2 votes
1 answer
363 views

MCTS RAVE performing badly in Board Game AI

I'm using Monte Carlo Tree Search with UCT selection to try and build an AI player for a complex multiplayer board game. My regular UCT MCTS seems to be working fine, winning with random and basic ...
  • 21
2 votes
0 answers
146 views

Is this a good approach to evaluate the game state with a neural network?

I've written a Monte Carlo Tree Search player for the game of Castle (AKA Shithead, Shed, Palace...). I have set this MCTS player to play against a basic rule-based AI for ~30000 games and collected ~...
2 votes
0 answers
87 views

Using ML for Enemy Generation in Video Games

I am attempting to make a 2-D platformer game where the player traverses through an evil factory that is producing killer robots. The robots spawn at multiple specific locations in each level and ...
2 votes
0 answers
77 views

Best AI Approach for 2D to-down space shooter

I am building a 2d top-down space game, which involves several objects, such as asteroids, drones, spaceships, space litter and power-ups. It follows the rules of space gravity, with speed and ...
2 votes
0 answers
57 views

What are the main technologies needed to build an AI for Warcraft 3's mod DotA?

What are the main technologies needed to build an AI for Warcraft 3's mod Defense of the Ancients (DotA)? Maybe I can take inspiration from OpenAI's work.
2 votes
0 answers
98 views

Will the RL agent implemented as a neural network fine-tune itself?

Normally, when you develop a neural network, train it for object recognition (on normal objects like bike, car, plane, dog, cloud, etc.), and it turns out to perform very well, you would like to fine-...
  • 141
2 votes
0 answers
58 views

How should I build an AI that quickly detects falling game assets on screen?

I want to build an AI that plays a simple android game. The game is just a one at a time object falling, some times at an angle. The AI needs to recognize the object and to decide whether to swipe ...
2 votes
0 answers
370 views

Implementing AI/ML for the card game "Cheat"

Background info In Python, I've implemented a rudimentary engine to play "Cheat", supporting both bots and a human or only bots. When only bots are playing, the game is simulated. When placing cards,...
  • 21
2 votes
0 answers
153 views

Mapping Actions to the Output Layer in Keras Model for a Board Game

I have created a game based on this game here. I am attempting to use Deep Q Learning to do this, and this is my first foray into Neural networks (please be gentle!!) I am trying to create a NN that ...
2 votes
0 answers
84 views

Making behavior tree execute action for specific time?

Say I need to make an action such as "Walk" perform for 2 seconds using a behavior tree which has access to a timer. The timer can do the following: start, time (get value of timer), and reset. If ...
1 vote
1 answer
51 views

Can humans surpass AI in game-playing?

In the realm of game-playing, such as in the cases of AlphaGo and Deep Blue, can humans ultimately surpass AI in skill? Despite the current dominance of machine learning, what factors may contribute ...
1 vote
0 answers
35 views

What is the depth reached by chess-AI agents on a regular computer?

I'm looking for some reference for the number of lookahead steps typically used by chess agents (Stockfish / Leela Chess Zero / others?) From a quick search, I found that the answer depends on: ...
  • 405
1 vote
0 answers
32 views

Help with model architecture for a racing game

I’m working on a model for a racing game using pytorch. The model gets frame from the game as input and produces a controller state as output. The dataset consists of frames from the game and ...
  • 11
1 vote
0 answers
249 views

How should I choose the depth for minimax if I have a strict time constraint?

I am working on a controller that plays Ms. Pac-Man using a minimax algorithm. The controller has a limited time amount in which it can choose a move on each round, otherwise when the time runs out ...
1 vote
1 answer
130 views

Which RL algorithm should I use to learn an optimal weight vector?

What is the best practice in order to learn the optimal weight vector $W^*$? By optimal I mean the weights that will produce the agent with the highest win-rate. I have an agent that plays a ...
  • 405
1 vote
0 answers
76 views

Is there a benefit to starting with MCTS and switching to minimax as the branching factor decreases?

I've invented a deterministic, perfect-information game with a fairly large branching factor (~150) which tapers out dramatically after the midgame (~30 at worst). I need a strong AI. My understanding ...
1 vote
0 answers
35 views

What are the best practices of adding noise to game-playing bots?

I write bots that play card games. From time to time, I add noise to their decisions, mainly for two reasons: Reduce predictability: In games with hidden information the optimal play is a mix between ...
  • 405
1 vote
0 answers
76 views

Detecting cheats visually using AI

I really like to play my favorite 3D shooter game online. Unfortunately, it is really old and cheat protection isn't really common there, but cheaters are! It is very frustrating, because it really ...
  • 11
1 vote
0 answers
54 views

How to teach Machine Learning Agent to destroy replicating objects in a puzzle game?

I have an unusual but very interesting problem. I have a game that is very similar to Toon Blast (a puzzle mobile game). It's based on a Match-2 mechanic in which you can destroy 2 or more connected ...
  • 153
1 vote
0 answers
269 views

Why doesn't this Monte Carlo Tree Search algorithm work properly?

PROBLEM I'm writing a Monte-Carlo tree search algorithm to play chess in Python. I replaced the simulation stage with a custom evaluation function. My code looks perfect but for some reason acts ...
1 vote
0 answers
39 views

Why is the number of examined nodes $ O(b^{3d/4})$ in $\alpha$-$\beta$ pruning?

I'm taking a course 'Introduction to AI' and, in one of the tutorials, it was written that when pruning the game tree using $\alpha$-$\beta$ boundaries, the number of nodes that will be developed, ...
1 vote
0 answers
268 views

What is the size of 6-players no limit Texas holdem Poker?

What is the number of game states/information sets in 6-players, no limit, Texas Holdem? A year ago, Pluribus reached a super-human level in 6-players no limit Holdem Poker. I am interested in the ...
  • 405
1 vote
1 answer
984 views

Determining minimal state representation for maze game

I came across this question set. It asks following question: Let’s revisit our bug friends from assignment 2. To recap, you control one or more insects in a rectangular maze-like environment with ...
1 vote
0 answers
151 views

Monte Carlo Exploring Starts broke for 2048 game AI

I implemented a MCES for 2048 (the game), with a quality function implemented as a neural net of a single layer. The starts are created with 6 cells filled with values between 64 and 1024, two cells ...
1 vote
0 answers
70 views

What would be the good choice of algorithm to use for character action selection in an RPG, implemented in Python?

I have developed an RPG in likeness to the features showcased in the Final Fantasy series; multiple character classes which utilise unique action sets, sequential turn-based combat, front/back row ...
1 vote
0 answers
181 views

How do i start building an autoclick bot for pubg mobile?

I want to make a bot which clicks the fire button on the mobile screen upon seeing an enemies head. In pubg mobile which is an android game you have to control the fire button and the aim along with ...
1 vote
0 answers
38 views

What should be a good playing strategy in this 2-player simultaneous game?

This is a bot making problem from here. I am detailing the problem. The picture above shows the initial configuration of the game. P1 represents player1 and P2 represents player2. A scotch bottle is ...
1 vote
0 answers
112 views

Can I use deepfake to rotoscope for animation?

I'm a big fan of animation and have kept an eye on the deepfake's ability to replicate full body motion. So I ask Is there a deepfake software available I can use to gather animation from a video? ...
  • 11
1 vote
0 answers
73 views

What AI technologies were used in earlier versions of StarCraft?

I remember back in the 2000s, it was, and still is possible to play against computers in StarCraft BroodWar. They were not as good as pro players, but still reasonably smart. What AI technologies ...
  • 111
1 vote
0 answers
52 views

Unique game problem (ML, DP, PP etc)

Looking for a solution to my below game problem. I believe it to require some sort of reinforcement learning, dynamic programming, or probabilistic programming solution, but am unsure... This is my ...
1 vote
0 answers
57 views

Action spaces for an RTS game

I think reinforcement learning would be a good fit for this problem, but I am not sure of how to deal with a seemingly infinite number of actions. In the beginning of each game (generic RTS game), the ...
1 vote
0 answers
206 views

Understanding alpha-beta pruning for simplified NIM

This is a simple version of NIM: Two players alternately remove one, two or three coins from a stack initially containing 5 coins. The player who picks up the last coin loses. What does alpha-beta ...
  • 11
1 vote
0 answers
42 views

Game-based or nasty chatbot for Facebook Messenger or Skype

Are there chatbots for Facebook Messenger or Skype available which are game-based, i.e. with which it is possible to play a short funny game? It should be possible to play the game for at least 10 ...
  • 131
1 vote
0 answers
60 views

What to study for this simple poker game?

I'm a programmer with a background in mathematics, but I have no experience whatsoever with artificial intelligence/neural networks. I'd like to study it as a hobby, and my goal for now is to solve ...
1 vote
1 answer
100 views

Developing character tactics via repeated trials

Let's assume a common game scenario of several characters in a combat arena. Each character has different strengths and weaknesses. The arena has traps and tools. Suppose the characters had only very ...
  • 121
1 vote
0 answers
705 views

How to teach an AI to race optimally in a racing game?

I play a racing game called Need For Madness ( some gameplay: https://www.youtube.com/watch?v=NC5uFZ-t0A8 ). NFM is a racing game, where the player can choose different cars and race and crash the ...
1 vote
0 answers
52 views

Mini (local) NN for Mobile?

I'm working on architecture for a game AI where, due to the nature of the game, the classical approach seems likely be sufficient to beat most humans--the endgame is tractable and traditional game-...
  • 6,177
1 vote
0 answers
194 views

Help with implementing Q-learning for a feedfoward network playing a video game

I want to train a feedforward neural network to play a video game called Puyo Puyo 2, using reinforcement learning. More specifically, I'm trying Q-learning but I'm open to better alternatives. In ...
  • 21