Questions tagged [game-ai]

For questions related to game design involving AI.

Filter by
Sorted by
Tagged with
7
votes
3answers
1k views

How can you represent the state and action spaces for a card game in the case of a variable number of cards and actions?

I know how a machine can learn to play Atari games (Breakout): Playing Atari with Reinforcement Learning. With the same technique, it is even possible to play FPS games (Doom): Playing FPS Games with ...
2
votes
1answer
206 views

Large and Multiple-actions space

I have a steady hex-map and turn-based wargame featuring WWII carrier battles On a given turn, a player may choose different and independent actions 
(moving one, two naval unit, assigning a mission ...
0
votes
0answers
21 views

Are there any python implementations of GGP games or how to use game logic written in GDL in python?

I'm writing a General Game Playing (GGP) AI in python. I'd like to test it on some GGP games. So are there any python implementations of GGP games? I found in http://games.ggp.org/base games written ...
1
vote
0answers
20 views

How much can/should the non-player character know about the game's world?

I'm about to write a non-player character (NPC). I wonder how much the AI should know about the game's world. So, my question isn't about the amount of training data the AI has to collect. I'm ...
1
vote
2answers
709 views

Minimax combined with machine learning to determine if a path should be explored

I have an idea for a new type of AI for two-player games with alternating turns, like chess, checkers, connect four, and so on. A little background: Traditionally engines for such games have used the ...
1
vote
0answers
43 views

Use of virtual worlds (e.g. Second Life) for training Artificial General Intelligence agents?

There is emerging effort for Third Wave Artificial Intelligence (Artificial General Intelligence) (http://hlc.doc.ic.ac.uk/3AI_HLC_2019.html and https://www.darpa.mil/work-with-us/ai-next-campaign) ...
4
votes
1answer
464 views

How can I apply reinforcement learning to solve this asteroid game?

Introduction An attractive asteroid game was described in the paper Learning Policies for Embodied Virtual Agents through Demonstration (2017, Jonathan Dinerstein et al.): In our first experiment, ...
26
votes
4answers
9k views

How to handle invalid moves in reinforcement learning?

I want to create an AI which can play five-in-a-row/gomoku. As I mentioned in the title, I want to use reinforcement learning for this. I use policy gradient method, namely REINFORCE, with baseline. ...
6
votes
5answers
209 views

Examples of single player games that use modern ML techniques in the AI?

Are there any examples of single player games that use modern ML technique in its games? By this I mean AI that plays with or against the human player, and not just play the game by itself (like Atari)...
1
vote
1answer
66 views

Unable to achieve expected outputs using NEAT for the snake game

I am trying to implement NEAT for the snake game. My game logic is ready, which is working properly and NEAT configured. But even after 100 generations with 200 genomes per generation, the snakes ...
2
votes
2answers
141 views

Neural Network that Predicts Game State Based on Actions

I am trying to find literature on a network architecture that takes the following as in input: Action (like 'Up', 'Down', etc) Image of current state and outputs: Image of next state I already ...
0
votes
1answer
71 views

Do I need a large pool of training data to train a bot to play the 'pegging' game in the cribbage card game

The game of cribbage https://en.wikipedia.org/wiki/Cribbage is a two-player card game played over a series of deal with the goal to reach 121 points. The game's elements are: the discard. There are ...
0
votes
1answer
46 views

Were AI strategies identified at go or starcraft games and how?

When an AI is trained to play an opposing game, such as chess or go, it can become very strong. I have read in an article (non-scientific) the claim that AI strategies were identified by scientists ...
4
votes
1answer
72 views

How could an AI detect whether an enemy in a game can be blocked off/trapped?

Imagine a game played on a 10x10 grid system where a player can move up down left or right and imagine there are two players on this grid: An enemy and you. In this game, there are walls on the grid ...
3
votes
1answer
89 views

Why is tic-tac-toe considered a non-deterministic environment?

I have been reading about deterministic and stochastic environments, when I came up with an article that states that tic-tac-toe is a non-deterministic environment. But why is that? An action will ...
1
vote
1answer
231 views

How to encode card game state into neural network input

I'm trying create neural network to predict moves in a card game. I am looking for recommendations on encoding the game state to my input layer. It's a complex turn based collectible card game (...
1
vote
1answer
51 views

How is the probability transition matrix populated in the Markov process (chain) for a board game?

Following on from my other (answered) question: With regards to the Markov process (chain), if an environment is a board game and its states are the various position the game pieces may be in, how ...
1
vote
0answers
35 views

How can I convert a simple CLI RPG to a compatible environment for training an RL agent via stable-baselines?

What would be the good choice of algorithm to use for character action selection in an RPG, implemented in Python? I had previously asked this question in the hopes of getting headway on the AI ...
1
vote
0answers
78 views

Monte Carlo Exploring Starts broke for 2048 game AI

I implemented a MCES for 2048 (the game), with a quality function implemented as a neural net of a single layer. The starts are created with 6 cells filled with values between 64 and 1024, two cells ...
3
votes
1answer
211 views

Is it feasible to use minimax to solve a board game with a large number of moves?

I have to build a KI for a made-up game similar to chess. As I did research for a proper solution, I came upon the MinMax algorithm, but I'm not sure it will work with the given game dynamics. The ...
2
votes
1answer
72 views

q learning appears to converge but does not always win against random tic tac toe player

q learning is defined as: Here is my implementation of q learning of the tic tac toe problem: ...
3
votes
2answers
121 views

Game AI for “Lines” : help to get started

I am trying to find a good approach to create a computer player for the game "Lines" from gamious on Android. The concept of the game is pretty straightforward : Lines is an abstract ‘zen’ game ...
1
vote
0answers
40 views

What would be the good choice of algorithm to use for character action selection in an RPG, implemented in Python?

I have developed an RPG in likeness to the features showcased in the Final Fantasy series; multiple character classes which utilise unique action sets, sequential turn-based combat, front/back row ...
10
votes
5answers
4k views

How do I keep track of already visited states in breadth-first search?

I was trying to implement the breadth-first search (BFS) algorithm for the sliding blocks puzzle (number type). Now, the main thing I noticed is that, if you have a $4 \times 4$ board, the number of ...
3
votes
1answer
1k views

What is the typical AI approach for solving blackjack?

I'm currently developing a blackjack program. Now, I want to create an AI that essentially uses the mathematics of blackjack to make decisions. So, what is the typical AI approach for solving ...
2
votes
2answers
185 views

What are examples of simple problems and applications that can be solved with AI techniques?

What are examples of simple problems and applications that can be solved with AI techniques, for a beginner who is trying to make use of his basic programming skills into AI at the beginning level?
2
votes
0answers
51 views

What are the main technologies needed to build an AI for Warcraft 3's mod DotA?

What are the main technologies needed to build an AI for Warcraft 3's mod Defense of the Ancients (DotA)? Maybe I can take inspiration from OpenAI's work.
9
votes
3answers
667 views

Does Monte Carlo tree search qualify as machine learning?

To the best of my understanding, the Monte Carlo tree search (MCTS) algorithm is an alternative to minimax for searching a tree of nodes. It works by choosing a move (generally, the one with the ...
5
votes
1answer
238 views

What are some resources for coding some artificial intelligence techniques in the context of games?

I know the most basic rudimentary theory on AI, and I want to delve into actual practical coding with AI and machine learning. I already know a decent bit of coding in C++ and I'm learning Python ...
1
vote
1answer
51 views

How can I model and solve the Knight Tour problem with reinforcement learning?

I've read about the Knight Tour problem. And I wanted to try to solve it with a reinforcement learning algorithm with OpenAI's gym. So, I want to make a bot that can move on the chess table like the ...
3
votes
2answers
227 views

Is a good evaluation function as good as any of the extensions of alpha-beta pruning?

I would like to know if having a really good evaluation function is as good as using any of the extensions of alpha-beta pruning, such as killer moves or quiescence search?
2
votes
1answer
504 views

If certain moves are compulsory, will there still be a need for a quiescence search?

Certain games, like checkers, have compulsory moves. In checkers, for instance, if there's a jump available a player must take it over any non-jumping move. If jumps are compulsory, will there still ...
3
votes
1answer
186 views

How does one even begin to mathematically model an AI algorithm?

How does one even begin to mathematically model an AI algorithm, like alpha-beta pruning or even its thousands of variations, to determine which variation is best?
1
vote
0answers
24 views

How are AI's strategies discovered from chess and starcraft games?

Chess and starcraft games have been played by AI and sometimes won. Artificial intelligence had for these games a complex set of rules, database and decision-making tools to decide which actions it ...
1
vote
0answers
50 views

How do i start building an autoclick bot for pubg mobile?

I want to make a bot which clicks the fire button on the mobile screen upon seeing an enemies head. In pubg mobile which is an android game you have to control the fire button and the aim along with ...
15
votes
3answers
6k views

How do I choose the best algorithm for a board game like checkers?

How do I choose the best algorithm for a board game like checkers? So far, I have considered only three algorithms, namely, minimax, alpha-beta pruning, and Monte Carlo tree search (MCTS). Apparently,...
1
vote
0answers
29 views

What should be a good playing strategy in this 2-player simultaneous game?

This is a bot making problem from here. I am detailing the problem. The picture above shows the initial configuration of the game. P1 represents player1 and P2 represents player2. A scotch bottle is ...
2
votes
1answer
49 views

Can we use a neural network that is trained using Reinforcement Learning for dynamic game level difficulty designing in realtime?

I am a newbie to Machine Learning and AI. As per my understanding, with the use of reinforcement learning (reward/punishment environment), we can train a neural network to play a game. I would like ...
3
votes
4answers
79 views

How can artificial intelligence predict the next possible moves of the player?

When you play video games, sometimes there is an AI that attempts to predict what are you going to do. For example, in the Candy Crush game, if you finish the level and you still have moves ...
2
votes
0answers
52 views

MCTS RAVE performing badly in Board Game AI

I'm using Monte Carlo Tree Search with UCT selection to try and build an AI player for a complex multiplayer board game. My regular UCT MCTS seems to be working fine, winning with random and basic ...
1
vote
1answer
44 views

Should I be trying to create a generic or specific (to particular game) reinforcement learning agent?

I'm creating an RL application for the game Connect Four. In general, should I be aiming to create an application that's more generic, which would 'learn' different games, or specific to a ...
1
vote
0answers
28 views

NN for card game evaluation function

I've written an Monte Carlo Tree Search player for the game of Castle (AKA Shithead, Shed, Palace...). I have set this MCTS player to play against a basic rule based AI for ~30000 games and collected ~...
1
vote
0answers
39 views

Can I use deepfake to rotoscope for animation?

I'm a big fan of animation and have kept an eye on the deepfake's ability to replicate full body motion. So I ask Is there a deepfake software available I can use to gather animation from a video? ...
2
votes
0answers
25 views

How to create a best strategy AI for a specific complex ruleset?

I am new to this topic, researched a lot, but still, I have no clue which way might be the right one. As I do not have previous Expertise on this, it is very difficult for me to even find out the ...
9
votes
5answers
3k views

The real approach of creating AI for a fighting robot in an MMO

I have a MMO game where I have players. I wanted to invent something new to the game, and add player-bots to make the game be singleplayable as-well. The AI I want to add is simply only for ...
1
vote
0answers
62 views

What AI technologies were used in earlier versions of StarCraft?

I remember back in the 2000s, it was, and still is possible to play against computers in StarCraft BroodWar. They were not as good as pro players, but still reasonably smart. What AI technologies ...
5
votes
1answer
1k views

Why did AlphaGo lose its Go game?

We can read on wiki page that in March 2016 AlphaGo AI lost its game (1 of 5) to Lee Sedol, a professional Go player. One article cite says: AlphaGo lost a game and we as researchers want to ...
2
votes
2answers
102 views

How can I train a RL agent to play board games successfully without human play?

How would you go about training an RL Tic Tac Toe (well, any board game, really) application to learn how to play successfully (win the game), without a human having to play against the RL? ...
2
votes
0answers
29 views

Using ML for Enemy Generation in Video Games

I am attempting to make a 2-D platformer game where the player traverses through an evil factory that is producing killer robots. The robots spawn at multiple specific locations in each level and ...
1
vote
0answers
28 views

Best AI Approach for 2D to-down space shooter

I am building a 2d top-down space game, which involves several objects, such as asteroids, drones, spaceships, space litter and power-ups. It follows the rules of space gravity, with speed and ...