Questions tagged [game-ai]

For questions related to game design involving AI.

Filter by
Sorted by
Tagged with
1
vote
0answers
20 views

How can an AI play Flow Free?

The game "Flow Free" in which you connect coloured dots with lines is very popular. A human can learn techniques to play it. I was wondering how an AI might approach it. There are certain rules of ...
1
vote
2answers
39 views

How can I benchmark an application of ant colony optimization?

In my research on video games path finding I'm using ant colony optimization, not only to find the shortest path, but also to add some unpredictability and adaptiveness to bots path finding. It works ...
3
votes
0answers
70 views

Deep Q-Network (DQN) to learn the game 2048

I am trying to build a Deep Q-Network (DQN) agent that can learn to play the game 2048. I am orientating myself on other programs and articles that are based on the game snake and it worked well (...
4
votes
3answers
2k views

What else can boost iterative deepening with alpha beta pruning?

I read about minimax, then alpha-beta pruning and then about iterative deepening. Iterative deepening coupled with alpha-beta pruning proves to quite efficient as compared alpha-beta alone. I have ...
1
vote
0answers
15 views

Getting score values from openai gym rom

I am using the SpaceInvaders-ram-v0 from OpenAI gym. I want to extract the game's current score using the RAM values. How do I get it? I tried doing some research ...
2
votes
1answer
79 views

Game AI for “Lines” : help to get started

I am trying to find a good approach to create a computer player for the game "Lines" from gamious on Android. The concept of the game is pretty straightforward : Lines is an abstract ‘zen’ game ...
3
votes
1answer
41 views

Puzzle solving AI?

I have a book containing lots of puzzles with instructions like: ...
2
votes
1answer
131 views

Large and Multiple-actions space

I have a steady hex-map and turn-based wargame featuring WWII carrier battles On a given turn, a player may choose different and independent actions 
(moving one, two naval unit, assigning a mission ...
2
votes
1answer
77 views

How to deal with huge branching factors in real-time?

Some time ago playing chess was challenging for algorithms, then Go game which is vastly more complex than compared to chess. How about playing RTS game which have enormous branching factors limited ...
1
vote
0answers
41 views

Why humans aren't motivated to play robot games? [closed]

The screenshot shows a prototype of a robot simulator. It's a robotarm in a physics simulation which can be controlled manual by the slider in the GUI. The idea is, that the human sets a value and ...
6
votes
2answers
128 views

Evolving network in game

So I wrote simple feed forward neural network that plays tic-tac-toe: 9 neurons in input layers: 1 - my sign, -1 - opponent's sign, 0 - empty; 9 neurons in hidden layer: value calculated using Relu; ...
0
votes
0answers
14 views

Invalid moves in Deep Reinforcement Learning for games [duplicate]

I've been working on a bot for a game involving dice throws and chance. The architecture involved is similar to AlphaZero in the that it has Convolutions and MCTS. According to the current state ...
3
votes
2answers
145 views

MinMax and enormous branches

I have to build a KI for a made-up game similar to chess. As I did research for a proper solution, I came upon the MinMax algorithm, but I'm not sure it will work with the given game dynamics. The ...
1
vote
2answers
120 views

Neural Network that Predicts Game State Based on Actions

I am trying to find literature on a network architecture that takes the following as in input: Action (like 'Up', 'Down', etc) Image of current state and outputs: Image of next state I already ...
13
votes
2answers
1k views

Input/output encoding for a neural network to learn a grid-based game

I am writing a simple toy game with the intent of training a deep neural network on top of it. The games rules are roughly the following: The game has a board made up of hexagonal cells. Both players ...
0
votes
0answers
19 views

Suggestion on How to Push SARS to Memory Buffer of Losing RL Agent in Adversarial Learning

I am trying to implement my first RL program where there are multiple agents, rather than just one. The environment I am using is the connect four game, which is turn-based. In DQ-Learning, an agent ...
0
votes
1answer
43 views

How to beat the EISBot AI in Starcraft?

According to the implementation details of the gameplying AI, EISbot, the software was implemented as a Goal-driven autonomy architecture which is using the behavior language ABL.[1] Different modules ...
1
vote
1answer
77 views

Deep Q Learning for Simple Game Not Effective

This is a follow-up question about one I asked earlier. The first question is here. Basically, I have a game where a paddle moves left and right to catch as much "food" as possible. Some food is good (...
1
vote
1answer
88 views

How to encode card game state into neural network input

I'm trying create neural network to predict moves in a card game. I am looking for recommendations on encoding the game state to my input layer. It's a complex turn based collectible card game (...
1
vote
1answer
45 views

Create an AI to solve a puzzle (by deduction)

Some puzzle games have a unique solution that can be solved by deduction rather than guesswork (e.g. Slitherlink, Masyu). Using a computer to solve this puzzle it's pretty easy, we can use a ...
1
vote
0answers
37 views

Unique game problem (ML, DP, PP etc)

Looking for a solution to my below game problem. I believe it to require some sort of reinforcement learning, dynamic programming, or probabilistic programming solution, but am unsure... This is my ...
2
votes
0answers
28 views

Will the RL agent implemented as a neural network fine-tune itself?

Normally, when you develop a neural network, train it for object recognition (on normal objects like bike, car, plane, dog, cloud, etc.), and it turns out to perform very well, you would like to fine-...
0
votes
0answers
12 views

Is Rapidly-exploring random tree the appropriate algorithm for solving Sokoban?

In the game of Sokoban, a robot has to push boxes to a goal in a map. He has only the ability to move in four directions (left, right, up, down) and the map is small (15x15 fields) so it looks like an ...
0
votes
0answers
17 views

How to slowdown the Eaters example in SOAR?

Recently, I've discovered that the SOAR cognitive architecture comes with built-in examples which are Eaters (a pacman clone) and Tanksoar (which is a Robocode like game).[1] After loading two agents ...
1
vote
1answer
37 views

How to deal with invalid output in a policy network? [duplicate]

I am interested in creating a neural network-based engine for chess. It uses a $8 \times 8 \times 73$ output space for each possible move as proposed in the Alpha Zero paper: Mastering Chess and Shogi ...
2
votes
0answers
41 views

How should I build an AI that quickly detects falling game assets on screen?

I want to build an AI that plays a simple android game. The game is just a one at a time object falling, some times at an angle. The AI needs to recognize the object and to decide whether to swipe ...
0
votes
0answers
31 views

Questions performance SimPLe pong for AI demo

For a demo I need to develop an AI solution to learn how to play pong. I have the following requirements: Computer needs to play against a human player. Learn while playing the game. Poor AI result ...
6
votes
2answers
380 views

Reinforcement Learning in Commercial Strategy Games

I'm a professional game developer investigating the potential for using reinforcement learning to build strategy game AI opponents that have more creative behavior compared to traditional techniques ...
0
votes
0answers
10 views

Line following with a swarm of robots?

Introduction The line following problem is some kind of introduction task for robot control. The goal is program a physical robot to follow a black line on the ground. What the programmers have to do ...
5
votes
1answer
63 views

Understanding the expansion phase in Monte Carlo Tree Search

All sources I can find provide a similar explanation to each phase. In the Selection Phase, we start at the root and choose child nodes until reaching a leaf. Once the leaf is reached (assuming the ...
3
votes
1answer
94 views

Using graph searching to solve peg solitaire?

Problem: I've been reading research papers on how to solve a peg solitaire using graph searching, but all the papers kind of assume you know how to do the reduction(polynomial time conversion) from ...
0
votes
0answers
31 views

Non player characters vs normal AI: what is the difference?

In the literature both concepts (NPC and AI) are introduced as AI systems. The idea is that, the computer will act autonomously. But it's naive to guess that creating a non player character is equal ...
3
votes
2answers
82 views

Are there any discount-factors based on branching factors?

I recently came across this function: $$\sum_{t = 0}^{\infty} \gamma^t R_t.$$ It's elegant and looks to be useful in the type of deterministic, perfect-information, finite models I'm working with. ...
1
vote
1answer
34 views

Feasibility of a team-based FPS AI?

We have seen advances in top down, RTS team games like Dota 2 and Starcraft II from companies like OpenAI who developed agents to beat real pro players most of the time. How would similar learning ...
4
votes
1answer
56 views

How do we find the length (depth) of the game tic-tac-toe in adversarial search?

When we perform the tic-tac-toe game using adversarial search I know how make a tree. Is there a way to find the depth of the tree; which level is the last level?
5
votes
2answers
116 views

What are the most compact Real Time-Strategy Games?

There was a recent informal question on chat about RTS games suitable for AI benchmarks, and I thought it would be useful to ask a question about them in relation to AI research. Compact is defined ...
1
vote
0answers
35 views

Action spaces for an RTS game

I think reinforcement learning would be a good fit for this problem, but I am not sure of how to deal with a seemingly infinite number of actions. In the beginning of each game (generic RTS game), the ...
3
votes
1answer
89 views

How do I solve the problem of positioning 11 pieces into a 8x8 puzzle?

I was trying to figure out how to create a solver to the puzzle of putting 11 pieces in a board (8 x 8). I created the game in http://www.xams.com.br/quebra. It is possible to turn the piece 90 ...
1
vote
1answer
161 views

Adversarial Game playing using RL

I asked a question relating to TicTacToe playing in RL. From the answer it seems to me a lot is dependent on the opponent (rightly so, if we write down the Expectation Equations). My question is (in ...
1
vote
1answer
83 views

Predicting fate of different actors in upcoming Avengers 4

How would one go about predicting which characters (actors) are going to die in the next Avengers movie. To elaborate a bit, given all leaked scripts (fake or not), interviews of different actors and ...
2
votes
1answer
156 views

Any interesting ways to combine Monte Carlo tree search with the minimax algorithm?

I've been working on a game-playing engine for about half a year now, and it uses the well known algorithms. These include minimax with alpha-beta pruning, iterative deepening, transposition tables, ...
4
votes
2answers
149 views

Neural Network with varying inputs (for a game ai)

I want to create a simple game which basically consists of 2d circles shooting smaller circles at each other (to make hitbox detection easier for the start). My goal is to create an ai which adapts ...
5
votes
1answer
102 views

Can this tic tac toe program be considered AI?

I coded a tic tac toe program, but I don't know if I can call it artificial intelligence. Here's what I did. There is a random player, which always makes random valid moves. And then there is the ...
1
vote
0answers
143 views

Minimax combined with machine learning to determine if a path should be explored

I have an idea for a new type of AI for two-player games with alternating turns, like chess, checkers, connect four, and so on. A little background: Traditionally engines for such games have used the ...
11
votes
3answers
7k views

How to train a neural network for a round based board game?

I'm wondering how to train a neural network for a round based board game like, tic-tac-toe, chess, risk or any other round based game. Getting the next move by inference seems to be pretty straight ...
6
votes
1answer
180 views

Issue with simple game AI

A few months ago I made a simple game that is similar to the dinosaur game in Google Chrome - you jump over obstacles, or don't jump over levitating obstacles, and jump to collect bitcoins, which can ...
1
vote
2answers
81 views

Creative AI semester project (4 week time-frame)

I am taking AI this semester and we have a semester project. We can choose just about anything. I was wondering if anyone has a creative idea that I might be able to do. Nothing that is so extensive ...
4
votes
2answers
232 views

Inconsistency in TD-Leaf algorithm in KnightCap chess engine

Notice that, in the following formula, at the very right, the term multiplied with $\lambda$ is $d_i$ $$ w := w + \alpha \sum_{i=1}^{N-1} \nabla r(x_i^l, w) \Big \lfloor \sum_{j=i}^{N-1} \lambda^{j-i}...
0
votes
0answers
20 views

Superhuman AI to disguise as human players

TL;DR below. You entered a online mini video game. It's a fast-paced hypercasual game. But it's a ranked one - top 10 get prizes. The leaderboard resets and prizes are handed out every couple of ...
5
votes
1answer
55 views

Why didn't champion of the Go game manage to win the last game against AlphaGo, after winning the 4th one?

In the documentary about the match, it is said that after losing the 4th game, AlphaGo came back stronger and started to play in a weird way (not human-like) and it was pretty impossible to be beaten. ...