Questions tagged [game-ai]
For questions related to game design involving AI.
240
questions
1
vote
1
answer
53
views
How should I weight the factors that affect the choice of an action in a strategy board game with multiple actions?
I have written an AI that plays a strategy board game. There are lots of different types of moves (e.g. attack, defend, help ally colony, etc.).
I calculate the best moves to do depending on a ...
- 5,292
1
vote
1
answer
107
views
Designing a reinforcement learning AI for a game of connect 4 [closed]
I've made a connect 4 game in javascript, and I want to design an AI for it. I made a post the other day about what output would be needed, and I think I could use images of the board and a CNN. I did ...
- 514
3
votes
1
answer
409
views
Building 'evaluation' neural networks for go, reversi, checkers etc, how to train?
I'm trying to build neural networks for games like Go, Reversi, Othello, Checkers, or even tic-tac-toe, not by calculating a move, but by making them evaluate a position.
The input is any board ...
- 514
7
votes
2
answers
3k
views
How do I create an AI for a two-players board game?
Goal
I want to create an artificial intelligence to compete against other players in a board game.
Game explanation
I have a board game similar to 'snakes and ladders'. You have to get to a final ...
- 38.2k
6
votes
2
answers
3k
views
How can I create an artificially intelligent aimbot for a game like CS:GO?
How can I create an artificially intelligent aimbot for a game like Counter-Strike Global Offensive (CS:GO)?
I have an initial solution (or approach) in mind. We can train an image recognition model ...
- 38.2k
7
votes
1
answer
554
views
When does the selection phase exactly end in MCTS?
All sources I can find provide a similar explanation to each phase.
In the Selection Phase, we start at the root and choose child nodes until reaching a leaf. Once the leaf is reached (assuming the ...
- 38.2k
6
votes
1
answer
2k
views
Which nodes are expanded in the expansion phase of MCTS?
I'm confused regarding a specific detail of MCTS.
To illustrate my question, let's take the simple example of tic-tac-toe.
After the selection phase, when a leaf node is reached, the tree is expanded ...
- 38.2k
0
votes
1
answer
73
views
Do algorithms like OpenAI's "think up strategies"?
I was discussing with a friend whether current AI does anything remotely similar to 'thinking' and he argued that AIs that play games must think up strategies.
While thinking may not be precisely ...
- 38.2k
2
votes
1
answer
276
views
What technology do people use to create bots for games like LOL or Runescape?
I was curious about how people make AI to play games. Does anyone know of the AI used to play these games? What allows the AI to see/click the screen in real-time? Even just direction on what ...
- 38.2k
3
votes
3
answers
3k
views
How to calculate the optimal placements for settlements in Catan without an ML algorithm?
Is it possible to calculate the best possible placements for settlements in Catan without using an ML algorithm?
While it is trivial to simply add up the numbers surrounding the settlement (highest ...
- 6,207
9
votes
4
answers
887
views
Can a neural network work out the concept of distance?
Imagine a game where it is a black screen apart from a red pixel and a blue pixel. Given this game to a human, they will first see that pressing the arrow keys will move the red pixel. The next thing ...
- 38.2k
2
votes
1
answer
658
views
What would be the most effective self-learning algorithm for a 7 player social deduction game?
There's this 7 player social deduction game called Secret Hitler, and I have been trying to find a self-learning AI algorithm to learn how to play this game for a while. Basically, four players are ...
- 123
1
vote
2
answers
93
views
How can I benchmark an application of ant colony optimization?
In my research on video games path finding I'm using ant colony optimization, not only to find the shortest path, but also to add some unpredictability and adaptiveness to bots path finding. It works ...
3
votes
0
answers
272
views
Deep Q-Network (DQN) to learn the game 2048
I am trying to build a Deep Q-Network (DQN) agent that can learn to play the game 2048. I am orientating myself on other programs and articles that are based on the game snake and it worked well (...
- 6,207
3
votes
1
answer
1k
views
2
votes
1
answer
173
views
How to deal with huge branching factors in real-time?
Some time ago playing chess was challenging for algorithms, then Go game which is vastly more complex than compared to chess.
How about playing RTS game which have enormous branching factors limited ...
- 38.2k
13
votes
2
answers
2k
views
Input/output encoding for a neural network to learn a grid-based game
I am writing a simple toy game with the intent of training a deep neural network on top of it. The games rules are roughly the following:
The game has a board made up of hexagonal cells.
Both players ...
CommunityBot
- 1
2
votes
1
answer
121
views
Deep Q Learning for Simple Game Not Effective
This is a follow-up question about one I asked earlier. The first question is here. Basically, I have a game where a paddle moves left and right to catch as much "food" as possible. Some food is good (...
- 27k
2
votes
1
answer
535
views
Create an AI to solve a puzzle (by deduction)
Some puzzle games have a unique solution that can be solved by deduction rather than guesswork (e.g. Slitherlink, Masyu). Using a computer to solve this puzzle it's pretty easy, we can use a ...
- 181
1
vote
0
answers
52
views
Unique game problem (ML, DP, PP etc)
Looking for a solution to my below game problem. I believe it to require some sort of reinforcement learning, dynamic programming, or probabilistic programming solution, but am unsure... This is my ...
- 111
2
votes
0
answers
98
views
Will the RL agent implemented as a neural network fine-tune itself?
Normally, when you develop a neural network, train it for object recognition (on normal objects like bike, car, plane, dog, cloud, etc.), and it turns out to perform very well, you would like to fine-...
- 38.2k
1
vote
1
answer
191
views
How to deal with invalid output in a policy network? [duplicate]
I am interested in creating a neural network-based engine for chess. It uses a $8 \times 8 \times 73$ output space for each possible move as proposed in the Alpha Zero paper: Mastering Chess and Shogi ...
- 38.2k
2
votes
0
answers
59
views
How should I build an AI that quickly detects falling game assets on screen?
I want to build an AI that plays a simple android game.
The game is just a one at a time object falling, some times at an angle. The AI needs to recognize the object and to decide whether to swipe ...
- 38.2k
3
votes
2
answers
144
views
Are there any discount-factors based on branching factors?
I recently came across this function:
$$\sum_{t = 0}^{\infty} \gamma^t R_t.$$
It's elegant and looks to be useful in the type of deterministic, perfect-information, finite models I'm working with.
...
- 38.2k
1
vote
1
answer
52
views
Feasibility of a team-based FPS AI?
We have seen advances in top down, RTS team games like Dota 2 and Starcraft II from companies like OpenAI who developed agents to beat real pro players most of the time. How would similar learning ...
- 393
6
votes
2
answers
215
views
What are the most compact Real Time-Strategy Games?
There was a recent informal question on chat about RTS games suitable for AI benchmarks, and I thought it would be useful to ask a question about them in relation to AI research.
Compact is defined ...
- 347
1
vote
0
answers
60
views
Action spaces for an RTS game
I think reinforcement learning would be a good fit for this problem, but I am not sure of how to deal with a seemingly infinite number of actions. In the beginning of each game (generic RTS game), the ...
- 111
3
votes
1
answer
170
views
How do I solve the problem of positioning 11 pieces into a 8x8 puzzle?
I was trying to figure out how to create a solver to the puzzle of putting 11 pieces in a board (8 x 8). I created the game in http://www.xams.com.br/quebra. It is possible to turn the piece 90 ...
- 31
7
votes
1
answer
1k
views
Any interesting ways to combine Monte Carlo tree search with the minimax algorithm?
I've been working on a game-playing engine for about half a year now, and it uses the well known algorithms. These include minimax with alpha-beta pruning, iterative deepening, transposition tables, ...
- 38.2k
5
votes
2
answers
790
views
Neural Network with varying inputs (for a game ai)
I want to create a simple game which basically consists of 2d circles shooting smaller circles at each other (to make hitbox detection easier for the start). My goal is to create an ai which adapts ...
- 499
6
votes
1
answer
183
views
Can this tic tac toe program be considered AI?
I coded a tic tac toe program, but I don't know if I can call it artificial intelligence.
Here's what I did.
There is a random player, which always makes random valid moves.
And then there is the ...
- 53
6
votes
1
answer
208
views
Issue with simple game AI
A few months ago I made a simple game that is similar to the dinosaur game in Google Chrome - you jump over obstacles, or don't jump over levitating obstacles, and jump to collect bitcoins, which can ...
CommunityBot
- 1
5
votes
2
answers
413
views
Inconsistency in TD-Leaf algorithm in KnightCap chess engine
Notice that, in the following formula, at the very right, the term multiplied with $\lambda$ is $d_i$
$$
w := w + \alpha \sum_{i=1}^{N-1} \nabla r(x_i^l, w) \Big \lfloor \sum_{j=i}^{N-1} \lambda^{j-i}...
- 38.2k
1
vote
0
answers
213
views
Understanding alpha-beta pruning for simplified NIM
This is a simple version of NIM: Two players alternately remove one, two or three coins from a stack initially containing 5 coins. The player who picks up the last coin loses.
What does alpha-beta ...
- 27k
3
votes
0
answers
73
views
Negative counterfactual regret
I am reading the paper Regret Minimization in Games with Incomplete
Information on CFR algorithm.
On page 4, the paper defines $R^{T,+}_{i,\text{imm}}=\max\{R^{T}_{i,\text{imm}}, 0\}$ after equation (...
- 6,207
0
votes
0
answers
288
views
How to back-propagate illegal actions for policy gradient learning
When training a AI RL agent to play a game there'll be situations where the AI cannot perform certain actions lest they violate the game rules. That's easy to handle, and I can set illegal actions to ...
- 403
2
votes
1
answer
387
views
Game AI design for a multiplayer random board game?
I'm writing an AI for a board game, and previously I would just create a value maximizing state machine and tune the factors one at a time.
However, the issues with this is getting apparent. My last ...
- 27k
1
vote
1
answer
370
views
How to use Genetic Algorithm for varying lengths of solutions
Until now, I always thought that Genetic Algorithm can be used for problems of which the solution space can be encoded (modeled) as a chromosome of a specific length. However, some people claim that ...
- 436
0
votes
1
answer
93
views
Genetic programming with Objective-C [closed]
I have a complex wargame already developed in a aging Objective-C and I would like to improve the AI
I have built the logic for self-play, fitness evaluation and evolution
The hard-time is the ...
- 236
0
votes
1
answer
805
views
How do I update the Q values of a Deep Q Network when exploring?
I am trying to implement a Deep Q Network to play Asteroids. Unfortunately, I am not sure how to calculate the Q value exactly, if I am exploring. For example, the agent is exploring for 1 second (...
- 38.2k
3
votes
1
answer
2k
views
How do I apply reinforcement learning to a game with infinitely many actions?
I am trying to figure out how to use a reinforcement learning algorithm, if possible, as a "black box" to play a game. In this game, a player has to avoid flying birds. If he wants to move, he has to ...
- 38.2k
1
vote
0
answers
44
views
Game-based or nasty chatbot for Facebook Messenger or Skype
Are there chatbots for Facebook Messenger or Skype available which are game-based, i.e. with which it is possible to play a short funny game? It should be possible to play the game for at least 10 ...
- 6,207
4
votes
0
answers
3k
views
Is this a good way to represent Connect 4 to a Neural Network?
I'm attempting to make a bot for the Connect 4 competition on http://riddles.io
My bot isn't horrible, like it's getting up the ladder, but it cannot compete with the winning bots.
I'm using a ...
CommunityBot
- 1
2
votes
1
answer
63
views
Could a neural network be capable to diferentiate between two boards of a game?
Let's propose, that I can define the state of a board in a board game, with 234 neurons. In theory, could I be able to train a neural network, with 468 inputs (two game boards), and 1 output, to tell ...
- 489
1
vote
0
answers
60
views
What to study for this simple poker game?
I'm a programmer with a background in mathematics, but I have no experience whatsoever with artificial intelligence/neural networks. I'd like to study it as a hobby, and my goal for now is to solve ...
- 6,207
1
vote
2
answers
249
views
Can Alpha–Beta be used on symmetric zero sum games?
This question was asked in an AI exam. How would you answer such question?
- 7,393
4
votes
1
answer
457
views
Why do neural nets and machine learning tend to work well with MCTS, but not with regular Minimax game-playing AI?
I've often heard MCTS grouped together with neural nets and machine learning. From what I gather, MCTS uses a refined intuition (from maching learning) to evaluate positions. This allows it to better ...
- 130
2
votes
0
answers
378
views
Implementing AI/ML for the card game "Cheat"
Background info
In Python, I've implemented a rudimentary engine to play "Cheat", supporting both bots and a human or only bots. When only bots are playing, the game is simulated.
When placing cards,...
- 6,207
0
votes
5
answers
1k
views
Can an AI learn how to play chess without instructions?
Can an AI learn to play chess if you give it nothing but "the goal is to win" as starting criteria? If not, what is the minimum information the AI would need to be "seeded" with in order to learn to ...
- 7,393
7
votes
1
answer
294
views
How does Hearthstone AI deal with random events
I want to learn a lot about the AI of CCG, such as Hearthstone. And now I have known one of the main algorithms that used in this kind of games, MCTS. It analyses the most promising moves, and expands ...
- 9,824