Stack Exchange Network

Stack Exchange network consists of 175 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [neat]

NeuroEvolution of Augmenting Topologies (NEAT)

1
vote
2answers
42 views

What does the formula $1-\sum_i(e_i-a_i)^2$ mean in this NEAT Python API?

I have looked at the documentation for the NEAT Python API found here, but it shows calculus like this: The error for each genome is $1-\sum_i(e_i-a_i)^2$ I haven't learned calculus at the moment....
0
votes
0answers
14 views

Using neuroevolution to train a 7 DOF arm: How do I choose the correct fitness function and hyperparameters?

I am trying to train an ANN to control a 7 Degrees-Of-Freedom arm. It should reach a target avoiding a single obstacle. Given my modelling of the situation, my input layer is composed of 12 nodes: 5 ...
0
votes
0answers
17 views

Turn a NES ROM into object/tile representation

So i have a rom of a hacked super mario game (it has 2 players: Mario and Luigi). Feeding in the raw pixel data of this results in very poor rewards. I was wondering if there was a way to transform ...
1
vote
0answers
36 views

Running 2 NEAT nets on the same observations

So i have been playing around with neat-python. I made a program, applying neat, to play pinball on the Atari 2600. The code for that can be found in the file ...
2
votes
1answer
28 views

How accurate are neuroevolution algorithms in modelling organism evolution?

How accurate are neuro-evolution algorithms (such as NEAT) in modelling real organism evolution?
4
votes
1answer
92 views

Is there a neural network with a varying number of neurons?

Is there some type of neural network that changes the number of neurons while training? Using this idea the network can increase or decrease the amount of neurons when the complexity of the inputs ...
1
vote
1answer
34 views

How does NEAT work differently to ordinary machine learning algorithms?

Im trying to learn a bit more about why someone would use a neuroevolution algorithm over a traditional machine learning algorithm. i.e what situation would only apply to an algorithm such as NEAT, ...
3
votes
0answers
42 views

How do you implement NEAT by taking into account the loops?

I'm working on my own implementation of NEAT algorithm based on the original 2002 paper called "Efficient Reinforcement Learning through Evolving Neural Network Topologies" (by Kenneth O. Stanley and ...
1
vote
1answer
45 views

Are innovation weights shared in the NEAT algorithm?

I am trying to implement NEAT algorithm in Python from scratch. However, I am stuck. When a new innovation number is created it has two nodes which represents the connection. Also this innovation ...
1
vote
1answer
50 views

Neat Algorithm Question

I am new to this community, I have simple question. Can inputs nodes or output nodes be connected to each other in Neat Algorithm? Note: Inputs to --> Inputs or Output to --> Outputs
2
votes
1answer
35 views

Using NEAT, will the child of two parent genomes always have the same structure as the more fit parent?

I'm trying to implement the NEAT Algorithm using c#, based off of Kenneth O. Stanley's paper. On page 109 (12 in the pdf) it states "Matching genes are inherited randomly, whereas disjoint genes (...
4
votes
0answers
64 views

How does the NEAT speciation algorithm work?

I've been reading up on how NEAT (Neuro Evolution of Augmenting Topologies) works and i've got the main idea of it, but one thing that's been bothering me is how you split the different networks into ...
1
vote
0answers
84 views

NEAT - Managing species across generations

I (mis?)understood the NEAT algorithm has the following steps: Create a genome pool with N random genomes Calculate each genome fitness Assign each genome to a species Calculate the adjusted fitness ...
1
vote
0answers
337 views

NEAT + Keras : reproducibility problem (World Models implementation)

I'm trying to apply the World Models architecture to the Sonic game (using the gym-retro library). My problem concerns the evolutionnary algorithm part that I use as the controller (worldmodels = ...
3
votes
2answers
334 views

Creating a self learning Mario Kart game AI?

I will be undertaking a project over the next year to create a self learning AI to play a racing game, currently the game will be Mario Kart 64. I have a few questions which will hopefully help me ...
3
votes
1answer
118 views

Can a crossover result in a node with no outgoing connections?

I'm currently implementing the original NEAT algorithm in Swift. Looking at figure 4 in Stanley's original paper, it seems to me there is a chance that node 5 will have no (enabled) outgoing ...
5
votes
3answers
1k views

Can neuro-evolution of augmenting topologies (NEAT) neural networks be built in TensorFlow?

I am making a machine learning program for time series data analysis and using NEAT could help the work. I started to learn TensorFlow not long ago but it seems that the computational graphs in ...
1
vote
1answer
72 views

Can neuro-evolution methods be combined with A3C?

As a amateur researcher and tinkerer, I've been reading up on neuro-evolution networks (e.g. NEAT) as well as the A3C RL approach presented by Mnih et al and got to wondering if anyone has ...
2
votes
1answer
212 views

NEAT: Speciation

I was trying to implement NEAT but got stuck at the speciating of my clients/genomes. What I got so far is: the distance function implemented each genome can mutate nodes/connections. 2 genomes can ...
2
votes
0answers
60 views

Speciation in NEAT - Advantages of keeping stable number of species

I found several methods for setting the compatibility distance in NEAT: some normalize it, some don't, some automatically adjust it. In a few tests I am running, using normalized static compatibility ...
1
vote
1answer
154 views

How do I restrict the neural network structure to be acyclic in NEAT?

I want my neural network structure to not have a circular/looping structure something similar like a directed acyclic graph (DAG). How do I do that?
3
votes
1answer
312 views

NEAT crossover - what to do with disjoint and excess genes

According to the original paper "Genes that do not match are inherited from the more fit parent" But what if the more fit parent has lesser nodes compared to the other, will the disjoint/excess genes ...
1
vote
2answers
521 views

How to evaluate a NEAT neural network?

I'm trying to write my own implementation of NEAT and I'm stuck on the network evaluate function, which calculates the output of the network. NEAT as you may know contains a group of neural networks ...
3
votes
1answer
1k views

Training AI to play NES/SNES games on NN python

I am currently getting into Deep Learning and would like to set up an environment for training an Artificial Neural Network or NEAT to play simple video games on NES (Mario etc.) and SNES ( Donkey ...
4
votes
1answer
1k views

Implementing the “original” NEAT algorithm in JavaScript

I've recently read the original paper about NeuroEvolution of Augmenting Topologies by Kenneth O. Stanley and am now trying to prototype it myself in JavaScript. I stumbled across a few questions I ...
2
votes
1answer
137 views

Does training happen during NEAT?

I am wondering, when one uses NEAT to evolve best fitting network for the job, does training take place in each epoch as well? If I understand correctly, training is adjustment of weights in the ...
0
votes
1answer
143 views

How to evaluate output of unlayered NN?

I used to work with 'traditional' layered neural network and I evaluated the output given certain inputs by processing layer-by-layer. With NEAT, a neural network may assume any topology and they are ...
2
votes
1answer
368 views

How are connection weights “perturbed”?

I am reading through the NEAT paper here. On page 14 of the PDF, there is this quote about mutation: There was an 80% chance of a genome having its connection weights mutated, in which case each ...
4
votes
2answers
70 views

Help with dual parameter fitness function

Summary: I am teaching bots to pick food on a playing field. Some food is poisonous and some is good. Food Details: Poisonous food subtracts score points and good food adds. Food points vary based ...
2
votes
2answers
160 views

NEAT - Can mutation enable a disabled connection?

In the add node mutation, the connection between two chosen nodes (e.g A and B) is first disabled and then a new node is created between A and B with their respective two connections. I guess that the ...
5
votes
2answers
352 views

NEAT - Innovation for Connection genes only?

Does NEAT requires only connection genes to be marked with a global innovation number? From the NEAT paper Whenever a new gene appears (through structural mutation), a global innovation number is ...
1
vote
1answer
162 views

adjusted fitness in NEAT algorithm

I'm learning about NEAT from the following paper: http://nn.cs.utexas.edu/downloads/papers/stanley.ec02.pdf I'm having trouble understanding how adjusted fitness penalizes large species and prevents ...
7
votes
4answers
7k views

Teach a Neural Network to play a card game

I am currently writing an engine to play a card game, as there is no engine yet for this particular game. I am hoping to be able to introduce a neural net to the game afterwards, and have it learn to ...
4
votes
1answer
115 views

Problem with fitness calculation in NEAT

I am working on a project in which a drone is up to learn to fly. I am using NEAT. For the first experiment I want it to learn how to hover inside a 3x3x3 meters box. My input is 6 sensors for each ...
9
votes
6answers
510 views

Open-source tool for home AI learning/experimentation?

I'd like to do some experimenting with neural net evolution (NEAT). I wrote some GA and neural net code in C++ back in the 90s just to play around with, but the DIY approach proved to be labor-...
2
votes
1answer
79 views

What to do with duplicate Innovations in a genome?

I´m currently implementing NEAT. What should I do when in a mutation the same Innovation occurs which has already happened to that genome? Should I simply ignore it? If not what do I do with it in ...
6
votes
1answer
192 views

How does the Mating in NEAT take place

In the NEAT paper it says: The entire population is then replaced by the offspring of the remaining organisms in each species. But how does it take place? I mean like are they paired and then ...
5
votes
1answer
408 views

Questions to the NEAT Algorithm

I have read the NEAT paper and some questions are still bugging me: When do mutations occur? Between which Nodes? When Mating what happens if 2 genes have the same connection but a different ...
5
votes
1answer
457 views

When do mutations in NEAT occur?

I read through the NEAT paper and I understand the algorithm now. But one thing is still unclear to me. When does the mutation occur and how does it take place? How is it chosen whether to add a node ...
1
vote
2answers
399 views

Neural Network learning to play Connect 4

I want to make a Connect 4 AI using machine learning but I'm a complete beginner to the topic. From what I've seen an ANN is the way to go; some phrases I've heard are "neuroevolution" and the acronym ...