Questions tagged [neat]

For questions related to the neuroevolution technique called NeuroEvolution of Augmenting Topologies (NEAT), introduced in the paper "Evolving Neural Networks through Augmenting Topologies" (2002) by Kenneth O. Stanley and Risto Miikkulainen.

Filter by
Sorted by
Tagged with
0
votes
0answers
10 views

In NEAT algorithm, can innovation number really indicate gene's historical origin?

When a new connection is created by mutation, global innovation number is assigned to the connection gene. The key here is that, if the same mutation (connection with same source node and same target ...
0
votes
0answers
52 views

How to evaluate a Genome in NEAT

I am trying to implement NEAT from scratch by going through the original NEAT paper. I implemented a Genome class which consists of a list of Node Genes and ...
1
vote
0answers
77 views

How can I perform the forward pass in a neural network evolved with NEAT, given that some connections may not exist or there may be loopy connections?

I have a problem that arose as part of a NEAT (Neuro Evolution Through Augmenting Topologies) implementation that I am writing. I am wanting it to produce topologies or graphs that describe neural ...
2
votes
1answer
65 views

Evolved networks fail to solve XOR

My implementation of NEAT consistently fails to solve XOR completely. The species converge on different sub-optimal networks which map all input examples but one correctly (most commonly (1,1,0)). Do ...
0
votes
0answers
35 views

How to interpret the final neural network generated in NEAT-Python?

I made a simple obstacle collision game in Python and made a neural network which will play the game using the NEAT (NeuroEvolution of Augmenting Topologies) and I got a final network as follows -> ...
0
votes
0answers
49 views

ALL OUTPUTS for my neural network return SAME as [0.0, 0.0, 0.0] all of time. Trying to make an AI that plays the Snake Game in Python using NEAT

I am trying to make an AI that plays the Snake Game using the NEAT library in Python. I have most things figured out. I have chosen 6 inputs for my neural network -> Is it clear in forward ...
2
votes
0answers
68 views

NEAT can't solve XOR completely

I'm currently implementing the NEAT algorithm. But problems occur when testing it with problems which don't have a linear solution(for example xor). My xor only produces 3 correct outputs once at a ...
2
votes
2answers
61 views

How do I determine the genomes to use for crossover in NEAT?

If I have the fitness of each genome, how do I determine which genome will crossover with which, and so on, so that I get a new population? Unfortunately, I can't find anything about it in the ...
2
votes
0answers
165 views

How to select good inputs and fitness function to achive good results with NEAT for Icy Tower bot

I'm trying to make a bot to the famous "Icy Tower" game. I rebuilt the game using pygame and I'm trying to build the bot using Python-NEAT. Every generation a population of 70 characters ...
0
votes
1answer
40 views

What does “In each generation, 25% of offspring resulted from mutation without crossover” mean in the context of NEAT?

I am reading through the NEAT paper. In parameter settings, page 15, there is: In each generation, 25% of offspring resulted from mutation without crossover. What does it mean?
3
votes
0answers
235 views

How to perform classification with NEAT-Python?

I am trying to do classification using NEAT-python for the first time, and I am having difficulty getting the accuracy rate. I tried the same problem with an ANN and was able to get a good accuracy ...
4
votes
1answer
67 views

In NEAT, is it a good idea to give the same ID to node genes created from the same connection gene?

Do I have to prevent nodes created from the same connection gene to have different IDs/innovation number? In this example, the node 6 is created from the connection going from node 3 to node 4: In ...
2
votes
1answer
172 views

Do I have to crossover my node genes in NEAT, and how?

I'm currently trying to code the NEAT algorithm by myself, but I got stuck with two questions. Here they are: What happens if during crossover a node is removed (or disabled) and there's a connection ...
2
votes
1answer
100 views

I created a snake game and fitted the NEAT algorithm and there's issues

Below are my Inputs Outputs and fitness function. The snake is learning at a slow rate, and seems to be stagnant, additionally when the snake collides with the food, it gets deleted from the genome, ...
2
votes
1answer
151 views

How to choose the activation function in neuroevolution?

I am developing a NEAT flappy bird game, and it doesn't work, the system stays stupid for 300 generations. I chose tanh() for activation, just because it's included in JS. I can't find a good ...
2
votes
2answers
64 views

Are connections genes in a genome ever deleted or just disabled?

When a new node is added, the previous connection is disabled and not removed. Is there any situation in which a connection gene is removed? For example, in the above diagram connection gene with ...
2
votes
2answers
118 views

what will i be able to do in the end of AI: modern approach? [closed]

i just started the book and i was wondering , what will i be able to do in AI by the end of the book ? and more particularly, what is my position with Reinforcement Learning, deep neural networks and ...
1
vote
1answer
60 views

How are weights updated in a genetic algorithm with neural network?

Suppose an AI is to play the game flappy bird. And the fitness function is how long the bird has traveled before the game ends. Would we have multiple neural networks initialized at the beginning ...
1
vote
1answer
87 views

Unable to achieve expected outputs using NEAT for the snake game

I am trying to implement NEAT for the snake game. My game logic is ready, which is working properly and NEAT configured. But even after 100 generations with 200 genomes per generation, the snakes ...
0
votes
1answer
387 views

Library for rendering neural network NEAT

I just finished my implementation of NEAT and I want to see the phenotype of each genome. Is there a library for displaying a neural network like this? Example of my genome syntax: ...
6
votes
2answers
485 views

Can neuroevolution be combined with gradient descent?

Is there any precedent for using a neuroevolution algorithm, like NEAT, as a way of getting to an initialization of weights for a network that can then be fine-tuned with gradient descent and back-...
2
votes
1answer
105 views

Disabling of genes during crossover (NEAT)

I am implementing NEAT (Neuroevolution of augmenting topologies) by Stanley, Original Paper. I am facing a problem during crossover of genomes. Suppose two networks with connections ...
1
vote
0answers
217 views

Exploding population size in neat-python

I am trying to make my AI win the board game "Catan" against my friends. Therefore i am using the python implementation of NEAT. As I changed the values of ...
1
vote
1answer
96 views

How does NEAT find the most successful generation without gradients?

I'm new to NEAT, so, please, don't be too harsh. How does NEAT find the most successful generation without gradient descent or gradients?
2
votes
2answers
127 views

How to reduce amount of species in NEAT?

I am using the following library: https://github.com/vishnugh/evo-NEAT which seems to be a pretty simple NEAT-implementation. Therefore I am using the following Config: ...
1
vote
0answers
38 views

What are some examples of tasks in which, currently, neuroevolution outperforms gradient-based approaches?

Note: I am NOT asking for general advantages of neuroevolution over standard approaches (e.g.: architecture search, parallelization), I am asking for examples of tasks in which, currently, ...
2
votes
3answers
119 views

What does the formula $1-\sum_i(e_i-a_i)^2$ mean in this NEAT Python API?

I have looked at the documentation for the NEAT Python API found here, where it's written The error for each genome is $1-\sum_i(e_i-a_i)^2$ I have not yet learned calculus, so I can't understand ...
0
votes
0answers
51 views

How do I choose an appropriate fitness function and hyper-parameters to train a 7-DOF arm?

I am trying to train an ANN to control a 7 Degrees-Of-Freedom arm. It should reach a target avoiding a single obstacle. Given my modeling of the situation, my input layer is composed of 12 nodes: 5 ...
1
vote
2answers
94 views

Running 2 NEAT nets on the same observations

So i have been playing around with neat-python. I made a program, applying neat, to play pinball on the Atari 2600. The code for that can be found in the file ...
3
votes
1answer
59 views

How accurate are neuroevolution algorithms in modelling organism evolution?

How accurate are neuro-evolution algorithms (such as NEAT) in modelling real organism evolution?
5
votes
1answer
172 views

Is there a neural network with a varying number of neurons?

Is there some type of neural network that changes the number of neurons while training? Using this idea, the network can increase or decrease the number of neurons when the complexity of the inputs ...
3
votes
1answer
463 views

Why would someone use NEAT over other machine learning algorithms?

Why would someone use a neuroevolution algorithm, such as NEAT, over other machine learning algorithms? What situation would only apply to an algorithm such as NEAT, but no other machine learning ...
4
votes
2answers
390 views

How do you implement NEAT by taking into account the loops?

I'm working on my own implementation of NEAT algorithm based on the original 2002 paper called "Efficient Reinforcement Learning through Evolving Neural Network Topologies" (by Kenneth O. Stanley and ...
2
votes
1answer
172 views

Are innovation weights shared in the NEAT algorithm?

I am trying to implement NEAT algorithm in Python from scratch. However, I am stuck. When a new innovation number is created it has two nodes which represents the connection. Also this innovation ...
2
votes
1answer
219 views

Can NEAT produce neural networks where inputs are directly connected to outputs?

Can NEAT produce neural networks where inputs are directly (without intermediate hidden neurons) connected to outputs?
3
votes
1answer
85 views

Using NEAT, will the child of two parent genomes always have the same structure as the more fit parent?

I'm trying to implement the NEAT Algorithm using c#, based off of Kenneth O. Stanley's paper. On page 109 (12 in the pdf) it states "Matching genes are inherited randomly, whereas disjoint genes (...
6
votes
1answer
700 views

How does the NEAT speciation algorithm work?

I've been reading up on how NEAT (Neuro Evolution of Augmenting Topologies) works and I've got the main idea of it, but one thing that's been bothering me is how you split the different networks into ...
2
votes
2answers
412 views

NEAT - Managing species across generations

I (mis?)understood the NEAT algorithm has the following steps: Create a genome pool with N random genomes Calculate each genome fitness Assign each genome to a species Calculate the adjusted fitness ...
1
vote
0answers
1k views

NEAT + Keras : reproducibility problem (World Models implementation)

I'm trying to apply the World Models architecture to the Sonic game (using the gym-retro library). My problem concerns the evolutionnary algorithm part that I use as the controller (worldmodels = ...
2
votes
1answer
659 views

Creating a self learning Mario Kart game AI?

I will be undertaking a project over the next year to create a self learning AI to play a racing game, currently the game will be Mario Kart 64. I have a few questions which will hopefully help me ...
4
votes
1answer
163 views

Can a crossover result in a node with no outgoing connections?

I'm currently implementing the original NEAT algorithm in Swift. Looking at figure 4 in Stanley's original paper, it seems to me there is a chance that node 5 will have no (enabled) outgoing ...
7
votes
2answers
3k views

Can neuro-evolution of augmenting topologies (NEAT) neural networks be built in TensorFlow? [closed]

I am making a machine learning program for time series data analysis and using NEAT could help the work. I started to learn TensorFlow not long ago but it seems that the computational graphs in ...
1
vote
1answer
132 views

Can neuro-evolution methods be combined with A3C?

As a amateur researcher and tinkerer, I've been reading up on neuro-evolution networks (e.g. NEAT) as well as the A3C RL approach presented by Mnih et al and got to wondering if anyone has ...
2
votes
1answer
615 views

What is the order of the genetic operations in NEAT?

I was trying to implement NEAT, but I got stuck at the speciating of my clients/genomes. What I got so far is: the distance function implemented, each genome can mutate nodes/connections, two ...
4
votes
0answers
103 views

Speciation in NEAT - Advantages of keeping stable number of species

I found several methods for setting the compatibility distance in NEAT: some normalize it, some don't, some automatically adjust it. In a few tests I am running, using normalized static compatibility ...
1
vote
2answers
352 views

How do I restrict the neural network structure to be acyclic in NEAT?

I want my neural network structure to not have a circular/looping structure something similar like a directed acyclic graph (DAG). How do I do that?
5
votes
1answer
554 views

What if the more fit parent has fewer nodes compared to the other, will the disjoint and excess genes be discarded?

In the paper Efficient Evolution of Neural Network Topologies (2002), the authors say Genes that do not match are inherited from the more fit parent What if the more fit parent has fewer nodes ...
4
votes
6answers
2k views

How to evaluate a NEAT neural network?

I'm trying to write my own implementation of NEAT and I'm stuck on the network evaluate function, which calculates the output of the network. NEAT as you may know contains a group of neural networks ...
3
votes
0answers
2k views

Training AI to play NES/SNES games on NN python [closed]

I am currently getting into Deep Learning and would like to set up an environment for training an Artificial Neural Network or NEAT to play simple video games on NES (Mario etc.) and SNES ( Donkey ...
5
votes
1answer
3k views

Several questions regarding the NEAT algorithm [closed]

I've recently read the paper Evolving Neural Networks through Augmenting Topologies which introduces NEAT. I am now trying to prototype it myself in JavaScript. However, I stumbled across a few ...