Questions tagged [neuroevolution]

For questions related to neuroevolution (or neuro-evolution) techniques, such as NEAT, that are used to evolve (or train) artificial neural networks (that is, they are used evolve their parameters or topology), inspired by the natural evolution. A neuroevolution algorithm is thus an evolutionary algorithm where the genomes (individuals or chromosomes) are artificial neural networks.

Filter by
Sorted by
Tagged with
3
votes
1answer
63 views

What does "unknown search spaces" mean in the context of Evolutionary Algorithms?

In the article Multi-Verse Optimizer: a nature-inspired algorithm for global optimization (DOI 10.1007/s00521-015-1870-7), it's written The results of the real case studies also demonstrate the ...
0
votes
0answers
17 views

Evaluating species stagnation in NEAT

I'm exploring the NEAT algorithm, and among all of my questions on how to optimize my models, I was wondering how should I evaluate the stagnation of species in order to eventually extinct it. ...
1
vote
1answer
51 views

Different ways to produce the same network in NEAT

I have an interesting example for the NEAT and want to clarify what behavior is correct from NEAT's perspective and why (why the opposite is wrong, what are the consequences of choosing the different ...
1
vote
1answer
51 views

In the NEAT algorithm, what is the purpose of treating disjoint and excess genes differently?

In the NEAT algorithm, what is the purpose of treating disjoint and excess genes differently? They are treated so (or may be treated potentially) at least when calculating the distance between 2 ...
1
vote
0answers
39 views

In NEAT, how do node numbers work?

I have read a lot of debates about node ids and such. I'm not 100% sure how it works, but I am assuming the next node added to a network would be the next number in that specific networks list? For ...
2
votes
0answers
43 views

How does the paper implement NEAT without a global set tracking Innovations?

I have been reading this paper on NEAT and trying to implement the algorithm in C#. For the most part, I understand everything in the paper however, there are 2 things I don't understand that confuse ...
0
votes
0answers
28 views

Is NEAT speciation really effective?

I tried implementing NEAT algorithm from scratch, and it successfully solves XOR problem. I followed the original NEAT paper. However, when I run XOR problem solving test and calculate average ...
0
votes
2answers
39 views

How to ensure that the ES-HyperNEAT algorithm generates an ANN in the substrate?

I'm trying to implement the ES-HyperNEAT algorithm using the original paper, as well as the pseudocode provided in the official user page. Occasionally, the algorithm would be unable to generate a ...
2
votes
0answers
17 views

Is there an optimal number of species for NEAT?

Is there an optimal number of species for NEAT? Since too low and too high is bad, I am thinking about adjusting the threshold of the distance function at runtime in order to have the number of ...
0
votes
0answers
17 views

Neuroevolution + RL: How to make sure my policies are more diverse?

I currently implemented Deep Neuroevolution and used it on a couple of Atari games. For my implementation I used a similar Genetic Algorithm, network and setup as the Uber AI Deep Neuroevolution paper ...
1
vote
0answers
85 views

How can I perform the forward pass in a neural network evolved with NEAT, given that some connections may not exist or there may be loopy connections?

I have a problem that arose as part of a NEAT (Neuro Evolution Through Augmenting Topologies) implementation that I am writing. I am wanting it to produce topologies or graphs that describe neural ...
2
votes
1answer
73 views

Evolved networks fail to solve XOR

My implementation of NEAT consistently fails to solve XOR completely. The species converge on different sub-optimal networks which map all input examples but one correctly (most commonly (1,1,0)). Do ...
2
votes
2answers
135 views

Is it possible to perform neuroevolution without a fitness function?

My question is about neuroevolution (genetic algorithm + neural network): I want to create artificial life by evolving agents. But instead of relying on a fitness function, I would like to have the ...
1
vote
1answer
37 views

Choosing an AI method to recreate a given binary 2D image

If the title wan not very clear, I want a method to take an input image like this, [[0, 0, 0, 0], [1, 1, 1, 0], [1, 1, 1, 0], [0, 1, 1, 0]] and output the 2D ...
3
votes
2answers
77 views

How do I determine the genomes to use for crossover in NEAT?

If I have the fitness of each genome, how do I determine which genome will crossover with which, and so on, so that I get a new population? Unfortunately, I can't find anything about it in the ...
2
votes
0answers
201 views

How to select good inputs and fitness function to achive good results with NEAT for Icy Tower bot

I'm trying to make a bot to the famous "Icy Tower" game. I rebuilt the game using pygame and I'm trying to build the bot using Python-NEAT. Every generation a population of 70 characters ...
2
votes
0answers
33 views

Can operations like convolution and pooling be discovered with a neural architecture search approach?

From Neural Architecture Search: A Survey, first published in 2018: Moreover, common search spaces are also based on predefined building blocks, such as different kinds of convolutions and ...
5
votes
1answer
74 views

In NEAT, is it a good idea to give the same ID to node genes created from the same connection gene?

Do I have to prevent nodes created from the same connection gene to have different IDs/innovation number? In this example, the node 6 is created from the connection going from node 3 to node 4: In ...
2
votes
1answer
245 views

Do I have to crossover my node genes in NEAT, and how?

I'm currently trying to code the NEAT algorithm by myself, but I got stuck with two questions. Here they are: What happens if during crossover a node is removed (or disabled) and there's a connection ...
2
votes
1answer
211 views

How to choose the activation function in neuroevolution?

I am developing a NEAT flappy bird game, and it doesn't work, the system stays stupid for 300 generations. I chose tanh() for activation, just because it's included in JS. I can't find a good ...
2
votes
2answers
68 views

Are connections genes in a genome ever deleted or just disabled?

When a new node is added, the previous connection is disabled and not removed. Is there any situation in which a connection gene is removed? For example, in the above diagram connection gene with ...
2
votes
1answer
172 views

What are evolutionary algorithms for topology and weights evolving of ANN (TWEANN) other than NEAT?

I wonder, if there are other than NEAT approaches to evolving architectures and weights of artificial neural networks? To be more specific: I am looking for projects/frameworks/libraries that use ...
1
vote
1answer
72 views

How are weights updated in a genetic algorithm with neural network?

Suppose an AI is to play the game flappy bird. And the fitness function is how long the bird has traveled before the game ends. Would we have multiple neural networks initialized at the beginning ...
1
vote
1answer
93 views

Unable to achieve expected outputs using NEAT for the snake game

I am trying to implement NEAT for the snake game. My game logic is ready, which is working properly and NEAT configured. But even after 100 generations with 200 genomes per generation, the snakes ...
5
votes
1answer
150 views

Why evolutionary training of neural networks is not popular?

Evolutionary algorithms are mentioned in some sources as a method to train a neural network (finding weights, not hyperparameters). However, I have not heard about one practical application of such an ...
4
votes
2answers
341 views

Iteratively and adaptively increasing the network size during training

For an experiment that I'm working on, I want to train a deep network in a special way. I want to initialize and train a small network first, then, in a specific way, I want to increase network depth ...
6
votes
2answers
589 views

Can neuroevolution be combined with gradient descent?

Is there any precedent for using a neuroevolution algorithm, like NEAT, as a way of getting to an initialization of weights for a network that can then be fine-tuned with gradient descent and back-...
2
votes
1answer
476 views

Is there any research work that attempts to combine neuroevolution with deep reinforcement learning?

Neuroevolution can be used to evolve a network's architecture (and weights, of course). Deep reinforcement learning, on the other hand, has been proven to be extremely powerful at optimising the ...
5
votes
3answers
269 views

How is neural architecture search performed?

I have come across something that IBM offers called neural Architecture search. You feed it a data set and it outputs an initial neural Architecture that you can train. How is neural architecture ...
1
vote
0answers
39 views

What are some examples of tasks in which, currently, neuroevolution outperforms gradient-based approaches?

Note: I am NOT asking for general advantages of neuroevolution over standard approaches (e.g.: architecture search, parallelization), I am asking for examples of tasks in which, currently, ...
2
votes
3answers
122 views

What does the formula $1-\sum_i(e_i-a_i)^2$ mean in this NEAT Python API?

I have looked at the documentation for the NEAT Python API found here, where it's written The error for each genome is $1-\sum_i(e_i-a_i)^2$ I have not yet learned calculus, so I can't understand ...
0
votes
0answers
52 views

How do I choose an appropriate fitness function and hyper-parameters to train a 7-DOF arm?

I am trying to train an ANN to control a 7 Degrees-Of-Freedom arm. It should reach a target avoiding a single obstacle. Given my modeling of the situation, my input layer is composed of 12 nodes: 5 ...
5
votes
3answers
328 views

Can neural networks evolve other neural networks?

Can neural networks change or evolve other neural networks? Also, could evolutionary algorithms be applied to evolve neural networks? For example, suppose that we have neural networks A and B. The ...
3
votes
1answer
61 views

How accurate are neuroevolution algorithms in modelling organism evolution?

How accurate are neuro-evolution algorithms (such as NEAT) in modelling real organism evolution?
5
votes
1answer
176 views

Is there a neural network with a varying number of neurons?

Is there some type of neural network that changes the number of neurons while training? Using this idea, the network can increase or decrease the number of neurons when the complexity of the inputs ...
3
votes
1answer
831 views

Why would someone use NEAT over other machine learning algorithms?

Why would someone use a neuroevolution algorithm, such as NEAT, over other machine learning algorithms? What situation would only apply to an algorithm such as NEAT, but no other machine learning ...
2
votes
0answers
39 views

Can neuroevolution be used for solving tasks other than games?

I'm seeing a lot of examples of neuroevolution techniques involving games or robot problems. Can neuroevolution be used for solving tasks other than games? For example, how could you transform a CSV ...
3
votes
1answer
260 views

Can NEAT produce neural networks where inputs are directly connected to outputs?

Can NEAT produce neural networks where inputs are directly (without intermediate hidden neurons) connected to outputs?
7
votes
1answer
3k views

Can neural networks be evolved using NEAT in TensorFlow? [closed]

I am making a machine learning program for time series data analysis, and using NEAT could help the work. I started to learn TensorFlow not long ago, but it seems that the computational graphs in ...
2
votes
1answer
645 views

What is the order of the genetic operations in NEAT?

I was trying to implement NEAT, but I got stuck at the speciating of my clients/genomes. What I got so far is: the distance function implemented, each genome can mutate nodes/connections, two ...
6
votes
1answer
571 views

What if the more fit parent has fewer nodes compared to the other, will the disjoint and excess genes be discarded?

In the paper Efficient Evolution of Neural Network Topologies (2002), the authors say Genes that do not match are inherited from the more fit parent What if the more fit parent has fewer nodes ...
5
votes
1answer
3k views

Several questions regarding the NEAT algorithm [closed]

I've recently read the paper Evolving Neural Networks through Augmenting Topologies which introduces NEAT. I am now trying to prototype it myself in JavaScript. However, I stumbled across a few ...
4
votes
1answer
357 views

Does training happen during NEAT?

When one uses NEAT to evolve the best fitting network for a task, does training take place in each epoch as well? If I understand correctly, training is the adjustment of the weights of the neural ...
3
votes
2answers
1k views

Can mutation enable a disabled connection?

In the add node mutation, the connection between two chosen nodes (e.g. A and B) is first disabled and then a new node is created between A and B with their respective two connections. I guess that ...
5
votes
2answers
1k views

Does NEAT require only connection genes to be marked with a global innovation number?

Does NEAT require only connection genes to be marked with a global innovation number? From the NEAT paper Whenever a new gene appears (through structural mutation), a global innovation number is ...
3
votes
1answer
169 views

In novelty search, are the novel structures or behaviour of the neural network rewarded?

I have been reading a lot lately about some very promising work coming out of Uber's AI Labs using mutation algorithms enhanced with novelty search to evolve deep neural nets. See the paper Safe ...
3
votes
2answers
523 views

How does adjusted fitness penalize large species in NEAT?

I'm learning about NEAT from the paper Evolving Neural Networks through Augmenting Topologies. I'm having trouble understanding how adjusted fitness penalizes large species and prevents them from ...
4
votes
1answer
156 views

How to improve the performance of my model trained with NEAT for a drone to learn how to fly?

I am working on a project in which a drone needs to learn how to fly. I am using NEAT. For the first experiment, I want the drone to learn how to hover inside a $3 \times 3 \times 3$ meters box. My ...
3
votes
1answer
735 views

How to represent the weights of a neural network as binary strings for a genetic algorithm?

I want to train my neural network by evolution, that is I want to recombine the weights of the best performing neural networks in each evolution cycle or generation. My initial instinct was to ...
1
vote
1answer
408 views

Does neuroevolution require a labelled dataset?

A neuroevolution algorithm, such as DXNN, can be used to refine the topology and weights of an artificial neural network (ANN). The GA will require a fitness function, which means you need labeled ...