Questions tagged [distributed-computing]
The distributed-computing tag has no usage guidance.
5
questions
0
votes
0answers
10 views
How is the parameterised server updated in distributed DQN?
In this paper about Massively Parallel Methods for Deep Reinforcement Learning, the parallelisation of DQN is done via separating the actors and learners. Multiple actors carry out the $\epsilon$ ...
1
vote
0answers
13 views
Do I need to maintain a separate population in each distributed environment when implementing PBT in a MARL context?
I have questions regarding on how to implement PBT as described in Algorithm 1 (on page 5) in the paper, Population Based Training of Neural Networks to train agents in a MARL (multi-agent ...
4
votes
1answer
61 views
Why do we average gradients and not loss in distributed training?
I'm running some distributed trainings in Tensorflow with Horovod. It runs training separately on multiple workers, each of which uses the same weights and does forward pass on unique data. Computed ...
2
votes
1answer
46 views
In how few updates can a multi layer neural net be trained?
A single iteration of gradient descent can be parallelised across many worker nodes. We simple split the training set across the worker nodes, pass the parameters to each worker, each worker computes ...
3
votes
1answer
36 views
Artificial intelligence services at the edge
I am a strategy consultant, deeply interested in edge computing and distributed and decentralized systems.
In performing some analysis on current edge offerings, I am curious as to how ML and AI ...
