Skip to main content

Questions tagged [scalability]

For questions about scalability related to software architectures and methods.

Filter by
Sorted by
Tagged with
0 votes
0 answers

How to Measure the Impact of Adding a Translation Layer to Large Language Models?

I'm currently exploring the integration of a translation layer into Large Language Models (LLMs) to preprocess all inputs into a uniform language (English) before processing by the model. The idea is ...
Ilya Gazman's user avatar
0 votes
0 answers

Why is my super-computer scale PPO not scaling well?

Hi I basically have PPO as implemented in stable-baselines3 and so far it is not scaling well at all which is very concerning. The basic parallelism strategy is very similar to OpenAI five's training ...
profPlum's user avatar
  • 434
0 votes
1 answer

Object Detection: Can I modify this script to support larger images (Scaled YOLOv4)?

I am looking at training the Scaled YOLOv4 on TensorFlow 2.x, as can be found at this link. I plan to collect the imagery, annotate the objects within the image in VOC format, and then use these ...
ihb's user avatar
  • 129
1 vote
0 answers

LSTM - MAPE Loss Function gives Better Results when Data is De-Scaled before Loss Calculation

I am building an LSTM for predicting a price chart. MAPE resulted in the best loss function compared to ...
user134132523's user avatar
1 vote
0 answers

How do you scale your ML problems? [closed]

While I have limited resource usually to train my machine learning models, I often find that my hyperparameter optimization procedure is not necessary using all my GPU and CPU, and that is because the ...
boomkin's user avatar
  • 119
13 votes
1 answer

How would DeepMind's new differentiable neural computer scale?

DeepMind just published a paper about a differentiable neural computer, which basically combines a neural network with a memory. The idea is to teach the neural network to create and recall useful ...
BlindKungFuMaster's user avatar