Questions tagged [training]

For questions about training networks, rules systems, or other AI system components.

Filter by
Sorted by
Tagged with
-8
votes
0answers
31 views

what career skills with the best online Training courses? [closed]

Get Live interactive training in trendinig technologies like salesforce,tableau, aws, data science, workday, Power bi, workday, python
1
vote
0answers
14 views

When training a CNN, what are the hyperparameters to tune first?

I am training a convolutional neural network for object detection. Apart from the learning rate, what are the other hyperparameters that I should tune? And in what order of importance? Besides, I read ...
1
vote
0answers
16 views

Training dataset for convolutional neural network classification - will images captured on the ground be useful for training aerial imagery?

I am an agronomy graduate student looking to classify crops from weeds using convolutional neural networks (CNNs). The basic idea that I am wanting to get into involves separating crops from weeds ...
1
vote
2answers
28 views

How to deal with random weights initialization in hyperparameters tuning?

In the step of tuning my neural networks I often encounter a problem that every time I train the exact same network, it gives me different final error due to random initialization of the weights. ...
1
vote
1answer
44 views

Why does my model overfit on pseudo-random numbers training data?

I am trying to predict pseudo-random numbers using the past numbers with a multiplayer perceptron. The error while training is very low. However, as soon as I test it with a test set, the model ...
0
votes
0answers
16 views

Deduce properties of the loss functions from the training loss curves

I have two convex, smooth loss functions to minimise. During the training (a very simple model) using batch SGD (with tuned optimal learning rate for each loss function), I observe that the (log) loss ...
2
votes
0answers
13 views

Which CNN hyper-parameters are most sensitive to centered versus off centered data?

Which hyper-parameters of a convolutional neural network are likely to be the most sensitive to depending on whether the training (and test and inference) data involves only accurately centered images ...
2
votes
1answer
41 views

How difficult is this sound classification?

I want a microphone to pick up sounds around me (let's say beyond a 3 foot radius), but ignore sounds made at my desk, such as the rustling of paper, clicking a mouse and typing, my hands brushing up ...
0
votes
1answer
30 views

not sure if fine-tuned network is finely-tuned

I am practicing with Resnet50 fine tuning for binary classification task, here is my code snippet. ...
1
vote
0answers
19 views

Is there any app / API which generates meaningful information?

I was wondering if there is any application / API which given a word comes up with legible and meaningful information related to it, and if possible relates it to any recent happenings or development ...
1
vote
1answer
31 views

How to explain peak in training history of a convolutional neural network?

I am training a simple convolutional neural network to recognize two types of 1024-point frequency spectra (FFT). This is the model I'm using: ...
0
votes
0answers
9 views

Automated Annotation of Objects

Given thousands of images, where some of the images contain target objects and others do not, is there an easy way of drawing bounding boxes on these target objects rather than relying on manual ...
4
votes
0answers
49 views

Training and inference for highly-context-sensitive information

What is the best way to train / do inference when the context matters highly as to what the inferred result should be? For example in the image below all people are standing upright, but because of ...
1
vote
0answers
34 views

How can I build a model to approximate the function $f(n) = 2n$?

I made the following HTML nd javascript to predict $f(n) = 2n$. Basically, I am trying to design my first neural network which predicts 2 multiplied by a number. I know we don't need a neural network ...
1
vote
0answers
28 views

Relationship between model complexity (depth) and dataset size

I'm new to deep learning. I was wondering what's the relationship between a deep model complexity (e.g. total number of parameters, or depth) and the dataset size? Assuming I want to do a binary ...
2
votes
1answer
35 views

What would be the implications of mistakenly adding bias after the activation function?

I was looking at the source code for a personal project neural network implementation, and the bias for each node was mistakenly applied after the activation function. The output of each node was ...
1
vote
0answers
45 views

Reinforcement learning for a 2D game involving two players

I'd like to create an AI for a 2D game involving two players fighting against each other. The map look something like this (The map is a NxN array somehow randomly generated): Basically the players ...
1
vote
1answer
39 views

Relationship between training accuracy and validation accuracy

During model training, I noticed various behaviour in between training and validation accuracy. I understand that 'The training set is used to train the model, while the validation set is only used to ...
2
votes
1answer
38 views

How are the inputs passed to the neural network during training for the XOR classification task?

Let's suppose we have to train a neural network for the XOR classification task. Are the inputs $(00, 01, 10, 11)$ inserted in a sequential way? For example, we first insert the 00 and change the ...
2
votes
0answers
43 views

What form of output would be needed to train a model on a connect 4 AI?

I've had a big interest in machine learning for a while, and I've followed along a few tutorials, but have never made my own project. After losing many games of connect 4 with my friends, I decided to ...
1
vote
0answers
22 views

How to change the architecture of my simple sequential model

I'm new to Deep Learning with Keras. With some tutorials online for cat vs non-cat classification, I was able to compile this simple architecture for my own ...
0
votes
0answers
13 views

Model training with colored images instead of grayscale

I'm new to Python and Deep Learning with Keras. With some tutorials online for cat vs non-cat classification, I was able to compile this simple training code for my ...
3
votes
0answers
17 views

How to organize model training hyperparameters

I am working on multiple deep learning projects, most of them in the area of computer vision. For many of them I create multiple models, try different approaches, use various model architectures. And ...
2
votes
1answer
32 views

Semantic issues with predictions made by my trained model

I'm new to Deep Learning. I used Keras and trained a inception_resnet_v2 model for my binary classification application (fire ...
2
votes
2answers
41 views

Training a Deep Learning in an End-to-End manner

Can anyone explain in simple words what training a deep learning framework in an end-to-end manner mean?
1
vote
1answer
73 views

Making a CNN for phoneme classification

I was making a simple phoneme classification model for a 10 week-long class project and I ran into a small question. Is it possible, to create a model that takes a 1-second (the longest phoneme is 0.2 ...
2
votes
3answers
65 views

In adversarial machine learning, how does an attacker have access to the test and training dataset in order to poison it?

In the field of adversarial machine learning, machine learning models are vulnerable to attacks both on the test and training data set. However, how does the attacker get access to these datasets? How ...
4
votes
2answers
90 views

Wouldn't convolutional neural network models work better without flattening the input in any stages?

The above model is what really helped me understand the implementation of convolutional neural networks, so based on that, I've got a tricky hypothesis that I want to find more about, since actually ...
2
votes
1answer
37 views

How exactly does adversarial training help in handling mode-collapse in generative networks?

Of my understanding mode-collapse is when there happen to be multiple classes in the dataset and the generative network converges to only one of these classes and generates images only within this ...
0
votes
0answers
35 views

creating your own dataset similar to cityscapes format

I'm trying to train a neural network with my own dataset. The neural network can accept the cityscape format. Is there any application that can give mask/segmented image, instance image, label IDs ...
3
votes
1answer
34 views

Training network with 4 GPUs performance is not exactly 4 times over one GPU why?

Training neural network with 4 GPUs using pyTorch, performance is not even 2 times (btw 1 & 2 times) compare to using one GPU. From Nvidia-smi we see GPU usage is for few milliseconds and next 5-...
2
votes
1answer
47 views

Generate Image with Artificial intelligence

I am pretty new to Artificial Intelligence programming, however i do understand the basic concept. I have an idea in my mind: Import a JPEG Image, Convert this Image into a 2D Array (x,y values + ...
2
votes
1answer
42 views

REINFORCE algorithm for portfolio optimization - problem while training

I'm trying to implement the Reinforce algorithm (Monte Carlo policy gradient) in order to optimize a portfolio of 94 stocks on a daily basis (I have suitable historical data to achieve this). The idea ...
1
vote
0answers
33 views

Finetuning GPT-2 twice for particular style of writing on a particular topic

Sorry if this is a stupid question. I'm just starting out in ML and am working with gpt-2 for text generation. My situation is that I have to generate text in a particular field for eg. family ...
3
votes
0answers
27 views

How to train a model to extract custom and unknown entities

I'm trying to figure out how to extract specific text from an utterance by a user. I need to extract "unknown" text from a short and simple text. In this case, the user wants to create a list. ...
9
votes
1answer
142 views

Will quantum computing have any kind of effect on the development of AI?

Recently, according to some reports Google achieved something called 'Quantum Supremacy'. Whether its true or not remains to be seen. But my question is does Quantum Computers or the principle they ...
1
vote
0answers
41 views

What is the state of the art AI training technique for imperfect information 2 player turn based games?

As far as I can tell (correct me if I'm wrong), Alphazero (with MCTS and neural network heuristic function RL) is the state of the art training method for turn based, deterministic, perfect ...
6
votes
2answers
68 views

Why do very deep non resnet architectures perform worse compared to shallower ones for the same iteration? Shouldn't they just train slower?

My understanding of the vanishing gradient problem in deep networks is that as backprop progresses through the layers the gradients become small, and thus training progresses slower. I'm having a hard ...
0
votes
0answers
7 views

Fusing label distribution and on-hot encoded labels

A while ago I came across a paper for image classification that utilized both label distribution and one-hot encoded labels to classify images. An image has a label distribution for all classes (4 ...
2
votes
0answers
334 views

How to transfer learn Darknet YOLOv3

I've started getting into object detection in image. I have YOLOv3 neural network with Darknet framework. The network is pre-trained from COCO data set. Now I need to do some transfer learning in ...
3
votes
1answer
48 views

GPU/TPU acceleration for neural networks with various network topologies

I was thinking about different neural network topologies for some applications. However, I am not sure how this would affect the efficiency of hardware acceleration using GPU/TPU/some other chip. If, ...
5
votes
1answer
83 views

Why evolutionary training of neural networks is not popular?

Evolutionary algorithms are mentioned in some sources as possible to be used to train a neural network (finding weights, not hyperparameters), however I have not heard about one practical application ...
0
votes
0answers
28 views

A2C for the game of Hanabi underfits

I am trying to solve the game of Hanabi (paper describing game) with actor-critic algorithm. I took code for the environment from the Deepmind's repository and implemented a2c algorithm myself. From ...
3
votes
1answer
39 views

Reinforcement learning with hints or reference model

In Reinforcement Learning, when I train a model, it comes up with its own set of solutions. For example, if I am training a robot to walk, it will come up with its own walking gait, such as this Deep ...
0
votes
0answers
17 views

Invalid moves in Deep Reinforcement Learning for games [duplicate]

I've been working on a bot for a game involving dice throws and chance. The architecture involved is similar to AlphaZero in the that it has Convolutions and MCTS. According to the current state ...
2
votes
1answer
24 views

Will a .h5 file trained with Xception model work with Resnet50?

I have been running my 2013 server box since 2 weeks ago for training an AI model. I set up 30 epochs to run but since than it only ran 1 epoch as my PC config is super slow. But it generates 1 .h5 ...
0
votes
3answers
100 views

Accuracy too high too fast?

I have a simple text classifier, with the following structure: ...
3
votes
0answers
41 views

When to use RMSE as opposed to MSE and vice versa?

I understand that RMSE is just the square root of MSE. Generally, as far as I have seen, people seem to use MSE as a loss function and RMSE for evaluation purposes, since it exactly gives you the ...
0
votes
0answers
20 views

Training, validation loss and accuracy yolov3?

This is a version of Yolo V3 implemented in PyTorch – YOLOv3 in PyTorch I am trying to use transfer learning to train this yolov3 implementation following the directions given in this post. This is ...
2
votes
2answers
110 views

What are the reasons a perceptron is not able to learn?

I'm just starting to learn about neural networking and I decided to study a simple 3-input perceptron to get started with. I am also only using binary inputs to gain a full understanding of how the ...