Questions tagged [training]

For questions about training networks, rules systems, or other AI system components.

Filter by
Sorted by
Tagged with
-1
votes
0answers
28 views

Does CNN Model accuracy increase if I fit it twice

As I train my CNN model I realised that fitting model twice, ie. running again this code ...
1
vote
1answer
30 views

Relationship between training accuracy and validation accuracy

During model training, I noticed various behaviour in between training and validation accuracy. I understand that 'The training set is used to train the model, while the validation set is only used to ...
2
votes
1answer
37 views

How are the inputs passed to the neural network during training for the XOR classification task?

Let's suppose we have to train a neural network for the XOR classification task. Are the inputs $(00, 01, 10, 11)$ inserted in a sequential way? For example, we first insert the 00 and change the ...
2
votes
0answers
43 views

What form of output would be needed to train a model on a connect 4 AI?

I've had a big interest in machine learning for a while, and I've followed along a few tutorials, but have never made my own project. After losing many games of connect 4 with my friends, I decided to ...
1
vote
0answers
22 views

How to change the architecture of my simple sequential model

I'm new to Deep Learning with Keras. With some tutorials online for cat vs non-cat classification, I was able to compile this simple architecture for my own ...
0
votes
0answers
13 views

Model training with colored images instead of grayscale

I'm new to Python and Deep Learning with Keras. With some tutorials online for cat vs non-cat classification, I was able to compile this simple training code for my ...
-2
votes
0answers
75 views

We are trying to analyse female golfer photos. What are the main data points that come up in these images? (I'm a newbie who needs help, friends.)

I would appreciate the indulgence here as this question may not be well formed. Non-technical people have posed a question to me to suss out timing and potential costs. They want to analyze between ...
3
votes
0answers
15 views

How to organize model training hyperparameters

I am working on multiple deep learning projects, most of them in the area of computer vision. For many of them I create multiple models, try different approaches, use various model architectures. And ...
2
votes
1answer
32 views

Semantic issues with predictions made by my trained model

I'm new to Deep Learning. I used Keras and trained a inception_resnet_v2 model for my binary classification application (fire ...
2
votes
2answers
38 views

Training a Deep Learning in an End-to-End manner

Can anyone explain in simple words what training a deep learning framework in an end-to-end manner mean?
1
vote
1answer
66 views

Making a CNN for phoneme classification

I was making a simple phoneme classification model for a 10 week-long class project and I ran into a small question. Is it possible, to create a model that takes a 1-second (the longest phoneme is 0.2 ...
2
votes
3answers
62 views

In adversarial machine learning, how does an attacker have access to the test and training dataset in order to poison it?

In the field of adversarial machine learning, machine learning models are vulnerable to attacks both on the test and training data set. However, how does the attacker get access to these datasets? How ...
3
votes
2answers
71 views

Wouldn't convolutional neural network models work better without flattening the input in any stages?

The above model is what really helped me understand the implementation of convolutional neural networks, so based on that, I've got a tricky hypothesis that I want to find more about, since actually ...
2
votes
1answer
32 views

How exactly does adversarial training help in handling mode-collapse in generative networks?

Of my understanding mode-collapse is when there happen to be multiple classes in the dataset and the generative network converges to only one of these classes and generates images only within this ...
0
votes
0answers
26 views

creating your own dataset similar to cityscapes format

I'm trying to train a neural network with my own dataset. The neural network can accept the cityscape format. Is there any application that can give mask/segmented image, instance image, label IDs ...
3
votes
1answer
34 views

Training network with 4 GPUs performance is not exactly 4 times over one GPU why?

Training neural network with 4 GPUs using pyTorch, performance is not even 2 times (btw 1 & 2 times) compare to using one GPU. From Nvidia-smi we see GPU usage is for few milliseconds and next 5-...
2
votes
1answer
33 views

Generate Image with Artificial intelligence

I am pretty new to Artificial Intelligence programming, however i do understand the basic concept. I have an idea in my mind: Import a JPEG Image, Convert this Image into a 2D Array (x,y values + ...
2
votes
1answer
42 views

REINFORCE algorithm for portfolio optimization - problem while training

I'm trying to implement the Reinforce algorithm (Monte Carlo policy gradient) in order to optimize a portfolio of 94 stocks on a daily basis (I have suitable historical data to achieve this). The idea ...
1
vote
0answers
27 views

Finetuning GPT-2 twice for particular style of writing on a particular topic

Sorry if this is a stupid question. I'm just starting out in ML and am working with gpt-2 for text generation. My situation is that I have to generate text in a particular field for eg. family ...
3
votes
0answers
27 views

How to train a model to extract custom and unknown entities

I'm trying to figure out how to extract specific text from an utterance by a user. I need to extract "unknown" text from a short and simple text. In this case, the user wants to create a list. ...
9
votes
1answer
130 views

Will quantum computing have any kind of effect on the development of AI?

Recently, according to some reports Google achieved something called 'Quantum Supremacy'. Whether its true or not remains to be seen. But my question is does Quantum Computers or the principle they ...
0
votes
0answers
29 views

What is the state of the art AI training technique for imperfect information 2 player turn based games?

As far as I can tell (correct me if I'm wrong), Alphazero (with MCTS and neural network heuristic function RL) is the state of the art training method for turn based, deterministic, perfect ...
6
votes
2answers
65 views

Why do very deep non resnet architectures perform worse compared to shallower ones for the same iteration? Shouldn't they just train slower?

My understanding of the vanishing gradient problem in deep networks is that as backprop progresses through the layers the gradients become small, and thus training progresses slower. I'm having a hard ...
0
votes
0answers
7 views

Fusing label distribution and on-hot encoded labels

A while ago I came across a paper for image classification that utilized both label distribution and one-hot encoded labels to classify images. An image has a label distribution for all classes (4 ...
2
votes
0answers
155 views

How to transfer learn Darknet YOLOv3

I've started getting into object detection in image. I have YOLOv3 neural network with Darknet framework. The network is pre-trained from COCO data set. Now I need to do some transfer learning in ...
3
votes
1answer
48 views

GPU/TPU acceleration for neural networks with various network topologies

I was thinking about different neural network topologies for some applications. However, I am not sure how this would affect the efficiency of hardware acceleration using GPU/TPU/some other chip. If, ...
5
votes
1answer
81 views

Why evolutionary training of neural networks is not popular?

Evolutionary algorithms are mentioned in some sources as possible to be used to train a neural network (finding weights, not hyperparameters), however I have not heard about one practical application ...
0
votes
0answers
24 views

A2C for the game of Hanabi underfits

I am trying to solve the game of Hanabi (paper describing game) with actor-critic algorithm. I took code for the environment from the Deepmind's repository and implemented a2c algorithm myself. From ...
3
votes
1answer
39 views

Reinforcement learning with hints or reference model

In Reinforcement Learning, when I train a model, it comes up with its own set of solutions. For example, if I am training a robot to walk, it will come up with its own walking gait, such as this Deep ...
0
votes
0answers
16 views

Invalid moves in Deep Reinforcement Learning for games [duplicate]

I've been working on a bot for a game involving dice throws and chance. The architecture involved is similar to AlphaZero in the that it has Convolutions and MCTS. According to the current state ...
2
votes
1answer
22 views

Will a .h5 file trained with Xception model work with Resnet50?

I have been running my 2013 server box since 2 weeks ago for training an AI model. I set up 30 epochs to run but since than it only ran 1 epoch as my PC config is super slow. But it generates 1 .h5 ...
0
votes
3answers
96 views

Accuracy too high too fast?

I have a simple text classifier, with the following structure: ...
3
votes
0answers
40 views

When to use RMSE as opposed to MSE and vice versa?

I understand that RMSE is just the square root of MSE. Generally, as far as I have seen, people seem to use MSE as a loss function and RMSE for evaluation purposes, since it exactly gives you the ...
0
votes
0answers
15 views

Training, validation loss and accuracy yolov3?

This is a version of Yolo V3 implemented in PyTorch – YOLOv3 in PyTorch I am trying to use transfer learning to train this yolov3 implementation following the directions given in this post. This is ...
2
votes
2answers
100 views

What are the reasons a perceptron is not able to learn?

I'm just starting to learn about neural networking and I decided to study a simple 3-input perceptron to get started with. I am also only using binary inputs to gain a full understanding of how the ...
0
votes
1answer
53 views

Why do I get a straight line as an output from a neural network?

I am using feedforward neural network for regression and what I get as a result of prediction is a constant value visible on the graph below: Data I use are typical standardised tabular numbers. The ...
5
votes
3answers
55 views

What should we do when we have equal observations with different labels?

Suppose we have a labeled data set with columns $A$, $B$, and $C$ and a binary outcome variable $X$. Suppose we have rows as follows: ...
3
votes
4answers
199 views

What could an oscillating training loss curve represent?

I tried to create a simple model that receives an $80 \times 130$ pixel image. I only had 35 images and 10 test images. I trained this model for a binary classification task. The architecture of the ...
1
vote
1answer
19 views

Train on big dataset (1mil + images)

I am in the process of collecting a huge dataset of Human poses captured images to create a model to classify poses. My question is how will I be able to train on this massive dataset? I have ...
4
votes
2answers
913 views

What is the “thing” which is trained in AI model training

I am a newbie in the fantastic AI world, I have started my learning recently. After a while, my understanding is, we need to feed in tremendous data to train a or many models. Once the training is ...
2
votes
1answer
48 views

What does it mean for AlphaZero's network to be “fully trained”

Reading this blog post about AlphaZero: https://deepmind.com/blog/article/alphazero-shedding-new-light-grand-games-chess-shogi-and-go It uses language such as "the amount of training the network ...
4
votes
2answers
322 views

Iteratively and adaptively increasing the network size during training

For an experiment that I'm working on, I want to train a deep network in a special way. I want to initialize and train a small network first, then, in a specific way, I want to increase network depth ...
1
vote
0answers
11 views

A NN based model of a Cattle for 'Heat Detection'

I am very new to AI/ML but have lot of interest in these. I am trying to understand how this gadget works. So far I have understood that a NN model of the cattle is generated by offline ...
0
votes
0answers
33 views

Not able to properly tune Neural Network via Back Propagation properly

I have a custom code Neural Network(not using keras or any package...Trying to learn the essence of Neural Network from scratch)... Code can be found here I have the per iteration training output(<...
1
vote
0answers
19 views

Train detector : 300 images with 30 objects or 9000 images with one?

so I have this dataset of images of people sitting in a restaurant. I've annotated about 300 images with an average of 30 instances of "person" per image. Now I'm wondering if I should have annotated ...
1
vote
1answer
21 views

Model Performance and Size of Data Set

Suppose we have a data set with $4,000$ labeled examples. The outcome variable is trinary (three possible categorical values). Suppose the accuracy of a given model is "bad" (e.g. less than $50 \%$). ...
1
vote
0answers
29 views

AI for Warcraft 3 Dota

I want to create AI for Dota1. Is it possible to create AI for Warcraft 3? How Open AI works in Dota2? I want to know more about algorithms what are in foundation in Open AI.
1
vote
0answers
20 views

i have trained my model & now trying to predict but unable to do using keras

i have trained my model & now trying to predict but unable to do please help. trying to predict cat or dog stuck in "prediction" ...
2
votes
1answer
37 views

How is a neural network where the majority of inputs are 0 trained?

Take alexnet. Alexnet has 1000 output nodes, each of which classify an image: The problem I have been having with training a neural network of similar proportions, is that it does what any reasonable ...
0
votes
0answers
17 views

Is a Q&A web application content good to be used to train a closed domain chat-bot?

Background I am currently trying to implement Stack Overflow for Teams where I work and this should cover Q & As about various topics from administrative / HR to internal programming questions. ...