Questions tagged [training]

For questions about training networks, rules systems, or other AI system components.

Filter by
Sorted by
Tagged with
0
votes
1answer
65 views

Why do I get a straight line as an output from a neural network?

I am using feedforward neural network for regression and what I get as a result of prediction is a constant value visible on the graph below: Data I use are typical standardised tabular numbers. The ...
5
votes
3answers
57 views

What should we do when we have equal observations with different labels?

Suppose we have a labeled data set with columns $A$, $B$, and $C$ and a binary outcome variable $X$. Suppose we have rows as follows: ...
3
votes
4answers
207 views

What could an oscillating training loss curve represent?

I tried to create a simple model that receives an $80 \times 130$ pixel image. I only had 35 images and 10 test images. I trained this model for a binary classification task. The architecture of the ...
1
vote
1answer
19 views

Train on big dataset (1mil + images)

I am in the process of collecting a huge dataset of Human poses captured images to create a model to classify poses. My question is how will I be able to train on this massive dataset? I have ...
4
votes
2answers
1k views

What is the “thing” which is trained in AI model training

I am a newbie in the fantastic AI world, I have started my learning recently. After a while, my understanding is, we need to feed in tremendous data to train a or many models. Once the training is ...
2
votes
1answer
56 views

What does it mean for AlphaZero's network to be “fully trained”

Reading this blog post about AlphaZero: https://deepmind.com/blog/article/alphazero-shedding-new-light-grand-games-chess-shogi-and-go It uses language such as "the amount of training the network ...
4
votes
2answers
323 views

Iteratively and adaptively increasing the network size during training

For an experiment that I'm working on, I want to train a deep network in a special way. I want to initialize and train a small network first, then, in a specific way, I want to increase network depth ...
1
vote
0answers
14 views

A NN based model of a Cattle for 'Heat Detection'

I am very new to AI/ML but have lot of interest in these. I am trying to understand how this gadget works. So far I have understood that a NN model of the cattle is generated by offline ...
0
votes
0answers
33 views

Not able to properly tune Neural Network via Back Propagation properly

I have a custom code Neural Network(not using keras or any package...Trying to learn the essence of Neural Network from scratch)... Code can be found here I have the per iteration training output(<...
1
vote
0answers
20 views

Train detector : 300 images with 30 objects or 9000 images with one?

so I have this dataset of images of people sitting in a restaurant. I've annotated about 300 images with an average of 30 instances of "person" per image. Now I'm wondering if I should have annotated ...
1
vote
1answer
24 views

Model Performance and Size of Data Set

Suppose we have a data set with $4,000$ labeled examples. The outcome variable is trinary (three possible categorical values). Suppose the accuracy of a given model is "bad" (e.g. less than $50 \%$). ...
1
vote
0answers
35 views

AI for Warcraft 3 Dota

I want to create AI for Dota1. Is it possible to create AI for Warcraft 3? How Open AI works in Dota2? I want to know more about algorithms what are in foundation in Open AI.
1
vote
0answers
22 views

i have trained my model & now trying to predict but unable to do using keras

i have trained my model & now trying to predict but unable to do please help. trying to predict cat or dog stuck in "prediction" ...
2
votes
1answer
38 views

How is a neural network where the majority of inputs are 0 trained?

Take alexnet. Alexnet has 1000 output nodes, each of which classify an image: The problem I have been having with training a neural network of similar proportions, is that it does what any reasonable ...
0
votes
0answers
17 views

Is a Q&A web application content good to be used to train a closed domain chat-bot?

Background I am currently trying to implement Stack Overflow for Teams where I work and this should cover Q & As about various topics from administrative / HR to internal programming questions. ...
3
votes
0answers
100 views

How can I incrementally train a Yolo model without catastrophic forgetting?

I have successfully trained a Yolo model to recognize k classes. Now I want to train by adding k+1 class to the pre-trained weights (k classes) without forgetting previous k classes. Ideally, I want ...
0
votes
0answers
34 views

What to look for when CNN returns same prediction for every input?

I am trying to use a CNN to do a regression prediction on some statistical data. The data is time-series data formatted into a 2-D grid. The network I'm using looks like this: ...
1
vote
0answers
12 views

Binary annotations on large, heterogenous images

I'm working on a deep learning project and have encountered a problem. The images that I'm using are very large and extremely detailed. They also contain a huge amount of necessary visual information, ...
3
votes
1answer
41 views

Decreasing Loss, Constant Accuracy

Problem Statement I've built a classifier to classify a dataset consisting of n samples and four classes of data. To this end, I've used pretrained VGG-19, pretrained Alexnet and even lenet (with ...
0
votes
2answers
38 views

Ideal score of a model on training and cross validation data

The question is little bit broad, but I could not find any concrete explanation anywhere, hence decided to ask the experts here. I have trained a classifier model for binary classification task. Now ...
2
votes
1answer
53 views

Leave One Out Testing

I am currently working with a small dataset of 20x300. Since I have so few datapoints, I was wondering if I could use an approach similar to leave-one-out cross-validation but for testing. Here's ...
0
votes
0answers
61 views

Can't create datasets and load images in COCO annotator

I'm trying to annotate images with COCO key points for pose estimation using https://github.com/jsbroks/coco-annotator. As described in the Installation section I cloned the repo. I installed Docker ...
1
vote
2answers
69 views

Divide classes into truncated and non-truncated objects

At the moment I am working on a vehicle counting & classification project. For a specific part in the project I need to get back only the completely visible vehicles from my input data (images). ...
1
vote
2answers
81 views

Drone training, how to train without training data?

I setupped a small drone simulator using PhysX, the time step is at 200 hz, while motors update like regular ESCs (at 50 Hz). I computed the inertia matrix, tweaked a bit mass of components to be real,...
2
votes
0answers
38 views

Difference between retraining on different portions of data and training initially on larger data set

I have a large data set that doesn't fit in memory and would have to use something like Keras's model.fit_generator if I would like to train the model on all of the ...
2
votes
1answer
29 views

Adding input features - is complete re-training required?

I've never worked with very large models that require weeks or months of training, but in such a situation, what happens if you want to add extra features inputs, do you need to re-train the entire ...
4
votes
2answers
498 views

Use Machine Learning/Artificial Intelligence to predict next number (n+1) in a given sequence of random increasing integers

The AI must predict the next number in a given sequence of incremental integers (with no obvious pattern) using Python but so far I don't get the intended result! I tried changing the learning rate ...
0
votes
0answers
19 views

Benefits in using multiple LSTM layers?

I am working on a time series forecasting problem and I am in the process of choosing the optimum network structure. Currently I have a 200 cell LSTM layer fully connected to 100 neurons in an ...
2
votes
1answer
21 views

Is it mostly the case to train with available models

I quite often find projects using pre-trained model and using them as a starting point for their new model that learns something novel from thier dataset or on-live learning process - e.g. using a ...
2
votes
1answer
31 views

how to benefit from previous training weights in training again to increase accuracy?

I have trained a modified VGG classification CNN, with random initialized weights; therefor the validation accuracy was not high enough for me to accept (around 66%). now using the weights resulted ...
3
votes
1answer
246 views

Why are not validation accuracy and loss as smooth as train accuracy and loss?

I am training a modified VGG16 network for classification (adding 0.5 dropout after each of the last FC layers). In the following plot I am training for a small number of epochs as an example, and it ...
0
votes
1answer
35 views

CNN output generally has more than one category in one-hot categorization?

I'm a bit of a CNN newbie, and I'm trying to train one to image classify pictures of pretty similar looking particles. I'm making the inputs and labels by hand from a set of 48x48 grayscale images, ...
2
votes
1answer
77 views

Can I calculate the training performance of GPUs by comparing their specification?

I am currently using Nvidia GTX1050 with 640 CUDA cores and 2GB GDDR5 for Deep Neural Network training. I want to buy a new GPU for training, but I am not sure how much performance improvement I can ...
0
votes
1answer
24 views

Why is a Nvidia Single Board computer less than ideal for AI model training?

Conventional NVIDIA GPUs, such as the Titan and or GT1080, are used to train AI models. Why would a Jetson Nano board be less than ideal as a substitute for a conventional GPU? CONTEXT I would like ...
2
votes
0answers
28 views

What methods are there to generate artificial training examples based on existing training examples?

I have a small dataset (117 training examples) and many features (4005). Each of the training examples is binary labeled (healthy / diseased). Each feature represents the connectivity between two ...
1
vote
1answer
21 views

What is the goal of the model and is the training data relevant to that?

The model that we develop in artificial intelligence.What is its purpose,and what training data is relevant to it.
2
votes
2answers
74 views

Export trained AI/ML model

From what I know, AI/ML uses a large amount of data to train an algorithm to solve problems. But since it’s an algorithm, I was wondering if it's possible to export it. If I trained an AI with R, ...
1
vote
0answers
31 views

Why validation performance is unstable for my LSTM based model (labelling problems)?

I have trained a recurrent neural network based on 1 stack of LSTM cells. I use it to solve a classification problem. The RNN cell has 48 hidden states. The output of the last unfolded LSTM cell is ...
1
vote
0answers
178 views

KnnBasic vs KnnWithMeans

I'm learning a bit about the use of the Surprise library and I have a set of data with users and ratings. I'm training a network with this library, using KNNBasic and KNNWithMeans, this last algorithm ...
0
votes
0answers
16 views

Consecutive frames can be discarded when training an SSD/YOLO?

Let's say I have a number of videos, and I want to train an SSD/YOLO (or FRCNN) to detect objects. In the case of a large amount of videos, there will be a lot of frames extracted and transferred to ...
0
votes
0answers
36 views

Is there a RNN that can predict the next substitute in a floorball match?

Floorball is a type of floor hockey. During the game, substitutions can be made. The team is also allowed to change players any time in the game; usually, they change the whole team. Individual ...
3
votes
0answers
50 views

How to train CNN such it eliminate dependent features and focuses on independent ones?

How we should train a CNN model when training dataset contains only limited number of cases, and the trained model is supposed to predict class (label) for several other cases, which has not seen ...
0
votes
1answer
27 views

How to shape the weights or nodes during gradient training of neural network? Training with constraints?

Gradient training changes indiscriminately all the weights and nodes of the neural network. But one can imagine the situations when the training should be shaped, e.g.: One can put constraints on ...
1
vote
1answer
29 views

Neural network with logical hidden layer - how to train it? Is it policy gradient problem? Chaining NNs?

I am doing neural machine translation task from language S to language T via interlingua L. So - there is the structure: ...
2
votes
1answer
248 views

Training an AI to recognize my voice (or any voice)

I want to start a project for my artificial intelligence class about speaker recognition. Basically, I want to train my AI to detect if it's me who's speaking or somebody else. I would like some ...
1
vote
0answers
18 views

Genetic algorithm generation of fuzzy rules with artificial network adjustment of fuzzy probabilities

Are there any working AI system designs or theory to support a system where an artificial network is trained to to adjust fuzzy probabilities and modify the parameters of a genetic algorithm that ...
2
votes
3answers
112 views

Extracting algebraic constraints from the input data

I would appreciate your help with this (naive) question of mine. Given the set of points located on a circle, $x_{i}, y_{i}$ as the input data, Can a deep/machine learning algorithm infer that radius ...
0
votes
1answer
204 views

Can gradient descent training be used for nonsmooth loss functions?

I have non-smooth loss function - e.g. loss(x)=min(x, 0.5). Can gradient descent be used for training neural networks with such functions. Can gradient descent be used for fairly general, ...
3
votes
2answers
128 views

How do biological neurons weights get initialized?

When trying to map artificial neuronal models to biological facts it was not possible to find an answer regarding the biological justification of randomly initializing the weights. Perhaps this is ...
1
vote
2answers
196 views

Would AI not obsessed with winning be better citizens of the world?

Some early AI research, inspired by Claude Shannon's maze learning mouse, Theseus, sought to discover resolutions to conflict. In the case of Theseus, the goal was to resolve the conflict between the ...