Episode #125 of the Stack Overflow podcast is here. We talk Tilde Club and mechanical keyboards. Listen now

Questions tagged [training]

For questions about training networks, rules systems, or other AI system components.

Filter by
Sorted by
Tagged with
2
votes
1answer
66 views

Can I calculate the training performance of GPUs by comparing their specification?

I am currently using Nvidia GTX1050 with 640 CUDA cores and 2GB GDDR5 for Deep Neural Network training. I want to buy a new GPU for training, but I am not sure how much performance improvement I can ...
0
votes
1answer
24 views

Why is a Nvidia Single Board computer less than ideal for AI model training?

Conventional NVIDIA GPUs, such as the Titan and or GT1080, are used to train AI models. Why would a Jetson Nano board be less than ideal as a substitute for a conventional GPU? CONTEXT I would like ...
2
votes
0answers
28 views

What methods are there to generate artificial training examples based on existing training examples?

I have a small dataset (117 training examples) and many features (4005). Each of the training examples is binary labeled (healthy / diseased). Each feature represents the connectivity between two ...
1
vote
1answer
21 views

What is the goal of the model and is the training data relevant to that?

The model that we develop in artificial intelligence.What is its purpose,and what training data is relevant to it.
2
votes
2answers
53 views

Export trained AI/ML model

From what I know, AI/ML uses a large amount of data to train an algorithm to solve problems. But since it’s an algorithm, I was wondering if it's possible to export it. If I trained an AI with R, ...
1
vote
0answers
24 views

Why validation performance is unstable for my LSTM based model (labelling problems)?

I have trained a recurrent neural network based on 1 stack of LSTM cells. I use it to solve a classification problem. The RNN cell has 48 hidden states. The output of the last unfolded LSTM cell is ...
1
vote
0answers
118 views

KnnBasic vs KnnWithMeans

I'm learning a bit about the use of the Surprise library and I have a set of data with users and ratings. I'm training a network with this library, using KNNBasic and KNNWithMeans, this last algorithm ...
0
votes
0answers
15 views

Consecutive frames can be discarded when training an SSD/YOLO?

Let's say I have a number of videos, and I want to train an SSD/YOLO (or FRCNN) to detect objects. In the case of a large amount of videos, there will be a lot of frames extracted and transferred to ...
0
votes
0answers
36 views

Is there a RNN that can predict the next substitute in a floorball match?

Floorball is a type of floor hockey. During the game, substitutions can be made. The team is also allowed to change players any time in the game; usually, they change the whole team. Individual ...
3
votes
0answers
48 views

How to train CNN such it eliminate dependent features and focuses on independent ones?

How we should train a CNN model when training dataset contains only limited number of cases, and the trained model is supposed to predict class (label) for several other cases, which has not seen ...
0
votes
1answer
24 views

How to shape the weights or nodes during gradient training of neural network? Training with constraints?

Gradient training changes indiscriminately all the weights and nodes of the neural network. But one can imagine the situations when the training should be shaped, e.g.: One can put constraints on ...
1
vote
1answer
29 views

Neural network with logical hidden layer - how to train it? Is it policy gradient problem? Chaining NNs?

I am doing neural machine translation task from language S to language T via interlingua L. So - there is the structure: ...
1
vote
1answer
193 views

Training an AI to recognize my voice (or any voice)

I want to start a project for my artificial intelligence class about speaker recognition. Basically, I want to train my AI to detect if it's me who's speaking or somebody else. I would like some ...
1
vote
0answers
18 views

Genetic algorithm generation of fuzzy rules with artificial network adjustment of fuzzy probabilities

Are there any working AI system designs or theory to support a system where an artificial network is trained to to adjust fuzzy probabilities and modify the parameters of a genetic algorithm that ...
2
votes
3answers
107 views

Extracting algebraic constraints from the input data

I would appreciate your help with this (naive) question of mine. Given the set of points located on a circle, $x_{i}, y_{i}$ as the input data, Can a deep/machine learning algorithm infer that radius ...
0
votes
1answer
131 views

Can gradient descent training be used for nonsmooth loss functions?

I have non-smooth loss function - e.g. loss(x)=min(x, 0.5). Can gradient descent be used for training neural networks with such functions. Can gradient descent be used for fairly general, ...
3
votes
2answers
117 views

How do biological neurons weights get initialized?

When trying to map artificial neuronal models to biological facts it was not possible to find an answer regarding the biological justification of randomly initializing the weights. Perhaps this is ...
2
votes
2answers
183 views

Would AI not obsessed with winning be better citizens of the world?

Some early AI research, inspired by Claude Shannon's maze learning mouse, Theseus, sought to discover resolutions to conflict. In the case of Theseus, the goal was to resolve the conflict between the ...
1
vote
0answers
17 views

Change parameter in Karaboga's code of ABC algorithm

I'm working on a problem and need to use Karaboga's code of the ABC algorithm but I have some questions... Does this formula for calculating a parameter have to be changed: ...
1
vote
0answers
38 views

Exploration rate decay and training in Q learning

I'm trying to replicate the results of the DeepMind's paper with Breakout included in OpenAI Gym. I wonder how much frames should I keep until I reach the fixed exploration rate. Actually it reaches ...
1
vote
1answer
24 views

Training by one batch of examples, what does it mean

Say I have a batch of examples, each examples represent a state: ...
1
vote
1answer
245 views

DQN Breakout adding an extra negative reward to help training?

I'm trying to train a DQN, so I'm using OpenAI gym and Breakout (Breakout-v0). I have altered the reward supplied by the environment: If the episode is not completed fully, the agent gets a -10 ...
2
votes
0answers
63 views

Regarding L0 sparsification of DNNs proposed by Louizos, Kingma and Welling

I am reading the paper on $\ell_0$ regularization of DNNs by Louizos, Welling and Kingma (2017) (Link to arxiv). In Section 2.1 the authors define the cost function as follows: $$ \mathcal{R}\left( \...
0
votes
1answer
57 views

Doubts at basic step of learning problem

Question: Express each of the following tasks in the framework of learning from data by specifying the input space X, output space Y, target function f:X->Y and the specifics of the data set that we ...
1
vote
0answers
36 views

Train a recurrent neural network by concatenating time series. Is it safe?

As the title says, I want to train a Jordan network (i.e. a particular kind of recurrent neural network) using a certain number of time series. Let's say that $x_1, x_2, \ldots x_N$ are $N$ input ...
0
votes
1answer
40 views

Are artificial intelligence learnings or trainings transferable from one agent to the other?

One disadvantage or weakness of Artificial Intelligence today the slow nature of learning or training success. For instance, an AI agent might require a 100,000 samples or more to reach an appreciable ...
6
votes
1answer
123 views

How do I predict if it is rainy or not?

I'm building a weather station, where I'm sensing temperature, humidity, air pressure, brightness, $CO_2$, but I don't have a raindrop sensor. Is it possible to create an AI which can say if it's ...
0
votes
1answer
239 views

How to add external training in chatterbot?

I created a very simple bot to learn how to use chatterbot. This library already comes with a training, but I wanted extra training with an import of a corpus in Portuguese that I found in github. <...
0
votes
1answer
171 views

How should one standardize input when transfer learning

Assume one is using transfer learning via a model which was trained on imagenet. Assume that the pre-processing which was used to achieve the pretrained model contained z-score standardization ...
1
vote
1answer
108 views

How to perform PCA in the validation/test set?

I was using PCA in my whole dataset (and after split to training, validation and test), but after some researchs I found out that is wrong way to do. Then I have few questions: -Are there some ...
1
vote
1answer
23 views

Time-management while training network : need advices

I'm not sure this question is in the right Stack Exchange website, but I thought this place is a good starting point, because of the experience of users. This question is not about artificial ...
2
votes
1answer
44 views

Influence of location on a Neural Network trained for parking detection occupancy

I loaded a neural network model trained with Caffe by other people in OpenCV. The model should detect the presence of a car in a single parking spot outputting the probability of it being free/...
6
votes
2answers
2k views

Why L1/L2 regularization technique did not improve my accuracy?

I am training a Multilayer Neural Nets with 146 samples (97 for training set, 20 for validation set and 29 for testing set). I am using: automatic differentiation, SGD method, fixed learning rate + ...
4
votes
4answers
3k views

How do I choose the optimal batch size?

Batch size is a term used in machine learning and refers to the number of training examples utilised in one iteration. The batch size can be one of three options: batch mode: where the batch ...
6
votes
1answer
93 views

Q-Learning the generic maze solution

After doing some exercices on Q-learning for maze solving, I wondered : my q-learning algorithms solve only ONE maze. The AI doesn't learn how to solve mazes, so how can I achieve it ? For instance ...
1
vote
1answer
98 views

Is 1mb an acceptable memory size for images being trained in a CNN?

I am using Tensorflow CNN to build an image classification/prediction model. Currently all the images in the dataset are each about 1mb in size. Most examples out there use very small images. The ...
3
votes
3answers
375 views

What is the name of an AI system that learns by trial and error?

Imagine a system that controls dampers in a complex vent system that has an objective to perfectly equalize the output from each vent. The system has sensors for damper position, flow at various ...
2
votes
1answer
30 views

What is the AI discipline where an algorithm learns from an initial training set, but then refines its learning as it uses that training?

Imagine a system that is trained to manipulate dampers to manage air flow. The training data includes damper state and flow characteristics through a complex system of ducts. The system is then given ...
0
votes
1answer
374 views

Add training data to YOLO post-training

(Cross-posting here from the data science stack exchange, as my question didn't get any replies. I hope it's okay!) I've been playing around with YOLOv3 and obtaining some good results on the ~20 ...
1
vote
0answers
19 views

Adding voices to voice synthesis corpuses

If one uses one of the open source implementations of the WaveNet generative speech synthesis design, such as https://r9y9.github.io/wavenet_vocoder/, and trains using something like the CMU's arctic ...
2
votes
1answer
145 views

How to implement an artificial network that outputs an integer within a range?

The goal is to implement an artificial network that, based on training samples labelled with positive integers, outputs a positive integer. Perhaps I am not searching for the correct thing but all ...
0
votes
3answers
84 views

Is there a way of pre-determining whether a CNN model will perform better than another?

I developed a CNN for image analysis. I've around 100K labeled images. I'm getting a accuracy around 85% and a validation accuracy around 82%, so it looks like the model generalize better than ...
3
votes
1answer
91 views

Use cross-validation to train after model selection

I have been recently reading about model selection algorithms (for example to decide which value of the regularisation parameter or what size of a neural network to use, broadly hyper-parameters). ...
5
votes
1answer
307 views

What happens to the training data after your machine learning model has been trained?

I am completely new to all this, for the life of me I can't find the answer to this question anywhere on Google. What happens after you have used machine learning to train your model? What happens to ...
6
votes
3answers
276 views

AI composing music

Do you know what AI model would be best for let it learn composing music? I really don't know where to start there. Are there some good papers out there? I would say, if I use a NN, my only option ...
6
votes
2answers
128 views

Evolving network in game

So I wrote simple feed forward neural network that plays tic-tac-toe: 9 neurons in input layers: 1 - my sign, -1 - opponent's sign, 0 - empty; 9 neurons in hidden layer: value calculated using Relu; ...
4
votes
1answer
44 views

How to compare the training performance of a model on different data input?

So I have a deep learning model and three data sets (images). My theory is that one of these data sets should function better when it comes to training a deep learning model (meaning that the model ...
2
votes
1answer
35 views

How do I compute log-likelihood for training set in supervised learning?

I am building a supervised learning model and I wish to compute the log-likelihood for the training set at the point of the minimum validation error. Initially, I was computing the sum of all the ...
1
vote
0answers
63 views

Sentence classification and named identity detection with automatic retraining

I am learning AI and trying out my first real life AI application. What I am trying to do is taking as an input various sentences, and then classifying the sentences into one of X number of categories ...
1
vote
0answers
35 views

What methods are there to detect discrimination in trained models?

I've been researching AI regulation and compliance (see my related question on law.stackexchange), and one of the big take-aways that I had is that the regulations that apply to a human will apply to ...