Questions tagged [training]

For questions about training networks, rules systems, or other AI system components.

Filter by
Sorted by
Tagged with
3
votes
2answers
66 views

How to actually teach the ANN the resulting weights of different training inputs?

I thought I have implemented the code (from scratch, no library) for an artificial neural network (first endeavour in the field). But I feel like I miss something very basic or obvious. To make it ...
2
votes
1answer
54 views

If use the weights from previous iteration of a k-fold cross validation to seed a neural network classifier would I be overfitting?

As is done traditionally, I used k-fold cross validation to select and optimize the hyper parameters of my neural network classifier. When it was time to store the final model for future predictions, ...
3
votes
3answers
408 views

Why should weights of Neural Networks be initialized to random numbers?

Premise Ok, I know that this question was asked before on ai.SE, on stats.SE and also on SO. So I did my homework in checking before posting my question, but none of them has an answer that fully ...
1
vote
0answers
77 views

Object recognition by two or more traits that are orthogonal (informally speaking)

I would really appreciate if someone could comment the following method of training neural nets providing them with some meta data (Making them more color prone only if needed, whereas now they're ...
7
votes
3answers
245 views

Can some one help me understand this paragraph from Nvidia's progressive gan paper?

Furthermore, we observe that mode collapses traditionally plaguing GANs tend to happen very quickly, over the course of a dozen minibatches. Commonly they start when the discriminator overshoots, ...
5
votes
3answers
1k views

TensorFlow batch learning

I used the example at - https://github.com/aymericdamien/TensorFlow-Examples/blob/master/examples/5_DataManagement/tensorflow_dataset_api.py - to create my own classification model. I used different ...
4
votes
2answers
71 views

How long has it taken for autonomous driving cars to be being sold and used on the roads today?

I remember the first time hearing about google trying to make driverless cars. That was YEARS ago! These days, I'm beginning to learn about Neural Nets and other types of ML and I was wondering: ...
3
votes
1answer
70 views

How to design a recommendation system for shift swapping?

I need to design an algorithm such that it handles the request for shift swapping. The algorithm will recommend a list of people who are more likely to swap that shift with the person by analyzing ...
1
vote
1answer
98 views

How to refine K-means clustering on a data set?

I'm working with a data set where the data is stored in a string such as AxByCyA where A, B ...
1
vote
2answers
119 views

Developing an AI to play outdoor games

I was wondering if it is possible to train an AI that can play outdoor games like cricket, badminton etc. I am new to AI, so if this question is dumb please bear it.
1
vote
1answer
51 views

Recommended Modelling Technique for Influencer Marketing Scenario

I have an approximately 90,000 row dataset that has information of social media profiles which has columns for biography, follower count, language spoken, name, username and the label (to identify ...
3
votes
1answer
103 views

Neural Network training beginner question

I have a question about the training sequence regarding Neural Network recognition. Let's say an image has 28*28 pixels, which leads to 784 Input Nodes with various greyscale values and 10 output ...
2
votes
3answers
2k views

What is the best XOR neural network configuration out there in terms of low error?

I'm trying to understand what would be the best neural network for implementing a XOR gate. I'm considering a neural network to be good if it can produce all the expected outcomes with the lowest ...
2
votes
0answers
95 views

Performance Evaluation Metrics used in Training, Validation and Testing

Which specific performance evaluation metrics are used in training, validation and testing and why? I am thinking error metrics (RMSE, MAE, MSE) are used in validation, and testing should use a wide ...
2
votes
0answers
40 views

Shifting training data

I want to create a neural network and train it on some data, however I want to be able to create a new model without retraining it from the start. An example, I have 1000 data points in my training ...
-3
votes
1answer
154 views

How can I train my computer work for me?

I want to train my computer to recognize texts from websites, copy them, insert them somewhere else, and other things like this, but I dont even know where to start my research and what tools should I ...
3
votes
3answers
105 views

Good idea to assign different objects to same class?

Suppose one trains a CNN to determine if something was either a cat/dog or neither (2 classes), would it be a good idea to assign all cats and dogs to one class and everything else to another? Or ...
2
votes
0answers
77 views

Classification Learning - Normalization of time series and live usage

UPDATE: The tables look messed up so i put them on pastebin for better visibility. https://pastebin.com/gDX28uVF I am using Neural Network with different learning types (for example Standard ...
3
votes
1answer
163 views

Does training happen during NEAT?

When one uses NEAT to evolve the best fitting network for a task, does training take place in each epoch as well? If I understand correctly, training is the adjustment of the weights of the neural ...
0
votes
2answers
49 views

A way to give more weight to particular data?

Let us for these purposes say with are working with any feed forward neural network. Let us also say, that we know beforehand that certain portion of our dataset arsignificantly more impactful or ...
2
votes
1answer
372 views

Periodic Pattern in Validation Loss Curve

I am currently trying to solve a regression problem using neural networks. I want to detect movement patterns in images over time (video) and output a continuous value. During the training process I ...
1
vote
0answers
121 views

My network does always predict always the first right class

I trained my model ResNet-50 for UCMerced_LandUse dataset and this my loss graph but I have a problem when I try my first picture ...
2
votes
1answer
54 views

Programming a bandit to optimize donations

I'm developing a multi-armed bandit which learns the best information to display to persuade someone to donate to charity. Suppose I have treatments A, B, C, D (which are each one paragraph of text). ...
1
vote
0answers
217 views

Transfer learning from model trained in a similar dataset

I am currently working on a defect detection algorithm but I only have a few samples of defects.I googled for defect detection datasets and I found this one: http://resources.mpi-inf.mpg.de/...
1
vote
1answer
620 views

How to label edited images after data augmentation

I am new to neural networks, I've only started studying and learning about the subject a year ago, and I just started building my first neural network. The project is a little bit ambitious: A ...
2
votes
0answers
73 views

How would I implement this New Type of NN

CIO NN CIO NN stands for Controller Input Output Nerual Network note due to a typo the "nearon" means "neron" For this we have to redefine the Nearon 2 Inputs 2 Outputs 4 Weights (each input and ...
4
votes
1answer
340 views

How would you encode your input vector/matrix from a sequence of moves in game like tasks to train an AI? e.g. Chess AI?

I've seen data sets for classification / regressions tasks in domains such as credit default detection, object identification in an image, stock price prediction etc. All of these data sets could ...
1
vote
0answers
109 views

Natural language processing with a continuous dependent variable

I have a large number of observations. Each observation contains: dependent variable: a scores ranging from 0 - 100 independent variable: a large article I want to know which words or phrases ...
7
votes
1answer
366 views

Why does 'loss' change depending on the number of epochs chosen?

I am using Keras to train different NN. I would like to know why if I increment the epochs in 1, the result until the new epoch is not the same. I am using shuffle=False, and np.random.seed(2017), and ...
2
votes
2answers
65 views

Identifying if an image contains an object with very small (five image) training data set

Let's suppose I have 5 images, all of which I assure you are of the same item, but from various angles and perhaps different lighting conditions. I now supply you with an additional image, and I want ...
1
vote
1answer
2k views

What fast loss convergence indicates on a CNN?

I'm training two CNNs (AlexNet e GoogLeNet) in two differents DL libraries (Caffe e Tensorflow). The networks was implemented by dev teams of each libraries (here and here) I reduced the original ...
5
votes
5answers
2k views

How does an activation function's derivative measure error rate in a neural network?

A blog post called "Text Classification using Neural Networks" states that the derivative of the output of a sigmoid function is used to measure error rates. What is the rationale for this? I ...
1
vote
0answers
85 views

When do you back-propagate errors through a Neural Network when using TD Lambda

I have a Neural Network that I'm want to use to self-play Connect Four. The neural network receives the board state and is to provide an estimate of the states desirability. I would then, for each ...
3
votes
1answer
127 views

How are LSTM's trained for text generation?

I've seen some articles about text generation using LSTMs (or GRUs) for text generation. Basically it seems you train them by folding them out, and putting a letter in each input. But say you trained ...
-3
votes
1answer
76 views

Neural Net not training biases correctly

This is an XOR neural net I built in Python. When I run it with random weights and keep the biases constant, it trains them perfectly and reaches the global minima, but when i add the biases in so ...
4
votes
1answer
129 views

What approach should I use to detect faces in video game footage?

I have set myself the challenge of detecting the locations of players/bots in videos of a well known first person shooter game (this is for a youtube series I'm planning on doing). I'm not sure which ...
1
vote
1answer
364 views

Dense-Sparse-Dense CNN training

I want to implement DSD: Dense-Sparse-Dense training for deep neural networks by Han et al. In short, the paper suggest the following training scheme to improve the network accuracy: Train as usual ...
9
votes
3answers
598 views

Why initial weights in neural network are randomized?

This might sound silly to someone who has plenty of experience with neural networks but it bothers me... I mean randomizing initial weights might give you better results that would be somewhat closer ...
2
votes
1answer
494 views

Solving Crossword Puzzles

I have to model an AI that should be able to understand clues and find the answer from a specified word database. I came across several papers that solves the problem with training neural networks or ...
2
votes
0answers
44 views

Recommendations on which architecture to use to guess appointment

I'm currently developping an application which allows psychologists to manage their schedule and budget. As a proof of concept, I would like to create an intelligent appointment service. There can be ...
5
votes
2answers
88 views

What defines a good dataset in Deep Learning approach?

Scenario: I am trying to create a dataset with images of choice for different animal classes. I am going to train those images for classification using CNN. Problem: Lets assume I somehow don't have ...
4
votes
2answers
151 views

As a starter: what is the form of training data for image processing

What we are doing in the image processing training. We are storing some form of data which is going to act as the knowledge or experience of the system. In which form can the system store it's ...
3
votes
1answer
105 views

Are there independent evaluations of various major AI platforms?

Has anyone had a chance to tinker with multiple major AI platforms such as TensorFlow, Cognitive Talk, Quill etc... What are the strengths and weaknesses of different AI platforms? Comprehensive ...
6
votes
2answers
153 views

Shortening the development time of a neural network

I am developing an LSTM for sequence tagging. During the development, I do various changes in the system, for example, add new features, change the number of nodes in the hidden layers, etc. After ...
1
vote
1answer
180 views

Markov Model for a Traffic Intersection

I need some help in developing a Markov Model for a crossroads there is no one way road and i am assuming at this time that traffic is only allowed to go straight no turns are allowed. There are 4 ...
2
votes
0answers
101 views

Train, Validation and Test Split for Reporting Accuracy of Neural Model and BOW

I need to report accuracies of my neural model in a conference paper as compared to various baselines. What are the accepted standards for reporting accuracies in a fair manner? Neural Model: To be ...
1
vote
1answer
298 views

What is the order of execution of steps in back propagation algorithm in a neural network?

I am a machine learning newbie. I am trying to understand backpropagation algorithm. I have a training dataset of 60 instances/records. So what is the correct order of the process: Forward pass of ...
2
votes
2answers
235 views

How to generate question answer data set like babi from books

I wanted to train a chat bot for answering questions from books. I am trying to use Dynamic Memory Networks to do so. How can I generate a data set like facebook did in case of babi tasks so that it ...
4
votes
1answer
61 views

What are state-of-the-art ways of using greedy heuristics to initially set the weights of a Deep Q-Network in Reinforcement Learning?

I am interested in the current state-of-the-art ways to use quick, greedy heuristics in order to speed up the learning in a Deep Q-Network in Reinforcement Learning. In classical RL, I initially set ...
5
votes
1answer
154 views

Is it feasible to train a Machine Learning Model (with image inputs) in an average personal computer?

There are lots of examples of machine learning systems that can recognize objects and extract other information from images with very high precision. To train the models of such systems is necessary (...