A message from our CEO about the future of Stack Overflow and Stack Exchange. Read now.

Questions tagged [training]

For questions about training networks, rules systems, or other AI system components.

Filter by
Sorted by
Tagged with
1
vote
0answers
8 views

Feeding a neural network with single slices of a 3D matrix

I'm working on a neural network wich "slices" a 1080p image in many layers. It takes a 1080p image as an input and produces a 1080*1920*n matrix: basically I add a z value to each pixel rapresenting ...
1
vote
0answers
9 views

What are evolutionary algorithms for topology and weights evolving of ANN (TWEANN) other than NEAT?

I wonder if there are other than NEAT approaches to evolving architectures and weights of artificial neural networks? To be more specific I am looking for projects/frameworks/libraries that use ...
-9
votes
0answers
34 views

what career skills with the best online Training courses? [closed]

Get Live interactive training in trendinig technologies like salesforce,tableau, aws, data science, workday, Power bi, workday, python
6
votes
3answers
137 views

Why do neural networks trained on identical datasets and with identical hyper-parameters have different performances?

I found that fully connected neural networks trained on identical data sets with identical hyper-parameters can have different performances or accuracies (7-8% of deviation). Is this an unusual ...
1
vote
0answers
14 views

When training a CNN, what are the hyperparameters to tune first?

I am training a convolutional neural network for object detection. Apart from the learning rate, what are the other hyperparameters that I should tune? And in what order of importance? Besides, I read ...
1
vote
0answers
16 views

Training dataset for convolutional neural network classification - will images captured on the ground be useful for training aerial imagery?

I am an agronomy graduate student looking to classify crops from weeds using convolutional neural networks (CNNs). The basic idea that I am wanting to get into involves separating crops from weeds ...
1
vote
2answers
28 views

How to deal with random weights initialization in hyperparameters tuning?

In the step of tuning my neural networks I often encounter a problem that every time I train the exact same network, it gives me different final error due to random initialization of the weights. ...
1
vote
1answer
44 views

Why does my model overfit on pseudo-random numbers training data?

I am trying to predict pseudo-random numbers using the past numbers with a multiplayer perceptron. The error while training is very low. However, as soon as I test it with a test set, the model ...
0
votes
0answers
16 views

Deduce properties of the loss functions from the training loss curves

I have two convex, smooth loss functions to minimise. During the training (a very simple model) using batch SGD (with tuned optimal learning rate for each loss function), I observe that the (log) loss ...
2
votes
1answer
41 views

How difficult is this sound classification?

I want a microphone to pick up sounds around me (let's say beyond a 3 foot radius), but ignore sounds made at my desk, such as the rustling of paper, clicking a mouse and typing, my hands brushing up ...
2
votes
0answers
13 views

Which CNN hyper-parameters are most sensitive to centered versus off centered data?

Which hyper-parameters of a convolutional neural network are likely to be the most sensitive to depending on whether the training (and test and inference) data involves only accurately centered images ...
0
votes
1answer
30 views

not sure if fine-tuned network is finely-tuned

I am practicing with Resnet50 fine tuning for binary classification task, here is my code snippet. ...
0
votes
1answer
441 views

Add training data to YOLO post-training

(Cross-posting here from the data science stack exchange, as my question didn't get any replies. I hope it's okay!) I've been playing around with YOLOv3 and obtaining some good results on the ~20 ...
0
votes
1answer
218 views

How should one standardize input when transfer learning

Assume one is using transfer learning via a model which was trained on imagenet. Assume that the pre-processing which was used to achieve the pretrained model contained z-score standardization ...
1
vote
0answers
19 views

Is there any app / API which generates meaningful information?

I was wondering if there is any application / API which given a word comes up with legible and meaningful information related to it, and if possible relates it to any recent happenings or development ...
1
vote
1answer
31 views

How to explain peak in training history of a convolutional neural network?

I am training a simple convolutional neural network to recognize two types of 1024-point frequency spectra (FFT). This is the model I'm using: ...
3
votes
1answer
404 views

Periodic Pattern in Validation Loss Curve

I am currently trying to solve a regression problem using neural networks. I want to detect movement patterns in images over time (video) and output a continuous value. During the training process I ...
4
votes
0answers
49 views

Training and inference for highly-context-sensitive information

What is the best way to train / do inference when the context matters highly as to what the inferred result should be? For example in the image below all people are standing upright, but because of ...
0
votes
0answers
9 views

Automated Annotation of Objects

Given thousands of images, where some of the images contain target objects and others do not, is there an easy way of drawing bounding boxes on these target objects rather than relying on manual ...
1
vote
0answers
34 views

How can I build a model to approximate the function $f(n) = 2n$?

I made the following HTML nd javascript to predict $f(n) = 2n$. Basically, I am trying to design my first neural network which predicts 2 multiplied by a number. I know we don't need a neural network ...
1
vote
0answers
28 views

Relationship between model complexity (depth) and dataset size

I'm new to deep learning. I was wondering what's the relationship between a deep model complexity (e.g. total number of parameters, or depth) and the dataset size? Assuming I want to do a binary ...
2
votes
1answer
35 views

What would be the implications of mistakenly adding bias after the activation function?

I was looking at the source code for a personal project neural network implementation, and the bias for each node was mistakenly applied after the activation function. The output of each node was ...
1
vote
0answers
45 views

Reinforcement learning for a 2D game involving two players

I'd like to create an AI for a 2D game involving two players fighting against each other. The map look something like this (The map is a NxN array somehow randomly generated): Basically the players ...
1
vote
1answer
41 views

Relationship between training accuracy and validation accuracy

During model training, I noticed various behaviour in between training and validation accuracy. I understand that 'The training set is used to train the model, while the validation set is only used to ...
2
votes
1answer
38 views

How are the inputs passed to the neural network during training for the XOR classification task?

Let's suppose we have to train a neural network for the XOR classification task. Are the inputs $(00, 01, 10, 11)$ inserted in a sequential way? For example, we first insert the 00 and change the ...
2
votes
0answers
43 views

What form of output would be needed to train a model on a connect 4 AI?

I've had a big interest in machine learning for a while, and I've followed along a few tutorials, but have never made my own project. After losing many games of connect 4 with my friends, I decided to ...
6
votes
2answers
68 views

Why do very deep non resnet architectures perform worse compared to shallower ones for the same iteration? Shouldn't they just train slower?

My understanding of the vanishing gradient problem in deep networks is that as backprop progresses through the layers the gradients become small, and thus training progresses slower. I'm having a hard ...
1
vote
0answers
22 views

How to change the architecture of my simple sequential model

I'm new to Deep Learning with Keras. With some tutorials online for cat vs non-cat classification, I was able to compile this simple architecture for my own ...
0
votes
2answers
39 views

Ideal score of a model on training and cross validation data

The question is little bit broad, but I could not find any concrete explanation anywhere, hence decided to ask the experts here. I have trained a classifier model for binary classification task. Now ...
0
votes
0answers
13 views

Model training with colored images instead of grayscale

I'm new to Python and Deep Learning with Keras. With some tutorials online for cat vs non-cat classification, I was able to compile this simple training code for my ...
2
votes
1answer
42 views

REINFORCE algorithm for portfolio optimization - problem while training

I'm trying to implement the Reinforce algorithm (Monte Carlo policy gradient) in order to optimize a portfolio of 94 stocks on a daily basis (I have suitable historical data to achieve this). The idea ...
3
votes
0answers
17 views

How to organize model training hyperparameters

I am working on multiple deep learning projects, most of them in the area of computer vision. For many of them I create multiple models, try different approaches, use various model architectures. And ...
9
votes
1answer
142 views

Will quantum computing have any kind of effect on the development of AI?

Recently, according to some reports Google achieved something called 'Quantum Supremacy'. Whether its true or not remains to be seen. But my question is does Quantum Computers or the principle they ...
2
votes
1answer
32 views

Semantic issues with predictions made by my trained model

I'm new to Deep Learning. I used Keras and trained a inception_resnet_v2 model for my binary classification application (fire ...
2
votes
2answers
41 views

Training a Deep Learning in an End-to-End manner

Can anyone explain in simple words what training a deep learning framework in an end-to-end manner mean?
1
vote
1answer
74 views

Making a CNN for phoneme classification

I was making a simple phoneme classification model for a 10 week-long class project and I ran into a small question. Is it possible, to create a model that takes a 1-second (the longest phoneme is 0.2 ...
2
votes
3answers
65 views

In adversarial machine learning, how does an attacker have access to the test and training dataset in order to poison it?

In the field of adversarial machine learning, machine learning models are vulnerable to attacks both on the test and training data set. However, how does the attacker get access to these datasets? How ...
2
votes
1answer
37 views

How exactly does adversarial training help in handling mode-collapse in generative networks?

Of my understanding mode-collapse is when there happen to be multiple classes in the dataset and the generative network converges to only one of these classes and generates images only within this ...
3
votes
1answer
39 views

Reinforcement learning with hints or reference model

In Reinforcement Learning, when I train a model, it comes up with its own set of solutions. For example, if I am training a robot to walk, it will come up with its own walking gait, such as this Deep ...
4
votes
2answers
93 views

Wouldn't convolutional neural network models work better without flattening the input in any stages?

The above model is what really helped me understand the implementation of convolutional neural networks, so based on that, I've got a tricky hypothesis that I want to find more about, since actually ...
0
votes
0answers
36 views

creating your own dataset similar to cityscapes format

I'm trying to train a neural network with my own dataset. The neural network can accept the cityscape format. Is there any application that can give mask/segmented image, instance image, label IDs ...
3
votes
1answer
81 views

What beginner-friendly machine learning method should I use to make teams for my pickup ultimate frisbee club fairly balanced?

A bunch of friends and I play ultimate every week. Recently I wrote a program to choose our teams for us, as well as keep track of certain data (like which players were on which team, which team won, ...
3
votes
1answer
75 views

How to design a recommendation system for shift swapping?

I need to design an algorithm such that it handles the request for shift swapping. The algorithm will recommend a list of people who are more likely to swap that shift with the person by analyzing ...
9
votes
3answers
278 views

Can some one help me understand this paragraph from Nvidia's progressive gan paper?

Furthermore, we observe that mode collapses traditionally plaguing GANs tend to happen very quickly, over the course of a dozen minibatches. Commonly they start when the discriminator overshoots, ...
0
votes
3answers
92 views

Is there a way of pre-determining whether a CNN model will perform better than another?

I developed a CNN for image analysis. I've around 100K labeled images. I'm getting a accuracy around 85% and a validation accuracy around 82%, so it looks like the model generalize better than ...
3
votes
1answer
35 views

Training network with 4 GPUs performance is not exactly 4 times over one GPU why?

Training neural network with 4 GPUs using pyTorch, performance is not even 2 times (btw 1 & 2 times) compare to using one GPU. From Nvidia-smi we see GPU usage is for few milliseconds and next 5-...
2
votes
1answer
47 views

Generate Image with Artificial intelligence

I am pretty new to Artificial Intelligence programming, however i do understand the basic concept. I have an idea in my mind: Import a JPEG Image, Convert this Image into a 2D Array (x,y values + ...
3
votes
1answer
48 views

GPU/TPU acceleration for neural networks with various network topologies

I was thinking about different neural network topologies for some applications. However, I am not sure how this would affect the efficiency of hardware acceleration using GPU/TPU/some other chip. If, ...
2
votes
1answer
250 views

Training an AI to recognize my voice (or any voice)

I want to start a project for my artificial intelligence class about speaker recognition. Basically, I want to train my AI to detect if it's me who's speaking or somebody else. I would like some ...
2
votes
3answers
112 views

Extracting algebraic constraints from the input data

I would appreciate your help with this (naive) question of mine. Given the set of points located on a circle, $x_{i}, y_{i}$ as the input data, Can a deep/machine learning algorithm infer that radius ...