Questions tagged [neural-networks]

For questions about a artificial networks, such as MLPs, CNNs, RNNs, LSTM, and GRU networks, their variants or any other AI system components that qualify as a neural networks in that they are, in part, inspired by biological neural networks.

800 questions with no upvoted or accepted answers
Filter by
Sorted by
Tagged with
2
votes
0answers
36 views

Why does model complexity increase my validation score by a lot?

I learned that when creating neural networks the go to was to overfit and then to regularize. However I am now in a situation where, when I make the model more complex (more layers, more filters, ...) ...
2
votes
0answers
32 views

Can the addition of low-quality images to the training dataset increase the network performance?

I already trained a deep neural network called YOLO (You Only Look Once) with high-quality images (1920 by 1080 pixels) for a detection task. The result for mAP and IOU were 93% and 89% respectively. ...
2
votes
0answers
65 views

Neural network to extract correlated columns

I want to use a neural network to find correlated columns in a .csv file and give them as a output. The input .csv file has ...
2
votes
0answers
45 views

Recent algorithms for correcting mislabeled data using multilayer perceptrons

I am doing literature research on algorithms for correcting mislabeled data using multilayer perceptrons. Found an "old" paper An algorithm for correcting mislabeled data (2001) by Xinchuan Zeng et al....
2
votes
0answers
29 views

Suitable algorithms for classifying terrain condition (asphalt, dirt etc) for motor vehicles

I am required to obtain data through a sensor located on the vehicle reading speed, vibration, roll and tilt, within a sample time, to classify the current road condition using machine learning for a ...
2
votes
0answers
29 views

Impact or applications of introducing attention in deep networks modelling multi-agent systems

I have been reading quite a lot about the research progress in the domain of self attention-based neural networks that were introduced by Google Inc. in their paper titled "Attention is all you ...
2
votes
0answers
36 views

Using ML for Enemy Generation in Video Games

I am attempting to make a 2-D platformer game where the player traverses through an evil factory that is producing killer robots. The robots spawn at multiple specific locations in each level and ...
2
votes
0answers
88 views

How is the receptive field of a CNN affected by transposed convolution?

When computing receptive field recursively through a CNN, does a transposed convolution affect the receptive field the same way that a convolution does if the kernel and stride is the same?
2
votes
1answer
249 views

Why am I getting a difference between training accuracy and accuracy calculated with Keras' predict_classes on a subset of the training data?

I'm trying to solve a binary classification problem with AlexNet. I split the original dataset into training and validation datasets using a 70/30 ratio. I have trained my neural network with a ...
2
votes
0answers
20 views

Sign Language to Speech conversion

Is there any solution about sign language to speech conversion for mobiles? Can anyone suggest me the flow and tools so that I may implement the solution for mobiles?
2
votes
0answers
161 views

Can we use GPT-2 to smooth out / correct text?

Are we able to use models like GPT-2 to smooth out/correct text? For instance if I have two paragraphs that need some text to make the transition easier to read, could this text be generated? And, ...
2
votes
0answers
21 views

How to handle set-like size agnostic input format

Let's set up some hypothetical simplified scenario: Each instance $i$ of my imaginary dataset $D=\{i_{1}, \ldots, i_{MAX}\}$ has different number $k_{i}$ of $n$-dimensional vectors as input into my ...
2
votes
0answers
185 views

How I can predict the next number in a sequence with a neural network?

I've been dabbling with machine learning and neural networks (namely, resnet50) for a few months now, mostly doing image recognition. I am currently trying to make a program that, given a string of ...
2
votes
0answers
59 views

Neural nets not learning mnist dataset

I tried training a 2 hidden layer network using the mnist dataset, but I am not getting any results. I have tried tuning the learning rate(tried 0.1 and 0.0001) and the number of epochs(tried 10 and ...
2
votes
0answers
50 views

What is the expected value of an IOU in this case?

I have a detection problem. An object with a probability of 0.5 is in a box with coordinates ((0,0), (2, 2)) and with a probability of 0.5 a box with coordinates ((2,0), (4,2)). What is the maximum ...
2
votes
0answers
41 views

How can I compare EEG data with accelerometer data in 1 algorithm?

I have frequency EEG data from fall and non-fall events and I am trying to incorporate it with accelerometer data that was collected at the same time. One approach is, of course, to use two separate ...
2
votes
0answers
38 views

How can I extract the reason of the legal compensation from a court report?

I'm working on a project (court-related). At a certain point, I have to extract the reason of the legal compensation. For instance, let's take these sentences (from a court report) Order mister X ...
2
votes
0answers
29 views

Determine Frequency from Noisy Signal With Neural Networks (With Adeline Model)

I'm trying to determine the frequency from a signal with NN. I'm using the Adeline model for my project and I'm taking a few samples in each 0.1-volt step in a true signal and a noisy one. First ...
2
votes
0answers
41 views

How to understand my CNN's training results?

I created a multi-label classification CNN to classify chest X-ray images into zero or more possible lung diseases. I've been doing some configuration tests on it and analyzing its results and I'm ...
2
votes
1answer
532 views

How does a batch normalization layer work?

I understood that we normalize to input features in order to bring them on the same scale so that weights won't be learned in arbitrary fashion and training would be faster. Then I studied about ...
2
votes
0answers
43 views

FasterRCNN's RPN network training

I would like to know if my understanding of RPN training is correct, and if never training the RPN on some specific anchor box is bad (i.e if the anchor never sees good nor bad examples). To make my ...
2
votes
0answers
44 views

Can learned feature vectors be considered a good encryption?

Considering I have some neural network that, using supervised learning, transforms a string into a learned feature vector where "close" strings will result into more close vectors. I know that since ...
2
votes
0answers
50 views

How can I feed any word into a neural network?

I am working on an Intent detection problem for a chatbot in Java. So I need to convert words from String to a double[] format. I tried using wordToVec(deeplearning4j), but it does not return a vector ...
2
votes
0answers
170 views

What is a location-based addressing in a neural Turing machine?

In the neural Turing machine (NTM), the content-based addressing and location-based addressing is used for memory addressing. Content-based addressing is similar to the attention-based model, ...
2
votes
0answers
34 views

Calculation of Neural network biases in backpropagation

While learning neural networks I've found a basic Python working example to play with. It has 3 input nodes, 4 nodes in a hidden layer, 1 output node. 5 data sets for training. The initial code is ...
2
votes
0answers
14 views

Loss function for increasing the quality of the image when labels are not perfectly alligned

I am trying to increse the quality of the images that I gather from the microscope. That is a acoustic microscope and there are lots of technical details but in a nutshell the low quality images and ...
2
votes
0answers
40 views

How should I make output layer of my neural network so that I can get outputs ranging from [-20,-1]

I am trying to make a neural network which takes in 0 and 1 as it's input and should give me output ranging from [-20,-1].I am using three layers with sigmoid as the activation function .How should I ...
2
votes
0answers
27 views

Choosing neural network output for prediction (regression) of a dynamical system

I’m trying to train a neural network to approximate the output of a dynamical system $dy/dt=f\left(y(t), u(t) \right)$, namely, given $y(0)$ and $u(t_i), i=1,2...N$ I want the network to predict $y(...
2
votes
0answers
30 views

Is there a detailed description or implementation of an end-to-end speech recognition system?

I am currently trying to implement an end-to-end speech recognition system from scratch, that is, without using any of the existing frameworks (like TensorFlow, Keras, etc.). I am building my own ...
2
votes
0answers
38 views

What is the complexity of policy gradient algorithms compared to discrete action space algorithms?

I am using a policy gradient algorithm (actor-critic) for wireless networks. The policy gradient-based algorithm helps because it considers continuous action space. But how much does a policy ...
2
votes
0answers
39 views

Can a Video Game Characters Behavior be directed by a NN?

So, I’m looking into some dynamic ways in which one can drive the behavior of a video game character. Specifically an NPC (Non playable character) that will be observable from the players point of ...
2
votes
0answers
28 views

Which neural network algorithms can be used to map motion vectors in image processing?

I'm working on finding out the motion vectors of objects in images. The inputs are the images of objects in motion. The outputs of neural network are the object name, direction of object vector and ...
2
votes
2answers
48 views

Maximize loss on non-target variable

I have a neural network that should be able to classify documents to target label A. The problem is that the network is actually classifying label B, which is an easier task. To make the problem more ...
2
votes
0answers
26 views

How to train a transformer text-to-text model on counterexamples?

Is it possible to update the weights of a vanilla transformer model using counterexamples alongside examples? For example, from the PAWS data set, given the phrases "Although interchangeable, the ...
2
votes
0answers
23 views

Can two neural networks be better instead of one with a categorical feature?

Let's assume, that I have a neural network with few numerical features and one binary categorical feature. The network in this case is used for regression. I wonder if such a neural network can ...
2
votes
0answers
305 views

How do I create a chatbot using tensorflow or pytorch using like the one defined in dialogflow?

How do I create a chatbot using TensorFlow or PyTorch using like the one defined in DialogFlow? What are the best datasets that I can use so to create my own personal assistant like google assistant? ...
2
votes
0answers
70 views

What is the difference between Squeeze-and-excite and bottleneck modules from Mobilenet v2?

Squezee-and-excite networks introduced SE blocks, while MobileNet v2 introduced linear bottlenecks. What is the effective difference between these two concepts? Is it only implementation (depth-wise ...
2
votes
0answers
22 views

How do I recover the 3D structure of a layer after a fully-connected layer?

I want to implement a CNN, but I want to explore what happens when my first layer is a fully-connected one. I still want to use convolutions, of course, but I want to apply them after the first layer. ...
2
votes
0answers
28 views

Can neuro-fuzzy systems be used for supervised learning tasks with tabular data?

Is it possible to use neuro-fuzzy systems for problems where ANNs are currently being used, for instance, when you have tabular data for regression or classification tasks? What kind of advantage can ...
2
votes
0answers
145 views

What are the possible neural network architecture for linear regression or time series regression?

I started modeling a linear regression problem using dense layers (layers.dense), which works fine. I am really excited, and now I am trying to model a time series linear regression problem using CNN, ...
2
votes
0answers
53 views

What are the main technologies needed to build an AI for Warcraft 3's mod DotA?

What are the main technologies needed to build an AI for Warcraft 3's mod Defense of the Ancients (DotA)? Maybe I can take inspiration from OpenAI's work.
2
votes
0answers
152 views

Understanding CNN+LSTM concept with attention and need help

I have a question about the context of CNN and LSTM. I have trained a CNN network for image classification. However, I would like to combine it with LSTM for visualizing the attention weights. So, I ...
2
votes
0answers
64 views

Will the RL agent implemented as a neural network fine-tune itself?

Normally, when you develop a neural network, train it for object recognition (on normal objects like bike, car, plane, dog, cloud, etc.), and it turns out to perform very well, you would like to fine-...
2
votes
0answers
55 views

Is a neural network the correct approach to optimising a fitness function in a genetic algorithm?

I've written an application to help players pick the optimal heroes during the draft phase of the Heroes of the Storm MOBA. It can be daunting to pick from 80+ characters that have synergies/counters ...
2
votes
0answers
43 views

Why do neural networks have bias units?

Why do neural networks have bias units? Why is it sometimes okay to opt them out?
2
votes
0answers
75 views

Why is graph convolution network in time-varying graphs useful for anomaly detection?

In this paper, the authors refer to the application of time-varying graphs as an open problem. And they say it will be useful for anomaly detection in financial networks, etc. But why is that useful?
2
votes
0answers
26 views

Is there any useful source on High Bias vs High variance issue on Neural Network?

I've been struggling to analyize my NN model. I've studied through andrew ng's course, but there are some results that cannot be explained by the course. Is there any useful source on High Bias vs ...
2
votes
0answers
58 views

Neural networks when gradient descent is not possible

I am looking for an example in which it is simply impossible to use some sort of gradient descent to train a neural network. Is this available? I have read quite some papers about gradient-free ...
2
votes
0answers
67 views

Neural Network for Error Prediction of a Physics Model?

I have physical model prediction data as well as actual data. From this I can calculate the error of each prediction data point through simple subtraction. I am hoping to train a neural network to be ...
2
votes
1answer
97 views

Validation Loss Fluctuates then Decrease alongside Validation Accuracy Increases

I was working on CNN. I modified the training procedure on runtime. As we can see from the validation loss and validation accuracy, the yellow curve does not fluctuate much. The green curve and red ...

1 2 3
4
5
16