Questions tagged [neural-networks]

For questions about a artificial networks, such as MLPs, CNNs, RNNs, LSTM, and GRU networks, their variants or any other AI system components that qualify as a neural networks in that they are, in part, inspired by biological neural networks.

Filter by
Sorted by
Tagged with
0
votes
1answer
37 views

Does the ANN's training data include the proper output for every neuron?

I was designing an Artificial Neural Network a while back, but hit a bump when I got to the backpropagation. I was having trouble making the script choose whether to add or subtract from the weights, ...
2
votes
0answers
40 views

Which method can accurately detect circular/angular shapes? (attached example)

Is there a method to detect shapes like these accurately and efficiently? I have tried the OpenCv Haar Casacade Classifier which does not work well. These shapes should all be the same class object ...
0
votes
1answer
32 views

Compare the efficiency of a trained ML model with a non-learning-based method for solving the same problem

If a certain task T is solved by a non-learning-based method A (let's say, an optimization-based approach). We now train a machine learning model B (let's say a neural network) on the same task. What ...
0
votes
1answer
39 views

How to pass multiple vectors and numeric features as input to the neural network?

I need help in a regression scenario. I have 12 input features. 4 of which are coordinates (each is a vector) in XYZ plane ...
1
vote
0answers
35 views

FCNs: Questions about the filter rarefaction in the CVPR paper [Long et al., 2015]

I am reading the paper about the fully convolutional network (FCN). I had some questions about the part where the authors discuss the filter rarefaction technique (I guess this is roughly equivalent ...
0
votes
0answers
13 views

What is the difference between supervised and unsupervised training in T5?

I know unsupervised training for T5 is like: input: He went X output: X to school Z is this equivalent to the following in a supervised manner: ...
0
votes
0answers
85 views

Discrepencies between the TimeGan paper and the code?

I recently read the paper Time-Series Generative Neural Networks and found the results that they reported quite promising (https://proceedings.neurips.cc/paper/2019/file/...
1
vote
1answer
60 views

What is the difference between gradient decent in neural networks and temporal difference in reinforcement learning?

I am studying Q-learning in reinforcement learning. My question is about the Bellman equation. In Q-learning, the Bellman equation is often introduced as follows. \begin{align} Q_{new}(s,a) &= Q_{...
-1
votes
1answer
29 views

What practically makes a good architecture of ANN?

When we take a look at the literature there are so many opinions. I was wondering what are some generally good practices to design an architecture, like how much depth would you prefer and how much ...
2
votes
1answer
44 views

Does a bigger neural network learn "worse" representations than a small neural network when the amount of data isn't enough?

Assume we have a neural network and we want to train it on a classification problem. The hidden layers of the neural network are kind of feature representations of the input data. If the neural ...
0
votes
1answer
20 views

Should I train my network for classification on samples whose ground truth label is ambiguous?

Imagine that I am training a model to classify handwritten digits. Suppose there are some bad quality images that could be classified by a human as either 0 or 8, 1 or 7 or other commonly ...
1
vote
1answer
25 views

How many iterations of the optimisation algorithm are performed on each mini-batch in mini-batch gradient descent?

I understand the idea of mini-batch gradient descent for neural networks in that we calculate the gradient of the loss function using one mini-batch at a time and use this gradient to adjust the ...
0
votes
0answers
26 views

Training a neural network using several data sources with quality flags

I have been searching for a specific problem in training a NN and hope someone is able and willing to help as I cannot find a solution. The problems is that I have a spatial data set with 3 sources of ...
0
votes
2answers
38 views

In mini-batch gradient descent, do we pass each input in the batch individually or all inputs at the same time through the layer?

In the stochastic gradient descent algorithm, the weight update happens for every training sample. In the mini-batch gradient descent algorithm, the weight update happens for every batch of training ...
0
votes
2answers
61 views

Is there any relationship between the batch size and the number of epochs?

I am currently running a program with a batch size of 17 instead of batch size 32. The benchmark results are obtained at a batch size of 32 with the number of epochs 700. Now I am running with batch ...
2
votes
2answers
67 views

How general is generalization?

I am sorry but I have to explain my question using an example, I do not know how to ask it in proper scientific terms. Let's assume, I have trained a deep learning model on classifying hand gestures, ...
0
votes
0answers
15 views

Brain tumour detection using CNN

I have a fairly basic mathematical and implementational understanding of ML algorithms and CNNs, and I am trying to think of an approach for this task: https://www.kaggle.com/c/rsna-miccai-brain-tumor-...
0
votes
0answers
12 views

Usecases where pretrained models are used without retraining

I was starting out with deep learning and come across a lot of pretrained models in frameworks and sites such as tensorflow model zoo. Are these models actually used by other developers in real use ...
0
votes
0answers
29 views

Is this a good implementation of this LSTM architecture?

I had been looking at some OCR problems and came across this presentation. I implemented it. In the presentation, there is the LSTM-Stack (diagram and algorithm, slide 32): Here is a visualization of ...
2
votes
1answer
227 views

Is "width of a neural network" a wrong phrase?

Depth of the neural network is equal to the total number of layers in the neural network except input layer. so, neural network with more number of layers are called deep neural networks. Width, in ...
0
votes
0answers
34 views

Multiple GRU layers to improve a text generation

I am using the model in this colab https://colab.research.google.com/github/tensorflow/text/blob/master/docs/tutorials/text_generation.ipynb#scrollTo=AM2Uma_-yVIq for Shakespeare like text generation. ...
0
votes
1answer
77 views

Why is the validation accuracy lower in case of CNN?

I fed the same set of 1.4 million data to two different models: MLP CNN model In both cases, I used the same parameters and hyperparameters. The CNN is showing comparatively lower accuracy (80%) ...
0
votes
1answer
31 views

How to handle random order of inputs and get same output?

I am a beginner with DL. I did some tutorials and I know the basics of TensorFlow. But I have a problem understanding how to construct more advanced NNs. Let's say I have 6 inputs and a list of 500 ...
2
votes
1answer
70 views

What problem does the neural network really solve?

In the image below taken from a Youtube video, the author explains that the neural network can be used to fit a relational graph for a set of data points shown by the green line. And that this is ...
0
votes
1answer
32 views

NLP problem Phrase/Token labeling

Looking for suggestions on how to define the following NLP problem and different ways in which it can be modeled to leverage machine learning. I believe there are multiple ways to model this problem. ...
0
votes
0answers
33 views

What deep reinforcement learning algorithm should I use for my problem?

So here is a description of my problem: Essentially, I have a large amount of files filled with code for a number of different tasks. However, lets say these codes are inefficient, and should be ...
0
votes
0answers
62 views

How to model the inputs and outputs of the neural network for the Splinterlands card game?

I have recently just completed a course on deep learning and I feel like an intermediate, but I still don't know how to structure this problem. I'm looking to create a NN to play the card game ...
0
votes
0answers
48 views

Which neural network architecture to use to detect very close and very small blobs in high resolution fluorescence images?

Context I am developing a pipeline to automate the detection of small, almost circular, bright blobs (4px) (see first image below) on high-resolution fluorescence images (2048px) and later to assign ...
0
votes
1answer
45 views

Do authors generally use fully connected layer instead of affine transformation?

We generally encounter the following statement several times The input vector is first fed into a fully connected layer...... Since linear activation functions, such as identity function, can so ...
0
votes
1answer
41 views

Why identity function is generally treated as an activation function?

It is known that the primary purpose of activation functions, used in neural networks, is to introduce non-linearity. Then how can the linear activation function, especially the identity function, be ...
0
votes
0answers
34 views

Using parameter estimation for training a neural network

Assume that we have 4 layers in a neural network. $$z_1 = L_1(x, W_1)$$ $$z_2 = L_2(z_1, W_2)$$ $$z_3 = L_3(z_2, W_3)$$ $$y = L_1(z_3, W_4)$$ Where $x$ is the vector input, $y$ is the vector output ...
0
votes
0answers
29 views

What's the benefit for using a Kalman filter for training a neural network compared to other optimization algorithms?

I found a paper about using an Unscented Kalman Filter(UKF) for traning a neural network. The UKF filter is modified so it works for parameter estimation. Assume that we have a neural network model $\...
1
vote
0answers
32 views

Machine learning with raw data alone / or raw data with its statistics

My question is very general and it does not originate from a specific problem. Let's assume that, through experience, we have learned that some statistical property of a set of data is important in ...
0
votes
1answer
67 views

How do I prepare this 3D data for NN?

How do I prepare the info of 3D models to use with NN? For example, I have thousands of models with boxes similar to the ones in the image below. I can extract the vertices and their normals that make ...
0
votes
0answers
18 views

Discrepancy of backpropagation formula between Andrew Ngs ML Course and those derived by neuralnetworksanddeeplearning.com

I'm currently working through Week 5 of Andrew Ngs Machine Learning course on Coursera, which goes through the backprop algorithm for basic neural networks. Whilst trying to derive the formulae he ...
1
vote
0answers
61 views

How to build neural network that detects changed signal firing pattern and is trained on positive patterns only?

Let's have a set of n devices firing signals. Devices are firing in the same cycles, but each device can fire in different phase of the cycle. More, the exact firing point can fluctuate, for example ...
1
vote
1answer
71 views

What does it mean when accuracy of regularized model is higher for training set than for validation set?

Accuracy of my regularized model is higher for training set than for validation set. The situation improves when regularization coeefficient is reduced: What does this really imply? From my ...
0
votes
0answers
20 views

Is my understanding of RNNs wrong?

I asked a similar question a few days back here, but since no one replied, I thought I should subdivide my question further. My understanding of RNNs is as follows, Suppose I have a standard MLP. To ...
0
votes
1answer
66 views

Is my single layer perceptron getting biased input some way or the other?

I was working a little bit on a school project my team and I decided to do for submission in the year-end. It's a small game which I call 'Quattro', and its rules are as follows: The game is played ...
0
votes
1answer
107 views

What, exactly, do mlp(64,64) and mlp(64,128,1024) mean in PointNet, and how many input neurons does 1 (x,y,z) point have?

I couldn't find out how to interpret the multilayer perceptron notation given in PointNet. Specifically, I am looking to find out what the numbers inside the parentheses of ...
0
votes
0answers
29 views

Modelling of output neuron for mixed features?

A dataset in artificial intelligence, in general, consists of some features (say $n$). Assume that $m$ among them are output features. I want to model this function using a neural network. So, input ...
0
votes
0answers
42 views

What are some machine learning frameworks for supervised clustering?

I have a task where I need to take "data points" which consist of collections of items. Each item needs to be categorised according to predefined categories. That's the easy part - my ...
1
vote
0answers
31 views

Are there any benefits of adding attention to linear layers?

Is attention useful only in transformer/convolution layers? Can I add it to linear layers? If yes, how (on a conceptual level, not necessarily the code to implement the layers)?
1
vote
1answer
65 views

What does it mean by bottleneck and representational bottleneck in feedforward neural networks?

Consider the following paragraph from section 2: General Design Principles of the research paper titled Rethinking the Inception Architecture for Computer Vision ...
0
votes
0answers
39 views

Which model is more efficient and why?

Suppose, I have two NN models: CNN model Sequential NN model They are solving the same problem. The data points have the same number of features. In the case of #1, we used 0.6 million data points, ...
1
vote
2answers
59 views

How to make an output independent of input feature in neural networks?

Is there a way to make a certain output dimension of a neural network independent of a particular feature dimension? For example, I have a function $f_{\theta} : \mathcal{R}^{10} \rightarrow \mathcal{...
2
votes
1answer
30 views

What type of neural network do you need if you want to detect an action or dynamic pattern instead of a static pattern?

Let's say that you want to detect if a man is running, walking, or dancing instead of just detecting a man still. What type of neural networks will you use for this purpose?
0
votes
1answer
56 views

How do CNNs handle inputs of different sizes and shapes?

I am new to deep learning so feel free to correct me where I am wrong. Imagine this scenario where we have a 7 * 7 input. We want to slide a 3 * 3 filter with a stride of 3 and padding of zero over ...
0
votes
0answers
40 views

What's the best way to feed stories to a neural network?

I'm trying to train a model that would generate stories. I have a dataset of 2000 stories prepared. They are tokenized and one-hot encoded. I can't load them all at once as a one big dataset, because ...
2
votes
0answers
50 views

How does back propagation adjust the hidden layers' weights and biases?

I'm new to neural networks and trying to figure out its fundamentals but I cannot fully understand the back propagation algorithm. In back propagation, I understand we want to go backwards from the ...

1 2
3
4 5
43