Questions tagged [neural-networks]

For questions about a artificial networks, such as MLPs, CNNs, RNNs, LSTM, and GRU networks, their variants or any other AI system components that qualify as a neural networks in that they are, in part, inspired by biological neural networks.

Filter by
Sorted by
Tagged with
0
votes
0answers
12 views

Camera pose to environment Mapping

I would like to teach a model the environment of a room. I'm doing so by mapping a camera pose (x, y, z, q0, q1, q2, q3) to its corresponding image; where x, y, z represent location in Cartesian ...
0
votes
2answers
41 views

How should I interpret the weights file of the Leela Zero neural network?

I am trying to understand the NN architecture given at https://github.com/leela-zero/leela-zero/blob/next/training/caffe/zero.prototxt. So, I downloaded the NN weights from http://zero.sjeng.org/. ...
1
vote
0answers
75 views

Polynomial Regressor vs Neural Network Regressor

So as far as my knowledge (might be a bit vague and not mathematical) goes a Neural Network can and should only be able to approximate a bounded function, which is not the case of a Polynomial ...
0
votes
1answer
56 views

What is the correct way to read and analyse images in machine learning?

I am trying to understand the best practice to read and analyze images. If your image has 10,000 pixels, your input layers will have 10,000 inputs? It sounds that my neural network will have too many ...
5
votes
3answers
93 views

Preventing bias by not providing irrelevant data

This seems like such a simple idea, but I've never heard anyone that has addressed it, and a quick Google revealed nothing, so here it goes. The way I learned about machine learning is that it ...
1
vote
2answers
74 views

Can neural networks be used to find features importance?

I am wondering if I can use neural networks to find features importances in similar manner as it can be done for random forests or decision trees and if so, how to do it? I would like to use it on ...
0
votes
0answers
12 views

Can Artificial Neural Networks learn traditional Latent Class models?

A colleague is a statistician who is an expert in building multi-dimensional Latent Class models. I would like to know if it is possible to use artificial neural networks with several hidden layers to ...
0
votes
0answers
14 views

What is interval of the initial weights at Matlab neural network tool?

What is interval of the initial weights at Matlab neural network tool?Yes I know it is randomly but are there limitation?
0
votes
0answers
16 views

Neuro fuzzy systems and it's application

I was wondering if it's possible to use Neuro fuzzy systems where ANNs are used, e.g having a tabular data for regression task or using it for classification tasks. What kind of advantage can give me ...
-3
votes
3answers
222 views

Evolutionary neural architecture?

I'm working on an idea for an AI architecture, and would like to know if there are any apparent flaws, or if there is prior work in this vein. Set I/O so that the neural network can read and write ...
1
vote
1answer
24 views

Clarifying when a loss/cost function calculation and backprop take place

I read different articles and keep getting confused on this point. Not sure if the literature is giving mixed information or I'm interpreting it incorrectly. So from reading articles my ...
2
votes
2answers
47 views

Standard deviation in the # of neurons per layer

In a neural network, by how much does the # of neurons typically vary from layer to layer? PLEASE NOTE: I am NOT asking how to find the optimal # of neurons per lyr. As a hardware design engineer ...
3
votes
2answers
45 views

Are fully connected layers necessary in a CNN?

I have implemented a CNN for image classification. I have not used fully connected layers, but only a softmax. Still, I am getting results. Must I use fully-connected layers in a CNN?
2
votes
1answer
50 views

What are the most common methods to enable neural networks to adapt to changing environments?

For real applications, concept drifts often exist, i.e., the relationship between the input and output changes overtime. Thus, we need our AI or machine learning system to quickly adapt to the ...
1
vote
1answer
71 views

Deep Q Learning Algorithm for Simple Python Game makes player stuck

I made a simple Python game. A screenshot is below: Basically, a paddle moves left and right catching particles. Some make you lose points while others make you gains points. This is my first Deep Q ...
3
votes
1answer
72 views

Can Neural Networks be considered as “Strong AI”?

I've been reading on the differences between "Strong" and "Weak "AI. I was wondering, where do Neural Networks (especially deep ones) fall in this spectrum? Can they be considered "Strong AI"? If ...
3
votes
1answer
56 views

How is REINFORCE used instead of Backpropagation?

In neural networks with stochastic layers I've seen the use of the REINFORCE estimator for estimating the gradient (because it can't be computed directly). Some such examples are Show, Attend and ...
0
votes
0answers
33 views

Not able to properly tune Neural Network via Back Propagation properly

I have a custom code Neural Network(not using keras or any package...Trying to learn the essence of Neural Network from scratch)... Code can be found here I have the per iteration training output(<...
2
votes
0answers
38 views

Does Retina-net's focal loss accomplish its goal?

Taking out the weighting factor we can define focal loss as $$FL(p) = -(1-p)^\gamma log(p) $$ Where $p$ is the target probability. The idea being that single stage object detectors have a huge ...
1
vote
1answer
30 views

What loss function is appropriate for finding “points of interest” in a array of x,y inputs

I am looking into whether a neural network is appropriate to detect "points of interest" (POI) in a set of tuples (say length, and some sensor value). A POI is essentially a quick change in the value ...
1
vote
1answer
33 views

Effect of rescaling of inputs on loss for a simple neural network

I've been trying out a simple neural network on the fashion_mnist dataset using keras. Regarding normalization, I've watched this video explaining why it's necessary to normalize input features, but ...
3
votes
1answer
43 views

Is there a Continuous Conditional Variational Autoencoder?

The Conditional Variational Autoencoder (CVAE), introduced in the paper Learning Structured Output Representation using Deep Conditional Generative Models (2015), is an extension of Variational ...
0
votes
1answer
55 views

How to detect patterns in a data set of given IP addresses using a neural network?

How to detect patterns in a data set of given IP addresses using a neural network? The data set is actually a list of all the vulnerable devices on a network. I want to use a neural network that ...
4
votes
2answers
143 views

When should I use 3D convolution?

I am new to convolutional neural networks, and I am learning 3D convolution. What I could understand is that 2D convolution gives us relationships between low-level features in the X-Y dimension, ...
1
vote
1answer
43 views

Is there a theory behind which model is good for a classification task for the convolutional neural network?

Let say I'm trying to apply CNN for image classification. There are lots of different models to choose and we can try an ensemble, but given a limit amount of resources, it does not allow to try ...
1
vote
0answers
37 views

What are the possible neural network architecture for linear regression or time series regression?

I started modeling a linear regression problem using dense layers (layers.dense), which works fine. I am really excited, and now I am trying to model a time series linear regression problem using CNN, ...
3
votes
1answer
45 views

What weights should I use while back-propagating?

I've started to learn about neural networks recently and I can't find the answer to this question. Let's assume there's a neural network (fig. 1) So if the loss function is: and the derivative is: ...
1
vote
0answers
24 views

AI for Warcraft 3 Dota

I want to create AI for Dota1. Is it possible to create AI for Warcraft 3? How Open AI works in Dota2? I want to know more about algorithms what are in foundation in Open AI.
0
votes
0answers
25 views

Pooling vs Subsampling: Multiple Definitions?

I have seen people using pooling and subsampling synonymously. I have also seen people use them as different processes. I am not sure though if I have correctly inferred what they mean, when they use ...
3
votes
1answer
97 views

Which approach can I use to generate text based on multiple inputs?

I have a little experience in building various models, but I've never created anything like this, so just wondering if I can be pointed in the right direction. I want to create (in python) a model ...
1
vote
1answer
71 views

Would this neural network have short term memory?

I want to design a NN that can remember it's last 7 actions and use them as inputs. So for example it would be able to store words in it's memory. Therefore if it had a choice of 10 different actions, ...
1
vote
1answer
37 views

How do I identify the number and type of objects in the same picture?

I need to identify the number and type of all objects in a picture, so there can be multiple objects of the same type. For example, I have a picture with $10$ animals, and I want my program to tell ...
4
votes
1answer
179 views

What is the time complexity of the forward pass algorithm of a neural network?

How do I determine the time complexity of the forward pass algorithm of a feedforward neural network? How many multiplications are done to generate the output?
4
votes
2answers
55 views

How can AI be used to design UI Interfaces?

I'm very new to AI. I read somewhere that AI can be used to create GUI UI/UX design. That has fascinated me for a long time. But, since I'm very new here, I don't have any idea how it can happen. ...
0
votes
1answer
53 views

Can neural networks modify their own weights without back-propagation and gradient descent?

Can neural networks modify their own weights without back-propagation and gradient descent?
0
votes
1answer
34 views

Use deep learning to rank video scenes

I'm new to machine learning and especially, deep learning. Given a video (and it's subtitle), I need to generate a 10-second summary out of this video. How can I use ML and DL to produce the most ...
4
votes
1answer
43 views

How can I use one neural network for both players in Alpha Zero (Connect 4)?

First of all, it is great to have found this community! I am currently implementing my own Alpha Zero clone on Connect4. However, I have a mental barrier I cannot overcome. How can I use one neural ...
0
votes
0answers
40 views

What neural network can be used to detect patterns and anomalies of a network map?

What neural network can be used to detect patterns and anomalies of a network map. The network data comes from tools like nmap and masscan.
3
votes
1answer
56 views

Clarification on definition of convolution: Is adding the Frobenius inner products between filter and input part of convolution or a separate step?

From the literature I have read so far, it is not clear how exactly the convolution operation is defined. It seems people use two different definitions: Let us assume we are given an $n_w \times n_h \...
4
votes
2answers
90 views

Can we optimize an optimization algorithm?

In this answer to the question Is an optimization algorithm equivalent to a neural network?, the author stated that, in theory, there is some recurrent neural network that implements a given ...
0
votes
1answer
31 views

Query regarding the minmax loss function formulation of the training of a Generative Adversarial Network (GAN)

Just needed a clarification on the training procedure for a standard GAN. Of my understanding the loss function to optimize is a min max (max min causing mode collapse due to focus on one class ...
3
votes
2answers
58 views

Is PReLU superfluous with respect to ReLU?

Why do people use the $PReLU$ activation? $PReLU[x] = ReLU[x] + ReLU[p*x]$ with the parameter $p$ typically being a small negative number. If a fully connected layer is followed by a at least two ...
1
vote
1answer
50 views

Is an optimization algorithm equivalent to a neural network?

Is an optimization algorithm equivalent to a neural network?
6
votes
9answers
522 views

Can Neural Networks self-optimize?

Suppose that you show a neural network its own code, and allow it to edit itself? Can a neural network modify its own weights and architecture (the number of layers, the number of neurons per layer, ...
0
votes
0answers
31 views

Neural Network cannot learn nonlinear function

I am currently creating a neural network to learn a function of the following form I am using both keras and tensorflow and with both scripts I get the following result . Somehow my neural network ...
3
votes
1answer
57 views

Why can't neural networks learn functions outside of the specified domains?

I understand that neural nets are fundamentally interpolative tools. Meaning, given a training dataset, a well trained neural net can approximate values within the domain of the training dataset. ...
0
votes
0answers
18 views

Is Hopfield network more efficient than a naive implementation of Hamming distance comparator?

Is Hopfield network more efficient than a naive implementation of Hamming distance that compare an input pattern and return the nearest pattern ?
0
votes
0answers
31 views

Understanding CNN+LSTM concept with attention and need help

I have a question about the context of CNN and LSTM. I have trained a CNN network for image classification. However, I would like to combine it with LSTM for visualizing the attention weights. So, I ...
3
votes
0answers
62 views

Why isn't the evolutionary Turing machine mainstream?

Given that recurrent neural networks are equivalent to a Turing machine, then why isn't the evolutionary Turing machine, e.g. described in the paper Evolution of evolution: Self-constructing ...
1
vote
0answers
37 views

How can an ANN efficiently predict multiple numbers with fixed sum (in other words, proportions)?

I need a neural network (or any other solution) to predict 3 values which sum equals a fixed number (100). This will help me calculate proportions. Which is the most efficient way to do this? The ...