Questions tagged [deep-network]

For questions about deep neural networks (DNNs), neural networks with multiple hidden layers between the input and output layer.

22 questions with no upvoted or accepted answers
Filter by
Sorted by
Tagged with
4
votes
2answers
34 views

What kind of output should be used for predicting angles in DNNs?

I am building a model which predicts angles as output. What are the different kinds of outputs that can be used to predict angles? For example, output the angle in radians cyclic nature of the ...
4
votes
0answers
418 views

Sparsity constraint in a deep autoencoder

Is there any way and any reason why one would introduce a sparsity constraint on a deep autoencoder? In particular, in deep autoencoders the first layer often has more units than the dimensionality ...
3
votes
1answer
39 views

Is batch normalization not suitable for non-gaussian input?

I generate some non-Gaussian data, and use two kinds of DNN models, one with BN and the other without BN. I find that the model DNN with BN can't predict well. The codes is shown as follow: <...
3
votes
1answer
69 views

Is it possible to create a decompiler using AI?

I am trying to decode a compiled file to source code and I am failing. I want to know whether an AI based decompilation is possible for a compiled files? Is it possible to create a decompiler using a ...
2
votes
0answers
42 views

Which deep neural networks are appropriate for the detection of bombs?

This is a follow-up question from my previous post here about explosion detection. I gathered a dataset of explosions. As I'm new to Deep Learning in Keras, I'm trying to see what architecture best ...
2
votes
1answer
36 views

Spikes in of Train and Test error

I learn a DNN for image recognition. During each epoch, I calculate mean loss in the training set. After each epoch, I calculate loss and number of errors over both training and test set. The problem ...
2
votes
0answers
58 views

How to define cost function for custom nonlinear functions?

For logistic regression, the Cost function is defined as: \begin{equation} Cost(h_{\theta}(x)-y) = -ylog(h_{\theta}(x))-(1-y)log(1-h_{\theta}(x)) \end{equation} I now have a nonlinear function \begin{...
2
votes
0answers
23 views

Using two generative adversarial nets to classify articles - what is a good approach?

I'm trying to create a deep learning network to classify news article based on the text and associated image. The idea comes from a novel use of GANs to classify based on generated data. My approach ...
2
votes
0answers
74 views

How would I implement this New Type of NN

CIO NN CIO NN stands for Controller Input Output Nerual Network note due to a typo the "nearon" means "neron" For this we have to redefine the Nearon 2 Inputs 2 Outputs 4 Weights (each input and ...
1
vote
0answers
28 views

Relationship between model complexity (depth) and dataset size

I'm new to deep learning. I was wondering what's the relationship between a deep model complexity (e.g. total number of parameters, or depth) and the dataset size? Assuming I want to do a binary ...
1
vote
0answers
29 views

One end to end Neural network or many task-specific ones?

Is it better to train one neural network for a dispersed labeled data with large number of classes or first classify data by unsupervised learning then train each part by a separate NN? I mean by ...
1
vote
0answers
38 views

What is the feasible neural network structure that can learn to identify types of trajectory of moving dots?

I have multiple image sequences, each of which contains an animation of two moving dots. The trajectory of the dots in a sequence is always cyclic (not necessarily circular). There are two types of ...
1
vote
0answers
38 views

How to handle varying length of inputs that represent dependencies and recursivity in deep neural networks in case of regression?

I wanna solve a problem of regression to predict a factor. I decide to go with Deep Neural Networks as solution for my problem. The features in this problem represent loop characteristic such us loop ...
1
vote
3answers
382 views

How to create Partially Connected NNs with prespecified connections using Tensorflow?

I'd like to implement a partially connected neural network with ~3 to 4 hidden layers (a sparse deep neural network?) where I can specify which node connects to which node from the previous/next layer....
1
vote
0answers
75 views

Confidence interval around a DNN prediction

I am facing a problem and do not know whether it is even solvable: I want to predict the behaviour of a system using a DNN, say a CNN, in the sense that I want to predict the time and intensity of a ...
1
vote
0answers
134 views

Deep learning model (LSTM) with temporal and non temporal attributes

I'm working on a project to predict the usage of all the files in a filesystem in near future based on the metadata of the file system for past 6 months. I've got the following attributes about the ...
1
vote
0answers
26 views

Are there a finite set of computable functions constructing deep neural network which can form or implement any c.e. function or computable function?

Are there a finite set of computable functions constructing deep neural network which can form or implement any c.e. function or computable function? Or does there exist a finite set of computable ...
0
votes
0answers
24 views

Stacking layers with different input size in deep network

I am trying to design a deep network that works on signals. The network should include multiple stacked tasks, but each task would work on a different window size of the signal. For example, the ...
0
votes
0answers
12 views

Camera pose to environment Mapping

I would like to teach a model the environment of a room. I'm doing so by mapping a camera pose (x, y, z, q0, q1, q2, q3) to its corresponding image; where x, y, z represent location in Cartesian ...
0
votes
0answers
42 views

How to use 0 padding with mask layer to handle variable lenght of my inputs in case of Multi-Layers Perceptrons?

We wanna build a DNN model to predict unrolling factor though our features represent variable length of inputs. Knowing that we have to give our features at once "0 padding" look like the only ...
0
votes
3answers
92 views

Is there a way of pre-determining whether a CNN model will perform better than another?

I developed a CNN for image analysis. I've around 100K labeled images. I'm getting a accuracy around 85% and a validation accuracy around 82%, so it looks like the model generalize better than ...
-1
votes
1answer
28 views

Does higher Accuracy in Reinforcement Learning indicate better model performance?

If a reinforcement learning algorithm uses a Deep Neural Network to predict the action given a state (a NN for a policy function), an Monte Carlo Tree Search in a model-based learning setup, then ...