Questions tagged [deep-neural-networks]

For questions related to deep neural networks, which are artificial neural networks with "many" layers, where "many" can vary depending on the context.

47 questions with no upvoted or accepted answers
Filter by
Sorted by
Tagged with
4
votes
0answers
60 views

Why Pixel RNN (Row LSTM) can capture triangular contexts?

I'm reading the paper Pixel Recurrent Neural Network. I have a question about Row LSTM. Why Row LSTM can capture triangular contexts? In this paper, the kernel of the one-dimensional convolution ...
4
votes
2answers
42 views

What kind of output should be used for predicting angles in DNNs?

I am building a model which predicts angles as output. What are the different kinds of outputs that can be used to predict angles? For example, output the angle in radians cyclic nature of the ...
4
votes
0answers
524 views

Sparsity constraint in a deep autoencoder

Is there any way and any reason why one would introduce a sparsity constraint on a deep autoencoder? In particular, in deep autoencoders the first layer often has more units than the dimensionality ...
3
votes
0answers
46 views

Are there any commonly used discontinuous activation functions?

Are there any commonly used activation functions (e.g. that take values in $(0,.5)\cup (.5,1)$)? Preferably for classification? Why? I was looking for commonly used activation functions on Google, ...
3
votes
1answer
85 views

Is batch normalization not suitable for non-gaussian input?

I generate some non-Gaussian data, and use two kinds of DNN models, one with BN and the other without BN. I find that the model DNN with BN can't predict well. The codes is shown as follow: <...
2
votes
0answers
44 views

Which deep neural networks are appropriate for the detection of bombs?

This is a follow-up question from my previous post here about explosion detection. I gathered a dataset of explosions. As I'm new to Deep Learning in Keras, I'm trying to see what architecture best ...
2
votes
1answer
64 views

Spikes in of Train and Test error

I learn a DNN for image recognition. During each epoch, I calculate mean loss in the training set. After each epoch, I calculate loss and number of errors over both training and test set. The problem ...
2
votes
0answers
61 views

How to define cost function for custom nonlinear functions?

For logistic regression, the Cost function is defined as: \begin{equation} Cost(h_{\theta}(x)-y) = -ylog(h_{\theta}(x))-(1-y)log(1-h_{\theta}(x)) \end{equation} I now have a nonlinear function \begin{...
2
votes
0answers
27 views

Using two generative adversarial nets to classify articles - what is a good approach?

I'm trying to create a deep learning network to classify news article based on the text and associated image. The idea comes from a novel use of GANs to classify based on generated data. My approach ...
2
votes
0answers
165 views

Deep learning model (LSTM) with temporal and non temporal attributes

I'm working on a project to predict the usage of all the files in a filesystem in near future based on the metadata of the file system for past 6 months. I've got the following attributes about the ...
2
votes
0answers
76 views

How would I implement this New Type of NN

CIO NN CIO NN stands for Controller Input Output Nerual Network note due to a typo the "nearon" means "neron" For this we have to redefine the Nearon 2 Inputs 2 Outputs 4 Weights (each input and ...
1
vote
0answers
28 views

How to understand this NN architecture?

I was reading a paper Multi-Agent Reinforcement Learning for Adaptive User Association in Dynamic mmWave Networks and I was stuck understanding the deep neural network architecture that was used. The ...
1
vote
0answers
39 views

How can one be sure that a particular neural network architecture would work?

Traditionally, when working with tabular data, one can be sure(or at least know) that a model works because the included features could explain a target variable, say "Price of a ticket" ...
1
vote
0answers
46 views

Advantages of training Neural Networks based on analytic success criteria

What is the reason to train a Neural Network to estimate a task's success (i.e. robotic grasp planning) using a simulator that is based on analytic grasp quality metrics? Isn't a perfectly trained NN ...
1
vote
1answer
89 views

Can we use a pre trained Encoder (BERT, XLM ) with a Decoder (GPT, Transformer-XL) to build a Chatbot instead of Language Translation?

I was wondering if the BART or T5 models can do the task of generating sentences in English. Most of the models I have mentioned ...
1
vote
0answers
83 views

Understanding the role of the target network in this DQN algorithm

I've found online this interesting algorithm: From what I understand reading this algorithm, I can't figure out why I should "perform the opposite action" and consequently storing that second ...
1
vote
0answers
26 views

How can I find the similar non-zero connections between different levels of sparsity of the same network?

I am pruning a neural network (CNN and Dense) and for different sparsity levels, I have different sub-networks. Say for sparsity levels of 20%, 40%, 60% and 80%, I have 4 different sub-networks. Now, ...
1
vote
0answers
26 views

Steps to train and re-train a good model

I'm still a bit new to deep learning. What I'm still struggling, is what is the best practice in re-training a good model over time? I've trained a deep model for my binary classification problem (...
1
vote
0answers
22 views

Post-classification after inference

I designed a fire detection using Deep Learning based classification approach. In my training dataset, I have both fire and fire smokes are supposed to be detected (all under "fire"; mostly real fires ...
1
vote
0answers
16 views

Can a trained Vid2Vid model be run on AMDs Ryzen 2700x with 32GB of RAM?

I know that training deep neural networks (DNNs) takes a lot of computational resources. This is, of course, just a generalized statement. Different networks require different resources. One that I ...
1
vote
0answers
46 views

Relationship between model complexity (depth) and dataset size

I'm new to deep learning. I was wondering what's the relationship between a deep model complexity (e.g. total number of parameters, or depth) and the dataset size? Assuming I want to do a binary ...
1
vote
0answers
104 views

Should I use deep learning to solve my task?

I need to predict the performance (CPI cycles-per-instruction) of 90 machines for the next hour (or day). Each machine has a thousand records (e.g. CPU and memory usage). Currently, I am using a ...
1
vote
0answers
14 views

Camera pose to environment Mapping

I would like to teach a model the environment of a room. I'm doing so by mapping a camera pose (x, y, z, q0, q1, q2, q3) to its corresponding image; where x, y, z represent location in Cartesian ...
1
vote
0answers
37 views

One end to end Neural network or many task-specific ones?

Is it better to train one neural network for a dispersed labeled data with large number of classes or first classify data by unsupervised learning then train each part by a separate NN? I mean by ...
1
vote
0answers
42 views

What is the feasible neural network structure that can learn to identify types of trajectory of moving dots?

I have multiple image sequences, each of which contains an animation of two moving dots. The trajectory of the dots in a sequence is always cyclic (not necessarily circular). There are two types of ...
1
vote
0answers
43 views

How to handle varying length of inputs that represent dependencies and recursivity in deep neural networks in case of regression?

I wanna solve a problem of regression to predict a factor. I decide to go with Deep Neural Networks as solution for my problem. The features in this problem represent loop characteristic such us loop ...
1
vote
3answers
731 views

How to create Partially Connected NNs with prespecified connections using Tensorflow?

I'd like to implement a partially connected neural network with ~3 to 4 hidden layers (a sparse deep neural network?) where I can specify which node connects to which node from the previous/next layer....
1
vote
3answers
107 views

Is there a way of pre-determining whether a CNN model will perform better than another?

I developed a CNN for image analysis. I've around 100K labeled images. I'm getting a accuracy around 85% and a validation accuracy around 82%, so it looks like the model generalize better than ...
1
vote
0answers
82 views

Confidence interval around a DNN prediction

I am facing a problem and do not know whether it is even solvable: I want to predict the behaviour of a system using a DNN, say a CNN, in the sense that I want to predict the time and intensity of a ...
1
vote
0answers
27 views

Are there a finite set of computable functions constructing deep neural network which can form or implement any c.e. function or computable function?

Are there a finite set of computable functions constructing deep neural network which can form or implement any c.e. function or computable function? Or does there exist a finite set of computable ...
0
votes
0answers
12 views

Is there a ReLU implementation where the slope can be specified for positive values

I am testing the effects of different activations on my model and was wondering if there already exists a variant of ReLU where one can set the slope for positive values. PReLU learns a parameter for ...
0
votes
0answers
20 views

Am I using transfer learning when I use SSD ResNet 50 model architecture?

Using Label-img, I have successfully labeled my images (dimensions 1100 x 1100 pixels), and am currently training the SSD ResNet50 model (from the TensorFlow 2 Detection Model Zoo). I downloaded the ...
0
votes
0answers
9 views

Is there a framework or method that would help visualise inner workings of a feedforward neural network?

I wonder if there is some framework or method to help visualising inner workings of a feedforward deep neural network? What I mean by this is something similar to what is being done with CNNs where we ...
0
votes
0answers
25 views

How to use Deep Q-Network with two-dimensional input? Hands-on Machine Learning 2

I'm studying with the book Hands-on Machine Learning with Scikit-Learn, Keras and TensorFlow, and I'm trying to implement the Deep Q-Network example that can be found on Github but that the input ...
0
votes
0answers
26 views

Deep Continuous Clustering algorithm - just one output cluster

I use the DCC algorithm to cluster some data. The whole algorithm is available here, but shortly it is: construct mkNN graph of the data points (the connected components of it are the clusters). ...
0
votes
0answers
15 views

How can I decrease the time to compute the mask in the Mask-RCNN for human body detection?

I am using Mask-RCNN to detect human bodies in photos, to get a rough approximation of the ratio of their heights to the length of their chests. I want to decrease the time for making the mask of the ...
0
votes
0answers
10 views

Generative Adversarial Network with two images in input

I am doing an internship project regarding deep learning, and it is a totally new topic for me as I have never studied machine learning in the bachelor's degree courses. I have to implement a GAN that ...
0
votes
0answers
45 views

What is the state-of-the-art algorithm for neural style transfer?

I've read the paper A Neural Algorithm of Artistic Style by Gatys et. al. and I find the application of neural style transfer very fun. I also read that Exploring the structure of a real-time, ...
0
votes
0answers
32 views

Why do we use the Target Network for action evaluation in Double deep Q networks

Is there any specific reason as to why The target Network is used for evaluation and The online network Is used for selection, what would be the difference if both roles were switched, our online ...
0
votes
1answer
81 views

Why does not the deepAR model of Amazon require the time series being stationary, as opposed to ARMA model?

As what the title said. Does not deepAR require the time series being stationary?
0
votes
0answers
45 views

Possible reasons that validation recall is fluctuating across different epochs but the precision is stable?

I'm training a deep learning model. After each epoch I measure the performance of the model on validation set. Here is how the performance looks like while training: It's a binary classification task ...
0
votes
0answers
34 views

DQN Tic-Tac-Toe does not quite become optimal

I am trying to implement a DQN agent for playing standard 3x3 Tic-Tac-Toe (it is a double DQN with experience replay, and using a target network). I got the hyperparameters to the point where the ...
0
votes
0answers
22 views

Computational difference between ANN and Pattern Matching

Conceptually, if you had an internal 3d model of all objects in CV you could do a scan matching algorithm. This algorithm would be ridiculously computationally intensive, but it would have a high ...
0
votes
0answers
41 views

Why are YOLO Darknet weights so heavy?

I have been trying to understand how YOLO Darknet works, and for the most part reading the documentation and checking the code helps me understand. But when it comes to the weight file, I can't find ...
0
votes
0answers
17 views

Separated LSTMs or a global one for cluster of related features

I have an $n$-dimensional time-series to apply LSTM to, $n$ is the number of features for each time point. These features can be clustered according to their concept, for example $n_1, ..., n_4$ are ...
0
votes
0answers
23 views

How to stabilize the training of a Conv-Siamese Neural Network if the results after different trainings vary relatively strongly?

I am training a neural network using MSE and ADAM optimizer. More precisely, a siamese architecture with a convolutional encoder and euclidean distance on top. I am using MSE because I have different ...
0
votes
0answers
19 views

Deep Network with constraint or auxiliary features

The target of my current neural network is to predict a label. The dataset contains some features, there is a label $y_i$ in transaction $i$, indicating its classification. There is one feature $f^{i}...