Questions tagged [deep-learning]

For questions related to deep learning, which refers to a subset of machine learning methods based on artificial neural networks (ANNs) with multiple hidden layers. The adjective deep thus refers to the number of layers of the ANNs. The expression deep learning was apparently introduced (although not in the context of machine learning or ANNs) in 1986 by Rina Dechter in the paper "Learning while searching in constraint-satisfaction-problems".

Filter by
Sorted by
Tagged with
3
votes
2answers
53 views

How to use LSTM to generate a paragraph

A LSTM model can be trained to generate text sequences by feeding the first word. After feeding the first word, the model will generate a sequence of words (a sentence). Feed the first word to get the ...
2
votes
1answer
67 views

The reasoning behind the number of filters in the convolution layer

Let's assume an extreme case in which the kernel of the convolution layer takes only values 0 or 1. To capture all possible patterns in input of $C$ number of channels, we need $2^{C*K_H*K_W}$ filters,...
1
vote
0answers
30 views

Sample size for the evaluation of Deep Learning Models

I'm evaluating the performance and accuracy in detecting objects for my data set using three deep learning algorithms. In total there are 24,085 images. I measure the performance in terms of time ...
0
votes
1answer
46 views

How is the loss value calculated in order to compute the gradient?

The gradient descent step is the following \begin{align} \mathbf{W}_i = \mathbf{W}_{i-1} - \alpha * \nabla L(\mathbf{W}_{i-1}) \end{align} were $L(\mathbf{W}_{i-1})$ is the loss value, $\alpha$ the ...
0
votes
0answers
28 views

Reasoning behind $Zero$ validation accuracy in the following ResNet50 model for classification

I have written this code to classify Cats and dogs using Resnet50. Actually while studying I came to the conclusion that Transfer learning gives very good accuracy for deep learning models, but I ...
1
vote
0answers
21 views

Hinton's Capsule network 16 dimensions

As you may know, Hinton's Capsule Network has been around for about 2 years now. https://arxiv.org/abs/1710.09829 Much ado has been made about how the Capsules output a vector (magnitude = ...
2
votes
1answer
35 views

Accuracy scores in a Deep Learning project

I'm using three pre-trained deep learning models to detect vehicles and count from an image data set. The vehicles belong to one of these classes ['car', 'truck', 'motorcycle', 'bus']. So, for a ...
1
vote
0answers
14 views

Number of weights in historical to cutting edge deployment of deep networks [closed]

In cutting edge deployment of deep networks for different architectures (such as $CNN$, $QRNN$ etc) what is the historical trend of current limits of trainability possible computationally? By this I ...
2
votes
1answer
46 views

How to make DNN learn multiplication/division?

A single neuron with 2 weights and identity activation can learn addition/subtraction as the 2 weights will converge to 1 and 1 (addition), or 1 and -1 (subtraction). However, for multiplication and ...
1
vote
0answers
20 views

Is there any app / API which generates meaningful information?

I was wondering if there is any application / API which given a word comes up with legible and meaningful information related to it, and if possible relates it to any recent happenings or development ...
2
votes
0answers
24 views

YOLO 9000 about Better Stronger

In this paper, YOLO has three features compared to YOLO v1. This question is about Better and Faster. In the Better section, there are many techniques such as Batch Norm, Anchor Box and so on. In the ...
3
votes
0answers
40 views

How does the memory mechanism (reading and writing) work in a neural Turing machine?

In neural Turing machine (NTM), reading memory is represented as \begin{align} r_t \leftarrow \sum\limits_i^R w_t(i) \mathcal{M}_t(i) \tag{2} \end{align} and writing to memory is represented as ...
1
vote
0answers
25 views

How to handle a high dimensional video (large number of frames per video) data for training a video classification network

I have a video dataset as follows. Dataset size: 1k videos Frames per video: 4k (average) and 8k (maximum) Labels: Each video has one label. So the size of my input will be (N, 8000, 64, 64, 3) ...
4
votes
1answer
79 views

What are some new deep learning models for learning latent representation of data?

I know that autoencoders are one type of deep neural networks that can learn the latent representation of data. I guess there should be several other models like autoencoders. What are some new deep ...
2
votes
1answer
46 views

How does a batch normalization layer work?

I understood that we normalize to input features in order to bring them on the same scale so that weights won't be learned in arbitrary fashion and training would be faster. Then I studied about ...
4
votes
0answers
49 views

Training and inference for highly-context-sensitive information

What is the best way to train / do inference when the context matters highly as to what the inferred result should be? For example in the image below all people are standing upright, but because of ...
1
vote
0answers
20 views

Why the error rates in table3 and table4 are differenct in the paper “deep residual learning for image recognition”

Why are the error rates in table 3 and table 4 are different in the paper Deep Residual Learning for Image Recognition (2015). They are both error rates on the validation sets by single model. ...
0
votes
0answers
14 views

Implementing Logic Inference with Deep Learning

Short question How can I implement Logic Inference with Deep Learning? Long question Based on Symbolic Logic, chaining multiple predicates (a short example is Syllogism) is a method of implementing ...
3
votes
0answers
34 views

Can sequence-to-sequence models be used to convert source code from one programming language to another?

Sequence-to-sequence models have achieved good performance in natural language translation. Could these models also be applied to convert source code written in one programming language to source code ...
1
vote
0answers
26 views

Are there any approaches other than deep learning to deal with unexpected questions in a question answering system?

I'm working on a question answering bot as my graduation project. The main concept is having a text file with many sentences, and building a question answering bot which answers a user's question ...
2
votes
2answers
113 views

Can a neural network be used to predict a sequence of integers based on dataset of previously produced random numbers?

What i really want to do, is to predict an integer sequence of (5 numbers with values from 1 to 50) for example based on a big dataset of other 5 numbers sequences with same values range created by ...
1
vote
1answer
43 views

CycleGAN for paired data

I am very interested in the application of CycleGANs. I understand the concept of unpaired data and it makes sense to me. But now a question comes to my mind: what if I have enough paired image data, ...
1
vote
0answers
7 views

Anyone familiar with Bilateral Recommendation System? And suggest any related papers?

I'm working on Bilateral Recommendation System. But not able to find much related papers. Could anyone suggest any papers relative? Thanks
2
votes
0answers
31 views

How can I prevent a Recursive Neural Network from performing extremely poorly after a few cycles?

I've trained a neural network that can predict the $(n+1)^{th}$ element in a sequence, given the $n^{th}$ element. It does a pretty good job doing this, with very little error. The problem emerges ...
1
vote
1answer
36 views

Deep Learning models train really slow Jetson Nano [closed]

I recently bought a Jetson Nano and I'm amazed with everything about it. But I don't know what is happening, because I created a very simple neural network with keras and it's taking way to long. I ...
4
votes
1answer
67 views

When exactly is a model considered over-parameterized?

When exactly is a model considered over-parameterized? There are some recent researches in Deep Learning about the role of over-parameterization toward generalization, so it would be nice if I can ...
1
vote
2answers
64 views

Would AI be appropriate for converting unstructured text into an XML?

I need to understand whether it is better to use AI algorithms (ML, DL, etc.) instead of the classic parser (based onto grammars with regular expression and automaton) for the following task: ...
-2
votes
1answer
43 views

How can I detect diagram region and extract (crop) it from a research paper [closed]

How can I detect diagram region and extract(crop) it from a research paper
0
votes
1answer
67 views

What are the characteristics of a deep learning AI?

I have experience in making several Artificial Neural Networks and some programs which may be classified as an Artificial Intelligence by using Tensorflow.js and Brain.js. In order to produce ...
1
vote
0answers
28 views

Relationship between model complexity (depth) and dataset size

I'm new to deep learning. I was wondering what's the relationship between a deep model complexity (e.g. total number of parameters, or depth) and the dataset size? Assuming I want to do a binary ...
2
votes
1answer
43 views

Regression using neural network

I'd like to ask for any kind of assistance regarding the following problem: I was given the following training data: 100 numbers, each one is a parameter, they together define a number X(also given)....
6
votes
2answers
125 views

Why is dropout favoured compared to reducing the number of units in hidden layers?

Why is dropout favored compared to reducing the number of units in hidden layers for the convolutional networks? If a large set of units leads to overfitting and dropping out "averages" the response ...
3
votes
1answer
59 views

Why do current models use multiple normalization layers?

In most current models, the normalization layer is applied after each convolution layer. Many models use the block $\text{convolution} \rightarrow \text{batch normalization} \rightarrow \text{ReLU}$ ...
2
votes
0answers
76 views

Which neural network should I use to transform the pixels of a video overtime?

I want to train a network with video data and have it transform pixel values overtime on an input video. This is for an art project and does not need to be super elaborate, but the videos I want to ...
8
votes
3answers
2k views

How can an AI freely make decisions on a network?

Say a Deep Neural Net is created using Keras or Tensorflow. Usually when you want to make a prediction the user would invoke model.predict.... However, how would ...
1
vote
1answer
43 views

Tabular Datasets where Deep neural networks outperforms XGBoost

Are there (complex) tabular datasets where deep neural networks (e.g. more than 3 layers) outperform traditional methods such as XGBoost by a large margin? I'd prefer tabular datasets rather than ...
0
votes
1answer
96 views

Should I use deep learning to solve my task?

I need to predict the performance (CPI cycles-per-instruction) of 90 machines for the next hour (or day). Each machine has a thousand records (e.g. CPU and memory usage). Currently, I am using a ...
1
vote
1answer
59 views

What is the difference between game theory and machine learning?

What is the difference between game theory and machine learning? I had gone through the papers Deep Learning for Predicting Human Strategic Behavior, by Jason Hartford et al., and When Machine ...
1
vote
0answers
41 views

Why isn't this deep Q network agent for the snake game learning?

I wanted to combine this snake game with this DQN implementation I found in this article. First, I tried to change the NN's input layer to a 400 input. The game has a field of 20 times 20, so I ...
0
votes
0answers
23 views

Sequence-to-Sequence models without specifying the start and end of sentences

Is there a seq-to-seq model which does not require to know the start and end of a sentence? I need to model a system which gets a long sequence of words and creates a long sequence of tokens as long ...
0
votes
2answers
54 views

Building an AI that generates text by itself

Now I know this might break some StackExchange rules and I am definitely open for taking the thread down if it does! I am trying to build an AI that can write it's own book and I have no idea where to ...
2
votes
0answers
33 views

FasterRCNN's RPN network training

I would like to know if my understanding of RPN training is correct, and if never training the RPN on some specific anchor box is bad (i.e if the anchor never sees good nor bad examples). To make my ...
1
vote
0answers
17 views

Optimisation of dependence of efficiency of CNN on training data

I got a large dataset of images (dimensions of 16 x 16, 250k samples) and corresponding spherical coordinates (distributed uniformly in each coordinate). On these, I trained a convolutional regression ...
1
vote
1answer
52 views

How to detect any native language when written in Latin characters?

Assume somebody knows only to write in Latin characters. If they write words of any other language (example: Hindi, French, Latin) using the Latin alphabet, how can I detect that language? Example: ...
2
votes
1answer
58 views

Are there ensemble methods for regression?

I have heard of ensemble methods, such as XGBoost, for binary or categorical machine learning models. However, does this exist for regression? If so, how are the weights for each model in the process ...
0
votes
1answer
51 views

Designing a reinforcement learning AI for a game of connect 4

I've made a connect 4 game in javascript, and I want to design an AI for it. I made a post the other day about what output would be needed, and I think I could use images of the board and a CNN. I did ...
2
votes
0answers
16 views

Which algorithm and architecture to use for 1:1 matrix transformation of an 8X8 dimension?

I would like to map the simplest 8X8 matrices, one to one, but am not sure which AI algorithm would give the best performance. I am thinking about the DeepLearning4j, however, I don't know which ...
2
votes
0answers
22 views

Position of layer normalization in transformer model

In Attention Is All You Need paper: That is, the output of each sub-layer is $LayerNorm(x+Sublayer(x))$, where $Sublayer(x)$ is the function implemented by the sub-layer itself. We apply dropout to ...
1
vote
0answers
14 views

Deep Learning on time series tabular data

In this new book release, at the top of page 51 the authors mention that to do deep learning on time series tabular data the developer should structure the tensors such that the channels represent the ...
2
votes
0answers
26 views

How would one develop an action space for a game that is proprietary?

I'm currently trying to develop an RL that will teach itself to play the popular fighting game "Tekken 7". I initially had the idea of teaching it to play generally- against actual opponents with ...

1 2 3 4 5 20