Questions tagged [deep-learning]

For questions related to deep learning, which refers to a subset of machine learning methods based on artificial neural networks (ANNs) with multiple hidden layers. The adjective deep thus refers to the number of layers of the ANNs. The expression deep learning was apparently introduced (although not in the context of machine learning or ANNs) in 1986 by Rina Dechter in the paper "Learning while searching in constraint-satisfaction-problems".

637 questions with no upvoted or accepted answers
Filter by
Sorted by
Tagged with
0
votes
0answers
75 views

Normalization of every patch of CNN input separately

What would be the effect of normalizing each input patch going to Convolutional layer separately. Let's say our input is 64 channels of the size 224x224 (like is the case for some hidden layers in ...
0
votes
0answers
15 views

Can attention with 2d position encoding beat capsule on cv tasks?

I have always had doubts about the necessity and intuitive/theoretical justification for capsule network in image classification and more recently nlp tasks. For the former, in order to address the ...
0
votes
0answers
17 views

Separated LSTMs or a global one for cluster of related features

I have an $n$-dimensional time-series to apply LSTM to, $n$ is the number of features for each time point. These features can be clustered according to their concept, for example $n_1, ..., n_4$ are ...
0
votes
0answers
87 views

TD-Leaf struggles at learning chess

I am currently working on implementing Giraffe chess algorithm. Following this paper, I designed a neural network similar to the one proposed by the author which I trained using TD-Leaf(lambda). The ...
0
votes
0answers
48 views

How GAN generator produce integer RGB colored picture?

For traditional neural networks, I know that we can't constraint the output to be strict integers. My question is what technique does GANs use to produce integer outputs, that can be then converted to ...
0
votes
0answers
91 views

Should the network weights converge when training Deep Q networks?

I have two sets of data, one training and one test set. I use the train set to train the deep q network model variant. I also continuously evaluate the agent Q values obtained on the test set every ...
0
votes
0answers
18 views

Identifying and Labeling multiple letters in image

While I attempt to learn AI/ML I have taken on the task to create a Boggle solver. The idea is that a system could take an image of a Boggle arrangement of letters and identify the letters (and the ...
0
votes
0answers
59 views

LSTM for imbalanced panel data

The available tutorials are most focused on time series prediction. I am wondering how shall we prepare the input data when it is an imbalanced data? Here is how data looks like. ...
0
votes
0answers
18 views

How would one modify CycleGAN in order to map a distribution to itself?

CycleGAN can map between two different distributions $X$ and $Y$ with cycle consistency. This is done with generator functions $F: X \mapsto Y$ and $G: Y \mapsto X$, such that $||G(F(x)) - x||_1 \...
0
votes
0answers
71 views

Reinforcement learning random agent always performing the same few actions

I have a DQN model which has 3 features as inputs (properly normalized) and should output q-values for each of the 100 possible actions. However, prior to any training, I would like to examine the ...
0
votes
0answers
84 views

How does multiple outputs added from intermediate layers of a keras functional model influence its learning behaviour / gradients?

let us assume I have a keras functional model with 2 inputs. My model has two branchs, each branch for each input. The model only uses dense layers. The first input is the data itself (feature vector ...
0
votes
0answers
18 views

Why do code implementations average the loss over a batch instead of finding the expected sample of that batch (using sampling probabilities)

Usually, our training objective over a batch is written in terms of the expected value of a sample in that batch such as $objective = E_{x \sim data} * log(P(x))$ But in the code implementations, ...
0
votes
0answers
29 views

How to stabilize the training of a Conv-Siamese Neural Network if the results after different trainings vary relatively strongly?

I am training a neural network using MSE and ADAM optimizer. More precisely, a siamese architecture with a convolutional encoder and euclidean distance on top. I am using MSE because I have different ...
0
votes
0answers
20 views

Deep Network with constraint or auxiliary features

The target of my current neural network is to predict a label. The dataset contains some features, there is a label $y_i$ in transaction $i$, indicating its classification. There is one feature $f^{i}...
0
votes
0answers
40 views

Are there any papers on this alternate neural net training approach?

I developed a custom callback for Keras. Initially, it monitors training accuracy. If on a given epoch the accuracy is below that of the previous epoch it lowers the learning rate by a factor. If for ...
0
votes
0answers
33 views

Can neural networks always be assembled like Lego blocks?

BACKGROUND Consider a supervised problem which is based on two scalar features (1) and (2) as well as a third, "time-dependent", feature consisting of a sequence of five values (3)-(7). For ...
0
votes
0answers
16 views

Can I use pertained ASR model for SER purpose?

Can I use pertained ASR(Automatic speech recognition) models like deep speech, jasper, to name a few for speech emotion recognition purposes? I was thinking by using the features which are extracted ...
0
votes
0answers
13 views

One model to output the whole vector vs different model to output each vector element

Let's say I'm using a neural net to solve some problem where the output of the net is a vector of some size. What are the advantages (and disadvantages if there are any) of training a single net to ...
0
votes
0answers
35 views

What is the degree of linearity in the error propagated by Gradient Descent?

Neural Network is trained to learn a non-linear function, the more layers it has, the more is the quality of the prediction and the ability to match the real-world function correctly (lets leave aside ...
0
votes
0answers
48 views

Where can I get exercises and problems to implement machine learning models and algorithms?

I'm an intermediate machine learning student and want to get more detailed and specific practical intuition about artificial intelligence. I have made a couple of searches over the well-observed ...
0
votes
0answers
17 views

How can I perform object detection by cutting the image into many pieces each containing one object?

Our task is to do a special object detection: In the traditional case, the neural network will output some rectangle bounding boxes. But in our case, the network should output many nearly-vertical ...
0
votes
0answers
67 views

Intuition behind single-shot object detection

Is there a good way to understand how single-shot object detection works? The most basic way to do detection is use a sliding-window detector and look at the output of the NN to detect if a class is ...
0
votes
1answer
50 views

Hand-Signs Recognition using Deep Learning Convolutional Neural Networks

I am developing a CNN model to recognize 24 hand-signs of American Sign Language. I have 2500 Images/hand-sign. The data split is: Training = 1250 Images/hand-sign Validation = 625 Images/hand-sign ...
0
votes
0answers
119 views

How to calculate covariance matrix of the mini-batch in the k-th layer using Python?

I am a beginner in Python. I want to calculate the covariance matrix of a mini-batch in a given hidden layer.
0
votes
0answers
144 views

Can a neural net learn to read?

I am a student of last year of computer engineering and lately I have been very interested in AI. Fields such as ML and DL seem very disruptive to me. A few months ago I saw an interview of Bill ...
0
votes
0answers
56 views

Pooling vs Subsampling: Multiple Definitions?

I have seen people using pooling and subsampling synonymously. I have also seen people use them as different processes. I am not sure though if I have correctly inferred what they mean, when they use ...
0
votes
0answers
170 views

How do I do further (domain-specific) pre-training with Google BERT in preparation for subsequent fine-tuning?

How do I do further (domain-specific) pre-training with Google BERT in preparation for subsequent fine-tuning? Another way to say this is: can you create a checkpoint file created from the final ...
0
votes
0answers
29 views

Deep Generative Networks Probability of “Success”

I have built various "successful" GANs or VAEs that can generate realistic images reliably, but in either case the generative step is sampling a latent feature vector from some distribution and ...
0
votes
0answers
19 views

Consecutive frames can be discarded when training an SSD/YOLO?

Let's say I have a number of videos, and I want to train an SSD/YOLO (or FRCNN) to detect objects. In the case of a large amount of videos, there will be a lot of frames extracted and transferred to ...
0
votes
0answers
17 views

how to work with multi-labels or two inputs and a output

I’m in this problem and haven’t found a sound solution to it. Been like 20 days now. I have a dataset that looks like this: ...
0
votes
0answers
21 views

How to serve a deep q network using tensorflow serving?

How to Serve a Deep Q Network using Tensorflow Serving. I have built a Deep Q Network using Multilayer Perceptron. Is it possible to serve it?
0
votes
0answers
89 views

Using AI to guess a mathematical pattern of certain polynomials in four variables: practical challenge

I'd like to use machine learning to guess a mathematical pattern: the input are certain polynomials in four variables $q_1,q_2,q_3,q_4$, the output can be zero or one. Allowed polynomials are such ...
0
votes
1answer
519 views

Machine learning to predict 8*8 matrix values using three independent matrices

Problem Statement I have 4 main input features. This is a small snippet of the data for clearer understanding. Gate name -> for example AND Gate index_1 -> ...
0
votes
0answers
41 views

Being able to see how tensorflow “weighs” features in classifier

Say you follow a tutorial on the tensorflow website for a wide and deep model (https://www.tensorflow.org/tutorials/wide_and_deep) I create a model based on the US census data to predict whether or ...
0
votes
1answer
37 views

Advantages of CNN vs. LSTM for sequence data like text or log-files

When do you tend to use CNN rather than LSTM (or the other way round) in classification or generation tasks of sequential data like text or log-data? What are the reasons for the decision and what ...
-2
votes
0answers
20 views

extract desire keyword/text pair

I am looking for extract keyword pair from text files. They might not be next to each other and do not have same pattern for each occurrence. And I would not think regex will works because there is no ...

1
9 10 11 12
13