Unanswered Questions
3,255 questions with no upvoted or accepted answers
13
votes
1answer
162 views
Will parameter sweeping on one split of data followed by cross validation discover the right hyperparameters?
Let's call our dataset splits train/test/evaluate. We're in a situation where we require months of data. So we prefer to use the evaluation dataset as infrequently as possible to avoid polluting our ...
12
votes
0answers
416 views
How can Viv generate new code based on some user's query?
I have been looking into Viv, an artificial intelligent agent in development. Here is a demonstration of Viv (by Dag Kittlaus).
Based on what I understand, this AI can generate new code and execute it ...
11
votes
3answers
392 views
Can some one help me understand this paragraph from Nvidia's progressive gan paper?
Furthermore, we observe that mode collapses traditionally
plaguing GANs tend to happen very quickly, over the course of a dozen minibatches. Commonly
they start when the discriminator overshoots, ...
9
votes
0answers
99 views
What is the number of neurons required to approximate a polynomial of degree n?
I learned about the universal approximation theorem from this guide. It states that a network even with a single hidden layer can approximate any function within some bound, given a sufficient number ...
9
votes
1answer
3k views
What is the relationship between the size of the hidden layer and the size of the cell state layer in an LSTM?
I was following some examples to get familiar with TensorFlow's LSTM API, but noticed that all LSTM initialization functions require only the num_units parameter, ...
8
votes
0answers
87 views
Given a list of integers $\{c_1, \dots, c_N \}$, how do I find an integer $D$ that minimizes the sum of remainders $\sum_i c_i \text{ mod } D$?
I have a set of fixed integers $S = \{c_1, \dots, c_N \}$. I want to find a single integer $D$, greater than a certain threshold $T$, i.e. $D > T \geq 0$, that divides each $c_i$ and leaves ...
8
votes
1answer
171 views
Extending FaceNet’s triplet loss to object recognition
FaceNet uses a novel loss metric (triplet loss) to train a model to output embeddings (128-D from the paper), such that any two faces of the same identity will have a small Euclidean distance, and ...
8
votes
2answers
300 views
Back-of-the-envelope machine learning (specifically neural networks) calculations
There is a popular story regarding the back-of-the-envelope calculation performed by a British physicist named G. I. Taylor. He used dimensional analysis to estimate the power released by the ...
8
votes
2answers
2k views
What is the difference between search and planning?
I'm studying Artificial Intelligence. A Modern Approach, Stuart Russell, Peter Norvig, specifically about search and planning arguments.
I don't understand the difference between the two terms. I was ...
7
votes
1answer
127 views
What is the point of using 1D and 2D convolutions with a kernel size of 1 and 1x1 respectively?
I understand the gist of what convolutional neural networks do and what they are used for, but I still wrestle a bit with how they function on a conceptual level. For example, I get that filters with ...
7
votes
1answer
142 views
How to deal with a small amount of labeled samples?
I'm trying to develop skills to deal with very small amounts of labeled samples (250 labeled/20000 total, 200 features) by practicing on Kaggle "Don't Overfit" dataset (Traget_Practice have ...
7
votes
0answers
5k views
How do I use GPT-2 to summarise text?
In section 3.6 of the OpenAI GPT-2 paper it mentions summarising text based relates to this, but the method is described in very high-level terms:
To induce summarization behavior we add the text <...
7
votes
0answers
748 views
Is there a difference in the architecture of deep reinforcement learning when multiple actions are performed instead of a single action?
I've built a deep deterministic policy gradient reinforcement learning agent to be able to handle any games/tasks that have only one action. However, the agent seems to fail horribly when there are ...
7
votes
1answer
159 views
Are all fully observable environments episodic?
According to the definition of a fully observable environment in Russell & Norvig, AIMA (2nd ed), pages 41-44, an environment is only fully observable if it requires zero memory for an agent to ...
6
votes
0answers
58 views
Why is my GAN more unstable with bigger networks?
I am working with generative adversarial networks (GANs) and one of my aims at the moment is to reproduce samples in two dimensions that are distributed according to a circle (see animation). When ...
