# Tag Info

Accepted

### How is it possible that deep neural networks are so easily fooled?

First up, those images (even the first few) aren't complete trash despite being junk to humans; they're actually finely tuned with various advanced techniques, including another neural network. The ...
• 2,569
Accepted

### What is fuzzy logic?

As complexity rises, precise statements lose meaning and meaningful statements lose precision. ( Lofti Zadeh ). Fuzzy logic deals with reasoning that is approximate rather than fixed and exact. This ...
• 2,346
Accepted

### How is a deep neural network different from other neural networks?

The difference is mostly in the number of layers. For a long time, it was believed that "1-2 hidden layers are enough for most tasks" and it was impractical to use more than that, because training ...

### How is it possible that deep neural networks are so easily fooled?

The images that you provided may be unrecognizable for us. They are actually the images that we recognize but evolved using the Sferes evolutionary framework. While these images are almost impossible ...
• 1,032

### What is fuzzy logic?

Fuzzy logic is based on regular boolean logic. Boolean logic means you are working with truth values of either true or false (or 1 or 0 if you prefer). Fuzzy logic is the same apart from you can have ...

### How is it possible that deep neural networks are so easily fooled?

All answers here are great, but, for some reason, nothing has been said so far on why this effect should not surprise you. I'll fill the blank. Let me start with one requirement that is absolutely ...
• 1,917

### Is the pattern recognition capability of CNNs limited to image processing?

Convolutional Nets (CNN) rely on mathematical convolution (e.g. 2D or 3D convolutions), which is commonly used for signal processing. Images are a type of signal, and convolution can equally be used ...
• 1,490
Accepted

### What kind of problems require more than 2 hidden layers?

Formally, a single hidden layer is sufficient to approximate a continuous function to any desired degree of accuracy, so in that sense, you never need more than 1. This is called the Universal ...
• 7,176
Accepted

### What is a deep neural network?

A deep neural network (DNN) is nothing but a neural network which has multiple layers, where multiple can be subjective. IMHO, any network which has 6 or 7 or more layers is considered deep. So, the ...
• 1,371

### How is it possible that deep neural networks are so easily fooled?

An important question that does not yet have a satisfactory answer in neural network research is how DNNs come up with the predictions they offer. DNNs effectively work (though not exactly) by ...
• 1,144

### How is a deep neural network different from other neural networks?

A deep neural network is just a (feed-forward) neural network with many layers. However, deep belief networks, Deep Boltzmann networks, etc., are not considered (debatable) deep neural networks, as ...
• 1,371

### What is fuzzy logic?

It's analogous to analogue versus digital, or the many shades of gray in between black and white: when evaluating the truthiness of a result, in binary boolean it's either true or false (0 or 1), but ...
• 329
Accepted

### What is the "dropout" technique?

Dropout means that every individual data point is only used to fit a random subset of the neurons. This is done to make the neural network more like an ensemble model. That is, just as a random ...
• 4,222
Accepted

### Are there any learning algorithms as powerful as "deep" architectures?

Have you read the book The Master Algorithm: by Pedro Domingos? He discusses the present day machine learning algorithms... Their strengths, weaknesses and applications... Deep Neural Network ...
Accepted

### How many neurons would a network have after a training of 100k small images?

The neural network is typically a set size once it's created. You'd have to create a network big enough for your data-set.
• 368

### Why are deep neural networks and deep learning insufficient to achieve general intelligence?

Everyone dealing with neural networks misses an important point when comparing systems with human like intelligence. A human takes many months to do anything intelligible, let alone being able to ...
• 330
Accepted

### How much of a problem is white noise for the real-world usage of a DNN?

The white noise that fools DNNs isn't really white noise. It has been altered in the same way as the synthetic misclassified pictures have been altered. You have to change many input pixels in exactly ...
• 4,127

### Why is no activation function used at the final layer of super-resolution models?

I am not into the field of super-resolution, but I think this question applies to general neural network construction. Usually, you try to solve a classification problem or a regression problem with ...

### What could an oscillating training loss curve represent?

Overview As it has already been observed, your main problem, beside the training related issues like fixing the learning rate, is you have basically no chance to learn such a big model woth such a ...

### What is the "dropout" technique?

The original paper1 that proposed neural network dropout is titled: Dropout: A simple way to prevent neural networks from overfitting. That tittle pretty much explains in one sentence what Dropout ...
Accepted

### How can the generalization error be estimated?

Generalization error is the error obtained by applying a model to data it has not seen before. So, if you want to measure generalization error, you need to remove a subset from your data and don't ...
• 2,059
Accepted

### Has any research been done on DNN Music?

The first thing is to define what is a «good» and a «bad» sound. This is an extremely tricky issue, since the networks need numeric inputs. And music is whole bunch of numbers. I know from people ...
• 538
Accepted

### Should deep residual networks be viewed as an ensemble of networks?

Imagine a genie grants you three wishes. Because you are an ambitious deep learning researcher your first wish is a perfect solution for a 1000-layer NN for Image Net, which promptly appears on your ...
• 4,127

### Why are deep neural networks and deep learning insufficient to achieve general intelligence?

Deep Learning is mostly successful in supervised learning, whereas the brain builds categories mostly in an unsupervised way. We don't yet know how to do that. (Take a look at google brain: 16,000 ...
• 4,127

### What could an oscillating training loss curve represent?

Try lowering the learning rate. Such a loss curve can be indicative of a high learning rate. Due to a high learning rate the algorithm can take large steps in the direction of the gradient and miss ...

### Why do we need target network in deep Q learning?

In DQN that was presented in the original paper the update target for the Q-Network is $\left(r_t + \max_aQ(s_{t+1},a;\theta^-) - Q(s_t,a_t; \theta)\right)^2$ were $\theta^-$ is some old version of ...
• 4,400

### Is the pattern recognition capability of CNNs limited to image processing?

The simple answer is "no, they aren't limited to images": CNNs are also being used for natural language processing. (See here for an introduction.) I haven't seen them applied to graphical data yet, ...
• 4,222
Accepted

### What is the purpose of the hidden layers?

"Hidden" layers really aren't all that special... a hidden layer is really no more than any layer that isn't input or output. So even a very simple 3 layer NN has 1 hidden layer. So I think the ...
• 3,717

### How is it possible that deep neural networks are so easily fooled?

How is it possible that deep neural networks are so easily fooled? Deep neural networks are easily fooled by giving high confidence predictions for unrecognizable images. How is this possible? Can you ...
• 608

### What is a deep neural network?

Deep networks have two main differences with 'normal' networks. The first is that computational power and training datasets have grown immensely, meaning that it's practical to run larger networks ...
• 4,222

Only top scored, non community-wiki answers of a minimum length are eligible