26
Yes, there is some research on this topic, which can be called adversarial machine learning, which is more an experimental field.
An adversarial example is an input similar to the ones used to train the model, but that leads the model to produce an unexpected outcome. For example, consider an artificial neural network (ANN) trained to distinguish between ...
12
Sometimes if the rules used by an AI to identify characters are discovered, and if the rules used by a human being to identify the same characters are different, it is possible to design characters that are recognized by a human being but not recognized by an AI. However, if the human being and AI both use the same rules, they will recognize the same ...
10
Yes there are, for instance one pixel attacks described in
Su, J.; Vargas, D.V.; Kouichi, S. One pixel attack for fooling deep
neural networks. arXiv:1710.08864
One pixels attacks are attacks in which changing one pixel in input image can strongly affect the results.
7
Douglas Hofstadter's CopyCat architecture for solving letter-string analogy problems was deliberately engineered to maintain a semantically-informed notion of 'salience', i.e. given a variety of competing possibilities, tend to maintain interest in the one that is most compelling. Although the salience value of (part of) a solution is ultimately represented ...
6
You could say that NAS fits into the domain of Meta Learning or Meta Machine learning.
I've pulled the NAS papers from my notes, this is a collection of papers/lectures that I personally found very interesting. It's sorted in rough chronological descending order, and *** means influential / must read.
Quoc V. Le and Barret Zoph are to good authors on the ...
5
Here is a few that might be what you are looking for:
Deep Sets, https://papers.nips.cc/paper/6931-deep-sets.pdf
BRUNO: A Deep Recurrent Model for Exchangeable Data, https://arxiv.org/pdf/1802.07535.pdf
Deep Learning with Sets and Point Clouds, https://openreview.net/pdf?id=HJF3iD9xe
Permutation-equivariant neural networks applied to dynamics prediction, ...
5
Concentration, perhaps easier to grasp as "focus" or "attention", has quite some history in AI. This answer mentions CopyCat, and there was work with neural networks in the 80s as well (e.g. from Fukushima, creator of the Neocognitron).
More recently, attention in neural networks is gaining momentum. The mechanisms are applied to learning in deep neural ...
5
There's Neural Program Synthesis, which can be used to generate a piece of code. Please, have a look at the article Neural Program Synthesis by Microsoft for an overview of the field.
5
I think that the answer to your question is yes. In the article New A.I. application can write its own code, the authors state
Computer scientists have created a deep-learning, software-coding application that can help human programmers navigate the growing multitude of often-undocumented application programming interfaces, or APIs.
Designing ...
5
Here's an example:
How to hack your face to dodge the rise of facial recognition tech
In his recent book The Fall, Stephenson wrote about smartglasses that that project a pattern over the facial features to foil recognition algorithms (which seems not only feasible but likely;)
Here's an article from our sponsors, Adversarial AI: As New Attack Vector ...
4
There are several generative models that have been proposed before or roughly at the same time of the GAN (2014). For example, the deep Boltzman machine (2009), deep generative stochastic network (2014) or variational auto-encoder (2014).
4
There are several papers related to the topic, because there have been several attempts to show this from slightly different perspectives and using slightly different assumptions (e.g. assuming that certain activation functions are used).
The article A visual proof that neural nets can compute any function (by Michael Nielsen) should give you some intuition ...
4
Isn't that essentially what chess does? For example, A human can recognize that a Ruy exchange offers white great winning chances (because of pawn structure) by move 4 while an engine would take several hours of brute force calculation to understand the same idea.
3
I have implemented Permutational Layer here using Keras: https://github.com/off99555/superkeras/blob/master/permutational_layer.py
You can call the PermutationalModule function to use it.
Implemented following this paper:
https://arxiv.org/pdf/1612.04530.pdf
The idea is to compare all pairs of N^2 pairs from N inputs, use the model with shared weights, ...
3
One of the important qualifications of the Universal approximation theorem is that the neural network approximation may be computationally infeasible.
"A feedforward network with a single layer is sufficient to represent any function, but the layer may be infeasibly large and may fail to learn and generalize correctly." - Ian Goodfellow, DLB
I can't ...
3
There's not really a good textbook yet, but there are more resources than I expected for this topic, so I'll list them as an answer here:
MIT offers a course in this. The slides and lecture videos are up online. It looks fairly speculative to me, and perhaps more application-focused than what was asked for.
There is actually a book called Artificial General ...
3
Nice Question!
This is a perennial topic of discussion among AI researchers. The short answer is "we don't really know which topics are hard in general, but we do know which we haven't got good techniques for yet."
Let's start by explaining why AI is not concerned with notions of computational complexity like NP-Completeness. AI researchers figured out in ...
3
For a foundation, there is nothing better than Cybernetics by Norbert Wiener. It is surprising how advanced this MIT professor was, prior to Turing's thought experiment on a general purpose computing machine or the embodiment of the von Neumann architecture upon which most contemporary computers are based. In key ways his analysis of time series and ...
3
There are many insightful comments and answers so far. I want to illustrate my idea of "color blindness test" more. Maybe it's a hint to lead us to the truth.
Imagine there are two people here. One is colorblind (AI) and another one is non-colorblind (human). If we show them a normal number "6", both of them can easily recognize it as number 6. Now, if we ...
3
Here's a live demo: https://www.labsix.org/physical-objects-that-fool-neural-nets/
Recall that neural nets are trained by feeding in the training data, evaluating the net, and using the error between the observed and the intended output to adjust the weights and bring the observed output closer to the intended. Most attacks have been on the observation that ...
2
A parallel situation might be that of spam/not spam. The detection of spam by AI has been pretty successful, so there is an existing algorithm - classification. However while you have a possible approach you are still missing the key ingredient which is sufficient data to train the model on.
AI depends on a large amount of data to train the model. Ideally ...
2
As far as I know, no one has tried this, due to the way the network is structured. Each input has a set of weights, that are connected to more inputs. If the inputs switch, the output will too.
However, you can build a network that approaches this behaviour. In your training set, use batch learning and for each training sample, give all possible ...
2
Firstly, you should be clear about on which subject you want to study.
AIMA deals with conventional ai algorithms like path planning, logic etc.
Elements of statistical learning is a machine learning book which covers most of the machine learning algorithms you will come across (spare deep learning).
digital image processing is an entirely different field ...
2
In addition to the books already mentioned I would like to recommend you some that helped me understand the basics and guided me through my first AI / CI implementations:
Computational Intelligence: An Introduction by Andries P. Engelbrecht - It includes the most relevant developments in computational intelligence with good discussions on intelligence and ...
2
You may look at these github repositories :
Text classification in NLP with deep learning
Convolutional Neural Networks for Sentence Classification
2
I would advise you to look into Mozilla’s implementation of Baidu DeepSpeech here
2
According to what Josh Dotson posted via medium,gives a clear insightful knowledge concerning the following;
1.Speech data besides speech recognition.
Language modelling.
Text to speech.
Machine translation.
Signal processing.
And lastly, books and blogs for further research
Resources for acknowledgement
2
I don't know about voice recognition but for NLP i think that Gensim could be what you are looking for!
Gensim is a NLP package that contains efficient implementations of many well known functionalities for the tasks of topic modeling such as tf–idf, Latent Dirichlet allocation, Latent semantic analysis...
About the readings, maybe you can start with the ...
2
Understanding a human brain fully, how hippocampus and neocortex works would surely help AI enthusiasts to make better AI algorithms with superior memory, ability to learn and finding what precisely intelligence, feelings and conciousness are by itself. The AI looks at psysiological and anatomical data as a source of suggestions regarding possible mechanisms ...
2
The other answers cover modern work on this, but it's not even a new topic!
Koza's work in 1992 led to whole sub-fields doing this. The techniques are widely used, robust, and well understood. They're just very computationally expensive. Enough so that most of the time you're better off just hiring a programmer to do it.
Only top voted, non community-wiki answers of a minimum length are eligible
