Questions tagged [security]

For questions about the security measures against malicious algorithms, and security measures provided by AI algorithms in detecting, mitigating and preventing breaches and malicious activity.

Filter by
Sorted by
Tagged with
23
votes
8answers
4k views

Is there any research on the development of attacks against artificial intelligence systems?

Is there any research on the development of attacks against artificial intelligence systems? For example, is there a way to generate a letter "A", which every human being in this world can recognize ...
1
vote
0answers
19 views

Encrypting and decrypting model files

I want my models to be accessible only by my programs. How do I encrypt and decrypt the model when I run inference on my model? Is there any existing technology that is widely used?
7
votes
2answers
754 views

Can machine learning be used to develop better reverse engineering/decompilation tools?

I googled this, but other than some papers, I couldn't find any reverse engineering tool that was built using machine learning. I'm not an expert in machine learning and deep learning, but it seems ...
5
votes
3answers
335 views

Can artificial intelligence applications be hacked?

Can artificial intelligence (or machine learning) applications or agents be hacked, given that they are software applications, or are all AI applications secure?
1
vote
1answer
60 views

In what way can we measure control between humans and machines?

This is not a soft question. Neither is this question related to singularity conjecture or wars with robots. This question seeks a mathematical formulation of what is currently only qualitative and ...
4
votes
1answer
34 views

How to design a classifier while the patterns of positive data are changing rapidly?

In some situation, like risk detection and spam detection. The pattern of Good User is stable, while the patterns of Attackers are changing rapidly. How can I make a model for that? Or which ...
1
vote
3answers
221 views

Are preemptive countermeasures indicated?

The Plausibility of Unintended Intelligence Software components applying emerging artificial intelligence techniques are being deployed with RestFUL interfaces exposed to the open Internet. It is ...
9
votes
1answer
297 views

What tools are used to deal with adversarial examples problem?

The problem of adversarial examples is known to be critical for neural networks. For example, an image classifier can be manipulated by additively superimposing a different low amplitude image to each ...
28
votes
9answers
5k views

Is artificial intelligence vulnerable to hacking?

The paper The Limitations of Deep Learning in Adversarial Settings explores how neural networks might be corrupted by an attacker who can manipulate the data set that the neural network trains with. ...
2
votes
2answers
388 views

Could a CNN hear the difference between sound of a pet moving, and a person?

"Deep Learning" neural networks are now successful at image-recognition tasks that I would not have expected say 10 years ago. I wonder if the current state of the art in machine learning could ...
7
votes
1answer
99 views

Which challenges in information security can be solved better using neural networks?

Information security has become a thriving field during the last years. It is a broad domain ranging from planing and building over testing to operating different applications, systems and networks in ...
4
votes
2answers
138 views

Which government agencies oversee development of new AI?

Nick Bostrom talks in his book Superintelligence about the many dangers of AI. He considers it necessary that strong security mechanisms are put in place to ensure that a machine, once it gains ...
8
votes
1answer
200 views

How would one debug, understand or fix the outcome of a neural network?

It seems fairly uncontroversial to say that NN based approaches are becoming quite powerful tools in many AI areas - whether recognising and decomposing images (faces at a border, street scenes in ...
5
votes
1answer
260 views

What will happen when you place a fake speedsign on a highway?

I was wondering what will happen when somebody places a fake speedsign, of 10 miles per hour on a high way. Will a autonomous car slow down? Is this a current issue of autonomous cars?
3
votes
1answer
104 views

How can AI help developer to develop things

I have seen an AI create a game it self, AI act as a lawyer, call center etc. There are many problems (Example for mobile development) ...
2
votes
1answer
77 views

How can genetic programming be used to prevent cyberterrorism?

I've read on wiki that genetic programming has 'outstanding results' in cyberterrorism prevention. Further more, this abstract says: Using machine-coded linear genomes and a homologous crossover ...
6
votes
3answers
603 views

Why did a Tesla car mistake a truck with a bright sky?

Do we know why Tesla's autopilot mistaken empty sky with a high-sided lorry which resulted in fatal crash involving a car in self-drive mode? Was it AI fault or something else? Is there any technical ...