Questions tagged [adversarial-ml]

For questions related to adversarial machine learning, which is a branch of machine learning focused on the study of adversarial examples, which are malicious inputs designed to fool machine learning models.

Filter by
Sorted by
Tagged with
2
votes
1answer
41 views

Can a trained object detection model deal with variations of the input?

Suppose an object detection algorithm is good at detecting objects and people when an object and person is close to a camera and upright. If the person walks farther away from the camera and is "...
4
votes
1answer
46 views

What is the relationship between robustness and adversarial machine learning?

I have been reading a lot of articles on adversarial machine learning and there are mentions of "best practices for robust machine learning". A specific example of this would be when there are ...
2
votes
1answer
57 views

What are causative and exploratory attacks in Adversarial Machine Learning?

I've been researching Adversarial Machine Learning and I know that causative attacks are when an attacker manipulates training data. An exploratory attack is when the attacker wants to find out about ...
5
votes
1answer
66 views

Isn't deep fake detection bound to fail?

Deep fakes are a growing concern: the ability to credibly alter a video may have great (negative) impacts on our society. It is so much of a concern, that the biggest tech companies launched a ...
2
votes
3answers
63 views

In adversarial machine learning, how does an attacker have access to the test and training dataset in order to poison it?

In the field of adversarial machine learning, machine learning models are vulnerable to attacks both on the test and training data set. However, how does the attacker get access to these datasets? How ...
2
votes
1answer
55 views

In what ways can financial markets be hacked? [Algorithmic Trading]

There was a recent question on adversarial AI applications, which led me to start digging around. Here my interest is not general, but specific: What are the vulnerabilities of automated trading ...
23
votes
8answers
4k views

Is there any research on the development of attacks against artificial intelligence systems?

Is there any research on the development of attacks against artificial intelligence systems? For example, is there a way to generate a letter "A", which every human being in this world can recognize ...
5
votes
3answers
335 views

Can artificial intelligence applications be hacked?

Can artificial intelligence (or machine learning) applications or agents be hacked, given that they are software applications, or are all AI applications secure?
9
votes
1answer
297 views

What tools are used to deal with adversarial examples problem?

The problem of adversarial examples is known to be critical for neural networks. For example, an image classifier can be manipulated by additively superimposing a different low amplitude image to each ...
28
votes
9answers
5k views

Is artificial intelligence vulnerable to hacking?

The paper The Limitations of Deep Learning in Adversarial Settings explores how neural networks might be corrupted by an attacker who can manipulate the data set that the neural network trains with. ...