Skip to main content
Share Your Experience: Take the 2024 Developer Survey

Questions tagged [adversarial-attacks]

For questions about the concept of an adversarial attack in machine learning.

Filter by
Sorted by
Tagged with
2 votes
1 answer

Why do adversarial attack transfer well?

I have read (*) that a common technique to attack a black box AI system based on a neural network is to use it to train a surrogate model to make the same classifications as the black box one. Once ...
Weier's user avatar
  • 131
1 vote
1 answer

What constitutes a 'backdoor' attack in machine learning models?

I've recently come across the term "backdoor attack" in the context of machine learning and I'm trying to understand its precise definition and characteristics. From what I gather, backdoor ...
hanugm's user avatar
  • 3,890
0 votes
0 answers

Is Carlini-Wagner dependent on the network under attack?

In my understanding, black-box attacks such as Carlini-Wagner are, in contrast to white-box attacks like FGSM, independent of the classifier's parameters, but various sources seem to disagree with ...
Value_Investor's user avatar
2 votes
1 answer

Adversarial attacks on AI systems

I am working on an AI system that classifies images of cats and dogs. I am concerned about the possibility of adversarial attacks, where an attacker can make small changes to an image to fool the AI ...
Kanan Suleyman's user avatar
0 votes
1 answer

Why don't people use their own random noise to counter adversarial attacks on computer vision systems?

Why couldn't you take the image an AI is given and apply several different random noise filters to the image and take the democratically most common response and use that for the output of the AI. As ...
Ethan's user avatar
  • 103
3 votes
0 answers

Why do adversarial attacks work on CNNs if they classify images as humans do?

A common illustration on how CNN works is as follows: It seems to suggest that CNN in ...
Sam's user avatar
  • 195
1 vote
1 answer

Do adversarial samples violate the i.i.d. assumption?

I am trying to understand why adversarial attacks work in theory. I have read, that the image is perturbed by a special perturbation $X_{adv}=X_1+p$, but i can't find any reference on that ...
Jan's user avatar
  • 351
0 votes
0 answers

What is the "attack success rate" of an Adversarial Attack?

For a typical adversarial attack, a sample $x_{0}$ is chosen from a training set belonging to class $C_{i}$ and a transformation $A$ is applied such that the adversarial example $x=A(x_{0})$ would be ...
VirginieDlpts's user avatar
2 votes
0 answers

What are the specific differences between vision transformers variants?

I have tried 4 different types of attacks on vision transformers (ViT small and tiny, DeiT small and tiny) but the attack successes on smaller versions are higher than the tiny versions. My ...
Craving_gold's user avatar
1 vote
1 answer

How do you game an automatic trading system by messing with data, as opposed to hacking the algorithm itself?

There was a recent question on adversarial AI applications, which led me to start digging around. Here my interest is not general, but specific: How do you game an automatic trading system by messing ...
DukeZhou's user avatar
  • 6,237
4 votes
3 answers

What is an adversarial attack?

I'm reading this really interesting article CycleGAN, a Master of Steganography. I understand everything up until this paragraph: we may view the CycleGAN training procedure as continually mounting ...
Cyclist's user avatar
  • 41