1
$\begingroup$

I have a couple opportunities to write a paper, or papers over some of the neural networks I have made.

I was wondering if there are anyways to figure out why the neural network classifies the data I have the way it does. As in, what features of the data the neural network is using to classify the data. The neural networks I'm using consists of ltsm layers, CNN layers, and fc layers.

I have thought about plotting the neural network at everything output, but this doesn't really help to much. Just because there are so many weights that go to each node in a layer it makes it very hard to determine what's happening. I could plot the bias's but I don't know how much influence they have over the weights.

Another thing I considered was adjusting the the values of the input data a little bit at a time and seeing where the classification changes. Which this would work to some extent, but wouldn't allow to me to get the full picture of what the neural network is doing.

So any suggestions on how to do this?

Or any papers that would be help over this topic!

Improve this question
$\endgroup$
1
  • $\begingroup$ Or any papers that would be help over this topic $\endgroup$
    – samuel fipps
    Jun 27, 2022 at 20:58

1 Answer 1

Reset to default
0
$\begingroup$

I ended up using Guided backprop from TorchRay. https://facebookresearch.github.io/TorchRay/attribution.html#module-torchray.attribution.guided_backprop

Improve this answer
$\endgroup$
1
  • $\begingroup$ As it’s currently written, your answer is unclear. Please edit to add additional details that will help others understand how this addresses the question asked. You can find more information on how to write good answers in the help center. $\endgroup$
    – Community Bot
    Jun 29, 2022 at 1:15

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .