CNN attention maps on non-images

Asked 2 years, 3 months ago

Viewed 302 times

My datasets are not actual images, so using methods with ImageDataGenerator or pre-trained networks might not apply in this case.

Data Structure: Each "image" is a 2048-long vector that has float values between 0 and 1.

Each "image" was associated with a label (multi-label classifcation) and the goal is to perform classification via Keras 2D CNN's.

What are common techniques for finding which parts of the "images" contribute most to classification via convolutional neural nets?

I already implemented the CNNs in keras and have already successfully trained on my images.

*No my data is not time series; however, my model works with either the keras Conv1D and Conv2D layers.

Karan

1048 bronze badges

asked Jul 17 '17 at 18:24

rajkarthikkumar

498 bronze badges

1

$\begingroup$ What is the premise to consider the data as image? The input vector is essentially a feature vector of size 2048. $\endgroup$ – Karan Jul 17 '17 at 20:29
1

$\begingroup$ I do not explicitly consider it as an image (hence using the quotes around image); however, I used a CNN as it has image-like qualities. The data has spatial features that determine its label. Regardless, is it possible to get any insight to what the CNN learns on? (whether it may be a CAM or something else) $\endgroup$ – rajkarthikkumar Jul 17 '17 at 20:33
1

$\begingroup$ if your data has signal property then CNN would work. What you are looking for is Saliency Map, you need to do guided back prop to see what your CNN is focusing on. Check out raghakot/keras-vis Github repo. $\endgroup$ – Karan Jul 17 '17 at 20:51

add a comment |

0 Your Answer

Name

Required, but never shown

Post as a guest

Name

Required, but never shown

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy