1
$\begingroup$

I'm attempting to develop a genetic algorithm capable of discovering classification rules for a given data set, a number of papers make use of the Confidence (precision) and Coverage of a rule to define its fitness.

However I'm not sure my understanding of the equations is correct.

For example confidence is:

conf = |P & D| / |P|

And is defined as follows; "In classification problems, confidence measure is defined as the ratio of the number of examples in P that are correctly classified as decision class of D and the number of examples in P."

Is this saying, the total number of occurrences of the attributes in a given rule P which occur in rules which have been classified as class D, by the number of attributes in P ?

Where an example of a rule containing two attributes would be as follows:

(martial_status = married & age > 30)

It seems a number of papers define it differently which has led to my confusion, if anyone is able to confirm my understanding or provide an some insight that'd be great.

Edit:

The research paper I've been following can be found here.

$\endgroup$
1
$\begingroup$

The confidence equation you are referring to is the definition of precision in the Classification/pattern-recongition/information-retrieval contexts. You can visually understand the equation with the help of the following figure from the wikipedia page:

Visual representation of Precision which you interchangeably with confidence

 P     : Refers to the set of samples in your dataset. (Selected elements)
|P|    : Refers to the number of samples in your dataset.
 D     : Refers to the set of correct class labels.(aka. Ground Truth).
|P & D|: Refers to the number of samples in the dataset that the classifier correctly labeled. 

I hope with this understanding you can implement the fitness function for your Genetic Algorithm. If you want more help in defining the fitness function, then you should probably add details about your approach or links to the research paper you are trying to follow.

| improve this answer | |
$\endgroup$
  • $\begingroup$ Thank you for your reply, I've edited my original post and linked the research paper I've mainly been studying. The problem I'm trying to solve is one of the data sets used in the paper (iris data). $\endgroup$ – Astronought Mar 26 '17 at 21:45
  • $\begingroup$ So from what I understand from the information you provided, do I need to keep referring to the initial items within the data set during the evaluation of a rule's fitness? Lets say I start of with 150 items (50 of each), and during the selection of a given generation I end up with 70 items where 30 of the items are for the classification I am trying to discover a rule for (and the remaining 40 would be split between the remaining two classes), would the equation for the precision be as follows: (30/70) and for the recall 30/50? $\endgroup$ – Astronought Mar 26 '17 at 22:06

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.