For my university project, I am planning to build a face recognition/ occupation recognition programme. However, rather than using the existing Haar cascade(for age and gender) I am planning to use Face API which seems far more accurate than the former. My question is is it possible to somehow combine my trained data for Haar cascade(for occupation) with Face API since Face API doesn't have the option to recognize occupation(such as students/office workers from their appearance)?

  • 1
    $\begingroup$ It may help if you provide links to the software you are hoping to use, and explain a little about the labelled data you have (how much, what image content, what kind of source distribution). In addition, this is getting very much into practical model training issues, so might be better asked in Data Science stack exchange. At the moment it is not always 100% clear which of Stack Overflow, Cross Validated, Data Science or Artificial Intelligence is best home for a question like yours. $\endgroup$ – Neil Slater Sep 10 '18 at 5:53
  • $\begingroup$ Thanks for your reply. This is the API I plan on using. azure.microsoft.com/en-us/services/cognitive-services/face $\endgroup$ – Duke Glacia Sep 10 '18 at 6:00
  • $\begingroup$ As of now I would like to be able to detect and track(just Gender and age) and send the output as a JSON file. $\endgroup$ – Duke Glacia Sep 10 '18 at 6:04
  • $\begingroup$ If you want to change the scope of the question after feedback, then it is best to edit the question text to match. This is unlike e.g. a forum where we keep the conversation. Instead it's a bit like WIkipedia: The goal is to create high quality paired question+answers $\endgroup$ – Neil Slater Sep 10 '18 at 11:20
  • $\begingroup$ @DukeGlacia please provide link to your training dataset (Haar cascade) ?? $\endgroup$ – Mohammad Zain Abbas Sep 12 '18 at 10:31

In short, it's possible to achieve occupation detection via face but it's highly doubtful that it can be done with Face API that you mentioned.

Now some details,

Face preception is a very complex job. You have so many parameters to consider before even beginning to design the model.

Many different types of important information are visible in faces and the processes and mechanisms involved in extracting this information are complex and can be highly specialized.


Face perception serves as the basis for much of human social exchange. Diverse information can be extracted about an individual from a single glance at their face, including their identity, emotional state, and direction of attention.

Extracting that much information is not easy.

Face API:

Face API gives you

  • Face Similarity (checks how similar two or more faces are)
  • Face Identification (gives you 27 landmarks like age, gender, facial hair, smile etc confidence level)
  • Emotion detection (check what kind of emotion the face has)

However, in my view, occupation detection via face will going to need a lot more than these basic parameters.

However, previous work utilizing single person’s nearly frontal clothing information and fore/background context preliminarily proves that occupation recognition is computationally feasible in computer vision.

However, in practice, multiple people with arbitrary poses are common in a photo, and recognizing their occupations is even more challenging.

You have to appropriately built visual attributes, co-occurrence, and spatial configuration model that is learned through structure SVM or deep neural nets to recognize multiple people’s occupations in a photo simultaneously.

I am attaching some research papers so you can review them to get more insight.

Reference Papers:

A Comparative View of Face Perception

The many faces of research on face perception

What Do You Do? Occupation Recognition in a Photo via Social Context


Please state your question clearly (like: tell us your problem in detail, and your approach to solve it), and also tell what research you have done before asking the question. Please see how much research effort is expected of stackoverflow users before they post any new questions.


Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.