I have an AI/ML challenge in relation to video analysis and am unsure where to start.
I am investigating an application that will grade students performance of carrying out a task, based on analysis of a video of them carrying out the task.
The problem has not been sufficiently defined yet but to get a high level idea, imagine video showing close up of a trainee doctor performing stitches to close a wound. the AI model would be trained using many videos of someone performing the stitches correctly and score the trainee on a number of criteria.
Most frameworks will allow detection of objects but taking a video of a person carrying out a task and assessing their success using an AI/ML model feels a step above regular object analysis.
Assumption is we will create the training material, having professionals video themselves carrying out the task successfully, which will also be graded by other professionals to provide a rubric of scores.
I understand this is not something that can be simply answered but an idea of where to start would be very helpful.
- are there specific areas of AI i should investigate?
- are there frameworks that can actually do this ( i have not found any)?
Appreciate any advice.