Secondary camera, ghost overlay, video merge... I do not know if what I mean has a more specific name.

I wonder if this is a thing. This could be insightful for example in racing sports where participants race one after another e.g. alpine skiing, downhill mountain bike, showjumping etc. E.g. comparing the current starter to the leader.

Given the camera position is fixed and only the camera angle and zoom is varying to focus on the current starter, the tasks to be able to overlay videos would be to:

  • match the timing, i.e. both videos start when the timer starts
  • align and overlay the videos according to specific marker points. Keypoint detection and tracking.
  • get the opacity right so that both videos are visible

My question is if there is any research on this. If so, what keywords do I need to search for?

enter image description here

Edit: My seach led me to SIFT (Scale Invariant Feature Transform) and SURF (Speeded-Up Robust Features). Feature matching should be possible with kNN or brute force. A lot can be done with OpenCV.


Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.