3
$\begingroup$

Is it possible with any of machine learning methods to train machine to tie shoe lace? If possible how data should be interpreted for the training? If we are using reinforcement learning, how will it learn to reach the best rewards?

$\endgroup$
  • $\begingroup$ I didn't downvote the question..But those who did probably want you to be more specific....State what you have done on your part of the problem..This is not a site for discussion...Here everything is down to brass tacks...State what you want to do, what tools u have, etc etc $\endgroup$ – DuttaA Dec 31 '17 at 12:42
  • $\begingroup$ Great question. Very smart people are thinking about knots! en.wikipedia.org/wiki/Conway_notation_(knot_theory) $\endgroup$ – DukeZhou Jan 2 '18 at 22:44
  • $\begingroup$ @DuttaA it's a good point for certain questions, but what if this is just a high-level, theoretical question from a curious mind? $\endgroup$ – DukeZhou Jan 5 '18 at 20:43
  • $\begingroup$ @DukeZhou for me any1 can ask a hi lvl question but only the geniuses can solve it $\endgroup$ – DuttaA Jan 6 '18 at 4:26
  • $\begingroup$ @DuttaA :) One think I love about Conway's notation is that he uses it to teach children at math camps. Apparently, there are a fair few kids who are interested in knots, and the field is surprisingly complex. But as "theorics" are on topic here, I do quite like this question! $\endgroup$ – DukeZhou Jan 7 '18 at 21:07
6
$\begingroup$

You would not believe how difficult this task is, assuming you want a humanoid robot to tie laces with humanoid hands. It’s possible of course but compared to what the current state of the art in machine learning is, this task is very very complex because it’s a physical system with unknown variables (Eg. coefficient of friction on laces), physical limitations (Eg. dexterity of robotic hands), and occluded vision (Eg. hand in front of laces) to name a couple of the issues one faces not to mention robots are expensive but I digress.

Robots can perform amazing preprogrammed sequences but if you wanted to have a robot to be able to tie any shoe in any situation, machine learning is the right approach.

Training data should include all of the things that humans use when they approach this problem:

  • proprioception (the location of joints in space aka where are your fingers)

    • a sense of touch, a robot would need a quite a few touch sensors

    • vision, although not actually necessary (because blind humans are capable of learning to do this task), it may speed up learning

Using reinforcement learning as a framework, one needs to be able to give the RL agent a signal that it is closer to tying the lace. This could be done in a few ways and it’s unclear what would be the best.

One method would be to train a separate model using supervised learning and pictures of shoes laced up to look at the current state of the bow (or lack thereof) and report if it looks like a tight bow. This method requires a whole other network but it may be the most versatile in the end although the RL agent may just learn how to place laces so it looks like a tight bow.

Although simple for humans, this is an interesting problem and thinking about how it could be implemented helps one understand how to apply ML in other areas.

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.