Timeline for Why can the Bellman equation be turned into an update rule?
Current License: CC BY-SA 4.0
8 events
| when toggle format | what | by | license | comment | |
|---|---|---|---|---|---|
| Apr 11, 2020 at 14:36 | comment | added | nbro | Note that this is done in other areas of mathematics too. For example, consider the equation of a line. We can easily represent (or approximate) a line in a computer by expressing it in the same way as the mathematical equation. | |
| Apr 11, 2020 at 12:32 | comment | added | nbro | @SaeidGhafouri That formula is converted to an update rule because WE CAN DO THAT (and nobody prevents us from doing that), it's a NATURAL way of implementing that equation in an algorithm, and it turns out that this is the RIGHT thing to do in many cases (because algorithms based on such update rules converge!). There's no rule that tells you that equations need to be turned or not into update rules. We (humans) just do it because that's a natural way of implementing an algorithm that approximates that function. | |
| Apr 11, 2020 at 10:42 | comment | added | Saeid Ghafouri | Thank you for your answer. I understand that since the update rule version of the formula converges it is practical to use it. But my question is how we can use a formula which is not an update rule as an update rule (which converges)? | |
| Apr 11, 2020 at 10:39 | vote | accept | Saeid Ghafouri | ||
| Apr 11, 2020 at 10:41 | |||||
| Apr 11, 2020 at 10:10 | vote | accept | Saeid Ghafouri | ||
| Apr 11, 2020 at 10:39 | |||||
| Apr 11, 2020 at 3:50 | history | edited | nbro | CC BY-SA 4.0 |
added 14 characters in body
|
| Apr 11, 2020 at 1:26 | history | edited | nbro | CC BY-SA 4.0 |
deleted 9 characters in body
|
| Apr 11, 2020 at 1:10 | history | answered | nbro | CC BY-SA 4.0 |