Skip to main content
Search type Search syntax
Tags [tag]
Exact "words here"
Author user:1234
user:me (yours)
Score score:3 (3+)
score:0 (none)
Answers answers:3 (3+)
answers:0 (none)
isaccepted:yes
hasaccepted:no
inquestion:1234
Views views:250
Code code:"if (foo != bar)"
Sections title:apples
body:"apples oranges"
URL url:"*.example.com"
Saves in:saves
Status closed:yes
duplicate:no
migrated:no
wiki:no
Types is:question
is:answer
Exclude -[tag]
-apples
For more details on advanced search visit our help page
Results tagged with
Search options answers only not deleted user 37607

For questions related to the multi-armed bandit (MAB) problem, in which a fixed limited set of resources must be allocated between competing (alternative) choices in a way that maximizes their expected gain, when each choice's properties are only partially known at the time of allocation.

5 votes
Accepted

What is the probability of selecting the greedy action in a 0.5-greedy selection method for ...

I read section 2.2 of Sutton and Barto, and I understand your confusion: the $\epsilon$-greedy algorithm is not defined precisely on page 27-28. Selecting an action randomly "every once in awhile" wit …
DeepQZero's user avatar
  • 1,703
2 votes

Why do we use $X_{I_t,t}$ and $v_{I_t}$ to denote the reward received and the at time step $...

Isn't the distribution independent of the time the arm $i$ was chosen? Each one of the two references you describe assumes the context of the random bandit problem proposed by Robbins (1952) where t …
DeepQZero's user avatar
  • 1,703
4 votes
Accepted

How do I recognise a bandit problem?

The bandit problem has one state, in which you are allowed to choose one lever among $n$ levers to pull. Why is there just one state in the formulation of this bandit problem? There is one state …
DeepQZero's user avatar
  • 1,703