I have an agent (drone) that has to allocate subchannels for different types of User Equipment.

I have represented the subchannel allocation with a 2-dimentional binary matrix, that is initialized to all zeros as there is no requests at the beginning of the episode.

When the agent chooses an action, it has to choose which subchannels to allocate to which UEs, hence populating the matrix with 1s.

I have no idea how to do it.

  • 1
    $\begingroup$ Can you please be a little more intuitive on what you would like to do? What is a subchannel, UE, and in general what a human being would face in this problem. Describe a use case scenario. This would help to define our env, space and actions. $\endgroup$
    – ddaedalus
    Commented Sep 28, 2020 at 9:47
  • $\begingroup$ To extend ddaedalus' comment, it would help to understand what the goals of the allocation are, and what the difference is between good and bad allocations $\endgroup$ Commented Jun 22, 2022 at 11:10

1 Answer 1


I think this question is hinting at the problem of choosing an exploration strategy.

The simplest strategy is to use the so called epsilon-greedy strategy (or $\epsilon$-greedy). This means that you select an action at random $x$ percent of the times that an agent has to select an action. The other times, the agent takes the action that its current policy dictates. Usually, $x$ declines throughout the learning process.

There are many different exploration strategies to choose from, with the aforementioned one being really the most simple one. For getting an impression of how diverse these different approaches to exploration strategies are, please be referred to Google Scholar (searching for "reinforcement learning exploration strategies").

  • 1
    $\begingroup$ It might be right, but I think you may have jumped in too early with an answer here. It is not clear to me that the op is asking about exploration strategy, they appear to be stuck earlier in the design process $\endgroup$ Commented Jun 22, 2022 at 11:13

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .