In the paper Parameter Space Noise for Exploration, the authors describe the noise that they add to the parameter vector as:
$$ \tilde{\theta} = \theta + \mathcal{N}(0, \sigma^2I) $$
is $I$ simply the identity matrix, or am I missing something?
Artificial Intelligence Stack Exchange is a question and answer site for people interested in conceptual questions about life and challenges in a world where "cognitive" functions can be mimicked in purely digital environment. It only takes a minute to sign up.
Sign up to join this communityIn the paper Parameter Space Noise for Exploration, the authors describe the noise that they add to the parameter vector as:
$$ \tilde{\theta} = \theta + \mathcal{N}(0, \sigma^2I) $$
is $I$ simply the identity matrix, or am I missing something?
Yes, since $\tilde{\theta}$ is a vector, to define its distribution one needs a covariance matrix. Here $I$ is the identity matrix, which means that the noise has a zero-mean normal distribution with standard deviation $\sigma$, and different components of this noise are uncorrelated.