In some sense, yes, in that you need diverse trajectories of the agent's behavior in different contexts, but you don't need to have access to those goals, or even the distribution, and the agent might be doing non-goal-directed behavior, such as exploration.
