Besides the (1) reward discount factor, we explored (2) prediction error scaling, (3) probability of disrupting RNN dynamics, (4) rollout buffer length. Each hyperparameter differently influenced the suboptimal decision making behavior, which we termed as delta area.