I think all ARR reviewers should go through the common review issues section before reviewing, regardless of their reviewing experience. I've received too many "The authors could also do [extra experiment X]" comments as weaknesses in this cycle. This is really annoying. (1/2)
aclrollingreview.org
ARR Reviewer Guidelines
A peer review platform for the Association for Computational Linguistics