At JCMS, we used to ask another double blind reviewer (esp a board member if we had one in the field) to evaluate how well the author incorporated the previous reviewer's feedback. Sometimes they added their own suggestions, but we made it clear that we were really only looking for a thumbs up/down.
