I suspect he's not angry about a specific thing, more so that the book exists at all and puts Louis in danger. Plus airing their dirty laundry: even if the events are technically true, there's always something that could be added from the other side.