Somebody pointed me to this fork of power delete suite: https://github.com/deestan/PowerDeleteSuite

It takes a while longer to run because it waits in between each edit, but best I could tell it got each and every of my 2000+ comments. The original version got most of the edits eaten by rate limiting and only got 25% of my comments at best.