May not be related, but if you're on Cedar you'll want to make sure that Pingdom is sending a GET request. I've seen a few uptime monitoring services that send HEAD requests, these worked on Aspen/Bamboo as nginx would translate them on the way through.

I've no idea why these services didn't report that my apps were permanently down :(