Hello,
There doesn't seem to be a way to remove someone from your Ignore List once they've been added. It would be nice if that possibility was a feature.
EDIT: Please disregard as it is possible to "Edit Ignore List" from the User CP. I wasn't able to find it until it was pointed out to me.