The author of a question named Organizing uploaded media according to the post's publish date (not current date) just removed the question. The 'title' popup says "Voluntarily removed". You can still see it in Google's cache though I don't know for how long. I had an answer to that question with no upvotes (at least per Google's cached copy). When the author removed the post it triggered, or seems to have triggered, a -2 reputation for me.
That is the part I am curious about. It is as if my answer to the question is considered voted down. The -2 is not a big deal but I am curious about the logic, and I haven't been able to find anything that explains it.
I see a similar thing on a post named "Custom e-mail: How is preference decided", which seems to have been removed by community/moderator action, but with that one I didn't have an answer, just a comment, which makes even less sense (at least to me).
What is the logic behind -2 for comments and answers on removed questions?