Such a slanderous vote is obviously made out of spite. The voter should crawl back up that vagina that has had more pricks than a dartboard and let honest writers be.
Careful about the venom. I've learned that often, those low 1 and 2 votes are often more political than personal dislike, as all of my 1 voters are loyal fans, who read each of my stories within days of their posting (I get so few 1 scores, it wasn't difficult tracking what and when they read it).
If someone ranks a story low, it doesn't mean they dislike your stories or you, but if you start saying ugly things, that could change. At this point, they might rate your stories a 2, but still talk about what a wonderful storyteller you are. If you make this personal, he's likely to start badmouthing you to everyone he meets. What's more, those who rated your story positively might decide that your an ass, and start avoiding your stories too.
Generally, when someone says something about a story, it's always best to ignore it and let it roll off your back. Ranting about it always makes you look bad. Readers know when a review is bogus. In fact, terrible reviews often lend credence to the other ratings, as it demonstrates they weren't ALL written by the author and his cronies (much as the ratings on Amazon, Apple and other sites often are, written by the app developer and their staffs).
It's not easy being the bigger man, but it's basic self-preservation. If you allow others to pull you into the gutter with them, you end up living in the same conditions they do.