I received the critic badge even after I immediately undid my downvote. Is rhis a bug or is it by design?
This is by design. The idea is that you do not lose badges once awarded.
For reference, here is the related question at meta.stackoverflow: Is the Critic badge awarded prematurely