Lol no. It is a term of admiration. In a dumb harry potter fan way.
Example:
Phil: Hey watch me pick up this chick
Tom: Ok, yeah whatever man haha. (She is way out of his league)
-22 seconds later-
Phil: See ya Tom, I am going home with this babe
Tom:....are you a wizard.....?
SO YES. In this case it was due to the sexiness :o