In my opinion nobody does.
Lois is his mother. She doesn't hate him at all. It's just her hardcore-education that makes it look like if she would.
And Herkabe doesn't hate him either. He just plays around with him all the time. I think he is trying to teach him in some strange way... He tries to teach him that life is not fair and that he should be careful all the time. He shows him that when you are gifted, your life isn't easier at all. He challenges him all the time.