Be honest with him. I know how the " love him like a brother" thing gose. If it's not working then you're just leading him on. I know its really hard but it's harder to mantain a meaningless realtionship. Good luck. ~*PO~*
You need to talk to him about your relationship first. Tell him everything you said in this journal post. If he gets mad, well, you have all the more reason to dump him. If he can't understand your feelings, he's not worth even your friendship.
~*PO~*