Am i just crazy???

No your not, because you just want to talk to him at night and he is just weird, and just doesn't want to talk to you.