He's in love with you, too. He just doesn't know how to express it and he left because he felt like he had to. In fact, if I remember right, you were the one that kept telling him Weiss was over when he was trying to find a reason to stay.

He wanted to be with you. He... I never wanted to leave.