Before it became clear that Riley resented the fact that Buffy was stronger than him and didn't need him to take care of her. In season 4 he never bothered me. I was never a Briley shipper but he didn't annoy me either. But by the time he left in s5 I was glad to see the back of him and his new "you don't love me enough if you don't need me to take care of you" mentality