I am a strong Muslim Roxy, and these relationships would simple result in sadness. A great poet said, 'In quest of happiness, youth seek love, but in failure they lose their current happiness'. So I always say no, sometimes its hard when you like that person too, and it takes a lot of guts for a girl to come up and say that.
I feel I am a strong muslim too, I understand your view, and accept it.
I think it's great that you'd say no, because it's not allowed in Islam.
But I just don't think you should feel that you are "unworthy of ones affection", or undeserving, because they chose you for a reason. (: