Hi Savio,
I don't think the other person will give you negative rating because he will also get negative rating from you, he may be buying from you just to check, how come you are selling at this rate. Additionally you can block this buyer if you dont want to sell your product to him.
Regards
Abhishek:-)