IMHO, by leaving you a neg feedback, he has basically told you that he doesn't want to come to some kind of compromise solution.

I wouldn't worry too much about 1 neg feedback. 6 months from now, it won't even be a blip on the radar screen.

Cheers!
Bill