That one also rouses my ire. However, because normally I am a person who can see both sides of an issue (which makes having a firm opinion difficult sometimes) I am aware that for other people they do not see it this way. Thus a polite warning first.

Endearments to do with confectionary (hun, sugar, etc.) I have no problems with at all, at least from people I know reasonably well. I'm not sure how I'd react to someone I don't know at all, and who I have no reason to be talking to, attempted to use an endearment to ingratiate themselves.