just let people know up front to cover the fee and you should have minimal problems
far less than you have now
i am guilty of not knowing WHAT the fees is , so i just add a few fto cover it
even when not asked to do so....sometimes