I ask them, "Can you hold on for a second?"
When they say yes, I set down the phone and go about my business.

It may not be effective, but for some reason I get a sense of pleasure in wasting some of THEIR time instead of them wasting mine...