It seems to me that you should not refund the money. You offered the buyer insurance and the buyer declined to take it. Why should the seller be held responsible? If that was the case no buyer would ever opt for insurance.
