Generally speaking, you have to be sued in the state where you live, not where the plaintiff lives.

Call his bluff. The easiest way to get rid of him is to tell him you have no time for empty threats, and he should have his attorney contact you by mail.

I am a lawyer. I see this crap all the time.