The sulphur will burn, just as the paper will burn. However, it's a pretty small risk if you store them so the match head cannot contact the oxidizer on the striker.

After all, they are called SAFETY MATCHES [g].