Did you actually need to take the button down?
The mere action of resetting the default would have automatically reset everyones cookie. (just as it did when you went live with the new board)
Those that wanted to change their preferences could then do so at any time.
