Phil Brown has said it would be hard to turn down an offer to work for England manager Sam Allardyce.