Joseph Parker and Hughie Fury both insist that the controversy over the referee for Saturday's world title fight is not distracting them.