Vernon Philander had to pull out of the South Africa team for the second Test with Australia in Adelaide because of a back injury.