Ricky Ponting says losing the public’s respect will have hurt Steve Smith and David Warner most after ball-tampering scandal.