Siya Kolisi felt South Africa were playing catch up against Ireland after they were dominated physically in the first half.