Hull KR head coach Tony Smith says the early second half tries by Luke Yates and Ricky Leutele hurt his side in their loss to the Huddersfield Giants.