Jermain Defoe insists he is not worried about losing his starting spot at Tottenham despite the return of Emmanuel Adebayor.