Peter Reid's men took the lead within five minutes as Alan Smith added to his goal against Newcastle United last Sunday with another against the North London club with a right foot shot as the Spurs faithful sensed another afternoon of struggle from their team.
Spurs went on to dominate the remainder of the half but had to wait until four minutes from the end to find an equaliser.
It arrived in the form of Argentine stopper Mauricio Taricco who scored only his second goal in a Spurs shirt in this, his 100th appearance for the club as he cut inside from the left to let fly with a wonder goal from range.
Spurs continued their dominance into the second half but could not find a way past Paul Robinson in the visitors' net with Helder Postiga and Bobby Zamora eventually starting to work in tandem to show why Glenn Hoddle shelled out big money for them in the summer.
However, fellow new boy Kanoute made his Spurs debut replacing Zamora on the hour mark and endeared himself to the crowd with a spectacular winner on 71 minutes.
The Frenchman scored his first goal for the club in some style with a brilliantly taken acrobatic overhead kick to ensure Hoddle's men rightfully earned maximum points.
