West Ham boss Sam Allardyce felt a key miss from Matt Taylor was the vital moment in the 3-2 home defeat by Tottenham.