West Ham manager Sam Allardyce was left frustrated by his team's 1-0 defeat to Spurs in an incident-packed game which saw both sides reduced to 10 men.