Crystal Palace manager Alan Pardew says it was frustrating to concede late on from a set piece following their 1-0 defeat to Tottenham.