Jack Duggan was Stourbridge's hero as his late strike saw the lowest-ranked team left in the FA Cup beat Northampton 1-0 to advance to the third round for the first time in their history.
After the original fixture was postponed this one looked to be heading for a replay, but with four minutes left a Luke Benbow free-kick caused all sorts of problems in the visitors' box and Duggan was on hand to slam the ball home and set up a third-round clash at Wycombe.
Gary Hackett's home side started well with Chris Lait firing wide after 10 minutes before Dan Scarr forced David Cornell into a smart save with a header on the half-hour mark.
Duggan glanced wide moments later, before again forcing Cornell into a low stop as the Glassboys dominated.
Those missed chances nearly came back to bite Hackett's men in stoppage time though, but Paul Anderson could only drag his rasping drive wide.
A long throw-in cannoned off the visitors' crossbar as the second period followed the pattern of the first.
Scarr's header was palmed over by the busy Cornell, but the Northern Premier League side got their reward when Duggan pounced to send the War Memorial Ground wild.