Two goals in the last five minutes from striker Paul Rowntree gave Billingham Town the scalp of UniBond League side Harrogate Town.
But manager Alan Robinson was quick to concede that Harrogate were more than a match for his side.
"Harrogate might be bottom of the UniBond League, but they were the better side in the first half," he said. "But they didn't really create anything, and I thought we deserved to win on our second half display."
Harrogate hit the bar in the first half, but Billingham came more into the game and set up a stirring finish.
Jamie Clark broke down the right and Rowntree scored from his low cross, and in the last minute Lee Tucker cut in from the right and set up Rowntree to tap in.
Horden CW will be at home to UniBond League Premier Division side Gainsborough Trinity - who had a spy at their tie with Tadcaster Albion - in the second qualifying round on September 30.
Horden, mid-table in Division Two of the Albany Northern League, won 1-0 with a 28th-minute goal from Craig Stephens, the chance carved out by Phil Nicholson.
Gainsborough lost 3-1 at Bishop Auckland in a Premier Division match to slip to third from bottom.
It was a real battle for Horden, particularly in the second-half, and goalkeeper Simon Hall made two outstanding saves, including one from Darren Wilson three minutes from time.
Horden's new manager Jim McGrath, unbeaten in his three games in charge, said: "When you are away in the FA Cup you know that it will be a battle. We proved that we are not just a footballing side, but a battling one.
"I am delighted with the win. Roll on Gainsborough, I can't wait."
Seaham Red Star were the day's top scorers, hammering Great Harwood 7-0. David Ross scored from a Gary Innes pass after 15 minutes, then Steve Newham got the second from a Ross flick. Lee Adamson scored a good solo goal for the third just on half time, and in the second half the floodgates opened. Innes quickly got a fourth, with Newham adding three more.
Seaham will now play Easington, who beat Yorkshire Amateurs 2-1 after being a goal down.
They took the lead when new signing Paul Pitman and Christian Robson combined for Andy Allen to beat a defender and score, then Dominic Rice provided the pass for Robson to turn quickly and fire home.
Bedlington were also among the goals, winning 5-1 at Harrogate RA. They took the lead after 20 minutes through a Steve Locker header, then John Milner got a second from a Brian Rowe pass. Harrogate rallied briefly and pulled one back after 70 minutes, but Bedlington moved up a gear. Milner restored the two-goal lead with a header from a Christian Graham cross. Recent signing Anthony Chapman chipped the fourth, with Dean Gibb getting the fifth from close range.
West Auckland beat Selby 3-1, all the goals coming in the first half.
West took the lead when Jonathan Milroy headed in a corner from Ray Stanger, then Dale Anderson scored with a piledriver from 35 yards.
Milroy then made it 3-0 with a first time shot from Paul Stout's pass, with Selby pulling one back before half time. West defended well in the second half.
Durham City won the all Northern League clash against Newcastle Blue Star by 3-1.
City took the lead in their opening attack when Michael Canavan scored from a Stuart Irvine corner, but Blue Star levelled with a Shaun Beech penalty after he had been fouled.
Former Hartlepool player Gus DiLella put Durham back in front from the rebound after Irvine's shot hit the post, then he wrapped things up with a deflected shot after 75 minutes.
Whitley Bay beat Consett by the same scoreline. Warren Dawson put them in the lead from 25 yards after ten minutes, but Tony Halliday levelled from a pass by Chris Hodgson.
Whitley went back into the lead when Marc Nash broke through and beat Consett keeper James Platten, and after Whitley keeper David Sproat made an excellent save, Whitley went down the other end and made sure through Nash.
Marske United won 1-0 at Thornaby, despite having Michael Kinnair sent off for a professional foul. Midfielder Neil Hodgson got the goal from a John Woods pass after 34 minutes.
Dunston went out 2-1 at home to Fleetwood Freeport, who have now beaten three Northern League sides in the competition. Dunston led at the interval with an Andrew Fletcher goal
Comments: Our rules
We want our comments to be a lively and valuable part of our community - a place where readers can debate and engage with the most important local issues. The ability to comment on our stories is a privilege, not a right, however, and that privilege may be withdrawn if it is abused or misused.
Please report any comments that break our rules.
Read the rules hereComments are closed on this article