Borna Barisic's two second-half penalties, including a last-minute winner, helped Rangers beat Royal Antwerp 4-3 in a topsy-turvy Europa League last-32 first-leg tie.
Joe Aribo's clever finish gave Rangers the lead seven minutes before half-time, only for the hosts to hit back with two goals late on in the first half through Felipe Avenatti's header and Lior Refaelov's penalty after Steven Davis was harshly penalised for a foul on the Israeli.
However, Steven Gerrard's team levelled matters via their own spot kick - awarded after a review by the Video Assistant Referee, who urged referee Georgi Kabakov to consult the TV monitor - with Barisic converting the resulting penalty just before the hour-mark.
Antwerp were soon back ahead, though, thanks to Martin Hongla's fine effort, only for the visitors to show great heart to deservedly turn the match on its head late on.
Firstly, substitute Ryan Kent equalised with a fine solo goal seven minutes from time, before Barisic kept his cool from the spot in the final minute to win it after Abdoulaye Seck had been sent off for giving away the penalty with a deliberate handball.
The second leg takes place at Ibrox next Thursday.
How Rangers gained first-leg advantage over Antwerp
Despite facing injury-hit hosts, Rangers still knew they faced a stern examination of their European credentials at the Bosuilstadion against an Antwerp team sitting second in the Belgium top flight.
However, it appeared as though Rangers would deservedly be going in ahead at the break after they took a 38th-minute lead when Connor Goldson's pass released Kemar Roofe on goal, only for the onrushing Ali Beiranvand to win the race for the ball.
The back-up goalkeeper somehow then lost control of the ball, which broke to Aribo after Alfredo Morelos and Beiranvand battled for possession on the edge of the box, with the midfielder finding the net from 35 yards out.
But it was Antwerp who actually led at half-time. First Avenatti headed home Refaelov's free kick in the 45th minute, and then the latter was brought down by Davis, before converting the spot kick in the eighth minute of injury time.
The visitors came out firing in the second period and it was no surprise when they levelled after Ritchie De Laet was deemed to have fouled Morelos in the box, albeit with the help of the VAR as Barisic netted the resulting penalty.
- Get Sky Sports | Get a Sky Sports Pass
- Live football on Sky Sports
- Get the Europa League from BT Sport on Sky
Seven minutes later, however, Rangers found themselves trailing once again after a well-worked Antwerp move ended with Hongla beating Allan McGregor with a fine shot from the edge of the box.
But just as Rangers thought they were would have to head home after a rare defeat, they hit back themselves with two goals late on, the first a real beauty from Kent, who played a neat one-two with Morelos, before curling home.
In a frenetic finale in which both sides had great chances to win it, it was the visitors who claimed the spoils in dramatic fashion after Seck blocked Kent's goalbound effort with his hand.
The defender was sent off having picked up a second yellow, with Barisic - who was only on penalty duties after captain and regular taker James Tavernier was forced off in the first half with a knee injury - once again keeping his cool from the spot to hand his team a slender first-leg lead.
Rangers maintain impressive run - Opta stats
- Rangers have only lost one of their last 40 matches across all competitions (W33 D6), with that lone defeat coming against St. Mirren in the Scottish League Cup last December.
- This was the highest-scoring European game Royal Antwerp have been involved in since September 1994, when they were beaten 5-2 at Newcastle in the UEFA Cup.
- Rangers conceded three goals against Royal Antwerp this evening, as many as they had in their previous 11 games combined across all competitions.
- In what was his 30th appearance in the UEFA Europa League, Royal Antwerp's Lior Refaelov scored and assisted in the same game in the competition for the very first time.
- Lior Refaelov's goal (52:21) was the second-latest in the first half of a game in UEFA Europa League history, after Fernando Cavenaghi for APOEL Nicosia versus Asteras Tripolis in October 2015 (52:24).
What the manager said...
Rangers manager Steven Gerrard: "I'm obviously very pleased with the outcome of the game in terms of the result. I think the boys showed amazing character to fight for the right result.
"It was a crazy match. I'm sure the neutrals enjoyed it but as a coach I'll be looking into it because we had too many issues defensively.
"The goals we've conceded are poor from our point of view. There is certainly work and a lot of improving to do.
"At this level, you get punished a lot more.
"We've put ourselves in a promising position and it's very difficult to win away from home.
"So there's a lot of me that's pleased and proud but there's still things going around in my head about needing to improve defensively."
Man of the Match - Borna Barisic
The left-back was involved in everything that was good about Rangers on Thursday night, creating numerous chances, as well as confidently stepping up to take on penalty-taking responsibilities in Tavernier's absence.
The experienced Croatia international set up his side's first big opening when his delightful pass sent Morelos through on goal, only for the Colombian to miss the opportunity, while it was also his centre that led to the visitors' first spot kick of the night, which he duly converted.
The full-back then set up a glorious late chance to equalise, but substitute Ianis Hagi somehow missed from three yards out, although it did not matter as Barisic was on hand again to score a last-minute spot kick.
And that means that since the start of last season, only Morelos (12) has been directly involved in more UEFA Europa League goals for Rangers than Barisic (9 - 2 goals, 7 assists).
What's next?
Antwerp host STVV on Sunday (7.45pm), while Rangers take on Dundee United at Ibrox on the same day, with the Scottish Premiership game getting underway at 3pm.