The Reds looked to be in for a long and uncomfortable afternoon at St. James' Park when Anthony Gordon's opener was followed up by a Virgil van Dijk red card.
However, Klopp's side rallied in the second half as substitute Darwin Nuñez silenced the doubters with a brace of near identical finishes to give the 10-man visitors an unlikely victory at the death.
The three points on the road keeps up Liverpool's unbeaten run at the start of the 2023/24 season, while it could ultimately prove a vital victory over a top-four rival.
Interestingly, the win also marks a new Premier League record set by Klopp.
Jurgen Klopp's Premier League record against Eddie Howe
The Liverpool boss has now won 11 consecutive Premier League games against Eddie Howe.
In 15 meetings to date, Klopp has only ever suffered defeat once against Howe – way back in December 2016 when Liverpool let a 2-0 lead slip against Bournemouth to lose 4-3, with Nathan Ake bundling in the winner.
Since that day, it's been all one-way traffic with Klopp becoming the first ever Premier League manager to record 11 consecutive wins against another (overtaking Alex Ferguson against Gordon Strachan and Pep Guardiola also against Howe).
11 - Jürgen Klopp has now overseen 11 consecutive Premier League wins against Eddie Howe – the longest winning run in the competition's history by one manager against a specific opposing manager. Authority. pic.twitter.com/xNDszwPoKR
— OptaJoe (@OptaJoe) August 27, 2023
There have been plenty of memorable matches in that time too.
The Reds recorded 3-0 and 2-1 victories over Bournemouth in their title-clinching 2019/20 campaign, with Howe's Cherries failing to even register a shot on target in the first meeting.
There was also a Mohamed Salah hat-trick in the 4-0 back in December 2018.
But perhaps the last three meetings with Newcastle have been the most eventful. Fabio Carvalho sealed a stoppage-time 2-1 win at Anfield in August last year, before Nick Pope was sent off in the reverse 2022/23 fixture as Liverpool ran out 2-0 winners.
After Nuñez's dramatic double on Sunday, Howe must be absolutely sick of the sight of Klopp and Liverpool. Expect more drama in the reverse fixture on 30 December.
Speaking after the game, Klopp called the record-setting performance 'super-special'.
He said: "I think in my 1,000 games as a coach or a manager I never had a game like this, that’s the truth. Not that we never turned games [around], we did that, but 10 men in an atmosphere like this against an opponent like this – it’s not that I can’t remember, I’m pretty sure it never happened because these moments are rare and super-special."