Neuville takes Germany through
With the game looking destined for extra time, Germany finally broke down the Paraguayan rear-guard when Bernd Schneider was released down the right and his cross was converted with aplomb by Neuville with just three minutes left on the clock.
In the dying seconds frustrated Paraguay were reduced to ten men when Michael Ballack was elbowed by Roberto Acuna who was shown the red card.
A dull game saw neither side willing to change their natural defensive games, and a sparse crowd given little reward for turning up.
Germany progress through to the quarter finals where they will face Mexico or the United States, whilst Paraguay bow out in poor fashion and may rue not taking a more attacking attitude.
After a low key first half the pace was raised a little in the second half, but the game rarely lifted itself above a drab contest.
Schneider and Campos had drives at either end of the pitch, but found their shots easily stopped by the respective keepers.
Schneider also had a free-kick float just wide, whilst Jose Chilavert was right behind a Neuville effort.
Torsten Frings worked well from the wing-back role, but after cutting inside his marker blazed a woeful shot over the top, and even a Chilavert free-kick that never looked likely to trouble Oliver Kahn failed to lift the crowd.
But the crowd were saved the unpalatable prospect of half an hour more of the game when Neuville scampered to the near post and met Schneider's low cross with a fine half-volley that left Chilavert no chance.
The first half had brought even less to lift the sparse crowd dotted around the stadium - a disgraceful turn out for a second phase game.
Paraguay looked defensive at times, but their ability to launch the ball forward troubled their German opposition on occasions and the South Americans perhaps shaded it in chances over the opening period.
Neuville had been close to playing Marco Bode in within three minutes, and Michael Ballack saw a header flash across the goal from a set-piece.
At the other end Denis Caniza flashed a shot that Kahn looked to have covered easily, until the final few yards of the ball's flight drew a nervous flick of the hand from the experienced goalkeeper.
Paraguay could have retreated into their shell when star man Roque Santa Cruz was withdrawn with a groin injury, but to their credit substitute Jorge Campos added impetus to the attacks.
Marko Rehmer gave Kahn a fresh scare when his back pass left the keeper to dash out to claim ahead of the lurking Campos.
The custodian looked less sharp when he opted to punch a Chilavert free-kick and was very nearly caught out when the ball came back in to Celso Ayala - who wasted the fine chance.
But the most exciting moment of the half came from Campos, who found himself half a yard of space after bringing down a lofted ball and produced a fine shot that was only diverted on its path to the top corner by a brilliant diving save from Kahn.
Germany: Oliver Kahn 8*, Torsten Frings 7, Thomas Linke 6, Marko Rehmer 6 (Kehl 6), Christoph Metzelder 6 (Baumann 6), Bernd Schneider 6, Jens Jeremies 6, Michael Ballack 6, Marco Bode 6, Miroslav Klose 6, Oliver Neuville 7 (Asamoah 6). CLICK HERE FOR OUR LIVE MINUTE BY MINUTE REPORT AND ALL THE LATEST STATS
Paraguay: Jose Luis Chilavert 6, Franciso Arce 5, Carlos Gamarra 6, Celso Ayala 7, Julio Cesar Caceres 6, Denis Caniza 7*; Carlos Bonet 6 (Gavilan 6), Roberto Acuna 5, Estanislao Struway 6 (Cuevas 7), Jose Cardozo 7, Roque Santa Cruz 6 (Campos 7).
To see reaction from the German camp, click here.
To see reaction from the Paraguay camp, click here.
Click here for our new feature Best of the Day