Portsmouth 1 Liverpool 0
The Czech star's early goal was enough to give Pompey the win and inflict the third successive Premiership defeat on Liverpool for the first time under Gerard Houllier.
Liverpool almost got off to a flying start after just two minutes with Emile Heskey latching onto Steve Finnan's long ball and holding off the challenge of Arjan De Zeeuw, but the big striker saw his shot come back off the post.
The visitors were made to pay for that miss just two minutes later with former Reds favourite Berger getting on the end of Sebastian Schemmel's low cross and providing the merest of touches with his right foot to send the ball past Jerzy Dudek.
Portsmouth survived a major scare on the half hour with Shaka Hislop unable to hold onto Steven Gerrard's free kick, but after an almighty goalmouth scramble the hosts managed to clear the danger.
The home side always looked dangerous went they went forward and Yakubu Aiyegbini was unlucky to see his hooked volley from Teddy Sheringham's flick on just drift wide of the target.
Liverpool piled forward in the second half in a bid to get back into the game and John Arne Riise missed a glorious chance to level things up on 50 minutes after the ball dropped nicely to him inside the box, but the Norwegian star blazed his shot over the crossbar.
Portsmouth were struggling to get out of their own half, but were almost gifted a second goal after 63 minutes with Igor Biscan, in attempting to clear Schemmel's free kick, heading the ball against his own crossbar.
The visitors were struggling to put any real pressure on the home side's defence with Gerrard forced to try his luck from long-range, but the shot went straight at Hislop.
Yakubu came within inches of doubling the lead in the final minute with a blistering drive from 25 yards that rattled off the crossbar.
Within seconds Liverpool had moved up the field and almost drew level, but substitute Florent Sinama-Pongolle dragged his shot wide after finding himself one-on-one with Hislop.
The young Frenchman fired another shot just wide of goal a minute later as Liverpool threw everything into attack, but to no avail as Pompey held on for their first win in five games.
