The game looked to be heading for a stalemate before giant striker Kyle found the back of the net for his sixth strike of the season with 20 minutes remaining.
Argentine midfielder Julio Arca was dismissed with minutes to spare for a second yellow card but The Blades failed to make their numerical advantage count as Mick McCarthy's men go back to Wearside with all three points.
West Brom recorded a valuable win to send them back to the summit of Division One with a 2-0 win away to Gillingham.
Scott Dobie gave the Hawthorns outfit the lead with a strike on 26 minutes with his third goal of the season before Neil Clement doubled the visitors' advantage with a goal just three minutes later to seal all three points for Gary Megson's side.
Norwich City came from a goal down to salvage a point against high-flying Wigan at the JJB Stadium.
Last season's Division Two rompers opened the scoring with a goal after 25 minutes from Andy Liddell.
Evergreen forward Iwan Roberts shot home an equaliser for Nigel Worthington's men though with just over half an hour remaining.
Stoke City were victorious over Paul Hart's Nottingham Forest side thanks to two goals in the opening half.
Stoke caught the visitors napping and defender Wayne Thomas scored his second of the season with a goal on six minutes before former Sheffield United front man Carl Asaba sent the home side into the break with a 2-0 lead with his fourth of the season with 14 minutes remaining of the first half.
Gareth Williams pulled a consolation goal back on 90 minutes but Stoke held on for a win at The Britannia Stadium.
Mark McGhee's Millwall side beat Coventry City with a late winner at The New Den.
It was Millwall who recorded the first goal of the game when Paul Ifill slotted past Scott Shearer on 63 minutes to give the home side the lead.
However, former Liverpool defender Steve Staunton was felled in the box and the experienced stopper picked himself up to ram home the penalty ten minutes later.
The Sky Blues defence could not hold out though and the winner came courtesy of substitute Neil Harris, who slammed the ball home from close range with five minutes to go.
Crystal Palace won a bad tempered affair at Selhurst Park in a game that saw two Cardiff players dismissed.
Wayne Routledge put The Eagles in front with a goal bang on half-time and Neil Shipperley ensured Steve Kember's men ended their recent losing streak when he dinked the ball home at the near post to make it 2-0.
Routledge continued to be a thorn in Lennie Lawrence's side and Wille Boland was given a straight red card on 53 minutes for a crude challenge on the winger, but the Welsh side showed their fighting spirit and pulled a goal back through Graham Kavanagh on 62 minutes.
The Welsh outfit's fate was finally doomed though when Andy Campbell became the second Cardiff player to see red as he was sent off for violent conduct with just minutes to go.
Reading were held to a 2-2 draw by a spirited Bradford City side at The Madejski Stadium.
Steven Sidwell got The Royals off to a good start with an opener after just five minutes but Paul Evans's goal ensured Nicky Law's side went into the break on level terms with an equaliser right on the stroke of half-time.
Bradford then took a shock lead when Andy Gray turned in an effort in front of the travelling Bantams fans after good work from Nicky Summerbee but Andy Hughes equalised on 78 minutes for a share of the points.
Burnley striker Delroy Facey notched a superb hat-trick to see his side on their way to a 3-1 win over Walsall.
Facey opened the scoring for Stan Ternent's side on four minutes but his goal was cancelled out by Paul Merson's equaliser with 24 minutes gone.
The Clarets deserved more than a point after hitting the crossbar three times and Facey eventually got a second on 82 minutes before completing his hat-trick three minutes later.
Wimbledon remain bottom of the league after a 1-0 defeat to Preston North End at Deepdale.
Ricardo Fuller notched his sixth goal of the season on the half-hour mark and bottom side Dons gave themselves an uphill task when they had defender Darren Holloway dismissed just minutes later for a professional foul.
Watford came away from Gresty Road with a shock 1-0 win after being reduced to 10 men in the first half.
The visitors did themselves no favours early on when veteran goalkeeper Alec Chamberlain was sent off for a professional foul midway through the first half, which forced Ray Lewington to bring off striker Bruce Dyer for Lenny Pidgeley to take over in goal.
The Hornets rather surprisingly took the lead on the hour mark when youngster Danny Webber scored and resolute defending saw them keep the Crewe attack at bay.
Ipswich Town recorded their fourth win of the season against Rotherham in a game that was marred by two dismissals.
Pablo Counago put Ipswich in front at Portman Road when he rose highest to meet Jim Magilton's corner three minutes into the second half.
Ronnie Moore's side though were rewarded for their efforts 11 minutes later when Martin Butler headed home his second goal in three games, but Counago fired home his fourth of the season with 20 minutes to go from the penalty spot before the Millmoor outfit had two players sent off in the shape of Martin McIntosh and Julian Baudet in what was a bad tempered affair.
Division One results:
Burnley 3-1 Walsall
Crewe 0-1 Watford
Crystal Palace 2-1 Cardiff
Derby v West Ham
Gillingham 0-2 West Brom
Ipswich 2-1 Rotherham
Millwall 2-1 Coventry
Preston 1-0 Wimbledon
Reading 2-2 Bradford
Sheff Utd 0-1 Sunderland
Stoke 2-1 Nott'm Forest
Wigan 1-1 Norwich
