Updated

BALTIMORE (AP) — Cesar Izturis had three RBIs, Nolan Reimold singled in the tiebreaking run during a three-run sixth inning, and the Baltimore Orioles beat the New York Yankees 5-4 on Tuesday night to become the last team in the majors to win at home.

The victory also gave Baltimore (4-16) its first winning streak of the season. The Orioles defeated Boston on Sunday to end a five-game skid.

Baltimore was 0-6 at Camden Yards before holding off New York before a crowd of 20,536 on a chilly night.

Jorge Posada homered, and Robinson Cano and Nick Swisher each had three hits for the Yankees, who have lost four of five after an 11-3 start.

New York scored two unearned runs in the ninth after Izturis misplayed a two-out grounder to shortstop, but Alex Rodriguez grounded into a fielder's choice with runners at the corners to end the game.

Yankees starter Phil Hughes allowed one run and two hits in 5 2-3 innings. The right-hander issued three of his four walks in the first two innings, which elevated his pitch count and led to an early departure.

As soon as he left, the New York bullpen gave up the lead. Boone Logan walked Luke Scott and was replaced by David Robertson (0-1), who hit Ty Wigginton with a pitch and gave up successive RBI singles to Rhyne Hughes, Reimold and Izturis.

Izturis singled in an unearned run in the ninth after an error by shortstop Derek Jeter.

Alberto Castillo (1-0) pitched 1 1-3 innings of one-hit relief, Jim Johnson worked the eighth and Alfredo Simon got three outs for his first major league save. It was Simon's first appearance in the big leagues since undergoing elbow reconstruction surgery last May.

Orioles starter Kevin Millwood gave up two runs and five hits in 5 1-3 innings. Millwood has a solid 3.38 ERA but has received little offensive support in five starts.

Baltimore went up 1-0 in the second inning when Phil Hughes gave up two straight singles, then issued consecutive walks to Reimold and Izturis to force in a run. Hughes avoided further damage by getting Adam Jones to bounce into an inning-ending double play.

A run-scoring grounder by Brett Gardner tied it in the third, and a big inning loomed when Mark Teixeira walked to load the bases with one out. But Rodriguez lined out to third and Cano hit a fly ball to right.

Posada led off the fourth with his fifth homer, his second in two games. The drive ended a 2-for-17 slump.

NOTES: Randy Winn got his first hit with New York, but made a poor throw from right on Rhyne Hughes' single in the sixth. ... Orioles RHP Koji Uehara (hamstring) pitched a scoreless inning for Double-A Bowie in a rehabilitation assignment Tuesday night. ... The Orioles summoned Simon from Triple-A Norfolk and optioned RHP Kam Mickolio to the same club. ... New York RHP Chan Ho Park, on the 15-day DL since April 16 with a right hamstring strain, threw off flat ground Tuesday at the Yankees spring training complex in Tampa, Fla., but there is no timetable for when he will throw off a mound. "He's not progressing as well as we would like," manager Joe Girardi said.