Reynolds knocked in Matt Wieters with a second-inning grounder that got past third baseman Alex Rodriguez for an error, and later added a fourth-inning double, also bringing home Wieters, as Baltimore posted its 11th victory of the spring schedule.
Baltimore took the lead for good when Ronny Paulino singled home L.J. Hoes in the top of the ninth. The Yankees had tied the game on an RBI groundout by Derek Jeter in the seventh.
The Yankees handed the ball to right-hander David Phelps for the start, wanting to keep the hurler in consideration for a long-relief spot. Phelps permitted three runs (two earned) in five innings, scattering seven hits while walking none and striking out four.
Making his fifth start of the spring, the Orioles' Jason Hammel allowed two runs on five hits in 5 1/3 innings, walking none and striking out five. He served up a long solo home run to left fielder Raul Ibanez in the second inning, Ibanez's second of the spring.
Ibanez has struggled for most of the spring after signing with the Yankees to serve as their designated hitter. He added an RBI single off Troy Patton in the sixth, a run charged to Hammel.
"You're always worried about overexposure early, but I think we got just about the right amount," Hammel said. "Got to see their boppers and pretty much close to their 'A' lineup, and I was very happy with the way it went."
Yankees closer Mariano Rivera made his seventh appearance of the spring, pitching a scoreless sixth inning around a single, and the 42-year-old remains unscored upon in seven innings this spring. He has not allowed an earned run in Spring Training since 2008.
Up next: Brian Matusz will make his final start before the club heads north against the Tigers on Friday. Matusz has pitched well this spring but yielded three runs on six hits in 4 2/3 innings in his last outing. In all, the lefty has given up seven runs in 19 2/3 innings, during which he has allowed 24 hits and struck out 18 batters compared to just two walks. The game is set to begin at 1:05 p.m. ET at Ed Smith Stadium.