Orlando, which also fell to the Clippers on Monday in OT, lost to the Hawks in Central Florida on Friday when Josh Smith scored 23 points and pulled down a season-high 19 rebounds as Atlanta escaped Amway Center with an 89-87 overtime win.
Orlando was led by Ryan Anderson, who scored 21 points and pulled down nine rebounds. Howard added a double-double with 18 points and 18 rebounds but it wasn't enough as the Magic lost for the second time in three contests.
"It's definitely tough, we had opportunities," said Magic point guard Jameer Nelson. "We had opportunities, just had to execute a little better."
The Bucks, meanwhile, also needed an extra frame to decide things on Friday but came away a 113-112 winner in Cleveland. Brandon Jennings had 24 points and eight assists to lead Milwaukee in that one.
Drew Gooden added 19 points, including six during overtime, as Milwaukee won its second straight on the heels of a three-game skid.
"The guys battled for it in the fourth and in overtime and made enough big plays to get it," Bucks head coach Scott Skiles said.
The Magic have won 10 of the last 12 meetings with Milwaukee and Howard, who is averaging 20.9 points and an NBA-leading 15.4 rebounds this season, missed Orlando's two defeats over that span due to injury and illness.