The visitors could have lead as early as the 11th minute when Izale McLeod pulled a ball back to Mark Marshall, but he blazed high over the bar.
But in the 36th minute, the visitors shocked Rotherham and grabbed the lead when Marshall's in-swinging corner was met by Clovis Kamdjo and with no defender on the post he turned the ball into the net.
Three minutes into the second half, the home side were level. Danny Schofield's corner went up in the air from a defender's head and as the ball dropped Troy Brown volleyed home.
But Rotherham were up against it again after 61 minutes when Michael Raynes felled McLeod for a clear penalty and the former Mk Dons striker picked himself up to slam the ball home from the spot.
Rotherham twice had the ball in the net only to be denied for offside and had confident penalty claims waved aside.
Mark Bradley also hit the bar from outside the box before Le Fondre rescued a point as he raced on to Danny Harrison's pass to fire home through the keeper's legs with nine minutes remaining.
Source: DSG