The Millers, who beat fellow League One rivals, Port Vale in the first round were one of the first teams to be pulled out of the hat by Sky Sports pundit Matt Le Tissier.
The game at Millmoor will be played on the week commencing 19th September and the Millers will try to recreate the epic first win of last season when they beat their Yorkshire rivals 1-0.