This is when it started expanding at a rapid rate and conditions became worse. Most of the Sahara still had fertile farmland by the Roman era. The Sahara is still expanding to this day.
Actually thanks to global warming its shrinking.

Africa's deserts are in "spectacular" retreat