Their exits come on the heels of a dramatic political fallout a day earlier, when Migration and Asylum Minister Makis Voridis, along with four deputy ministers, resigned