The Department of Homeland Security said ICE was arresting a "criminal illegal alien"; New York's mayor called it "unconscionable".