More than 12,000 people rally to urge the prime minister to stay in office as he decides whether to resign.